With the aid of AI, YouTube aims to make it simpler for users to dub videos in different languages. The company said at VidCon on Thursday that it is hiring the team from Google’s Area 120 incubator’s AI-powered dubbing service Aloud for the job.
According to the website for Aloud, this is how it functions. The video is initially transcribed by the programme, which then provides users with a transcription that can be checked and adjusted. The dub is then created after translation. The specifics are in the video above.
According to YouTube’s Amjad Hanif, hundreds of creators have already participated in testing the service. According to spokesperson Jessica Gibby, Aloud is currently available in English, Spanish, and Portuguese. Hanif also claims that although Aloud supports a few languages, there are more to come in the future.
Read More: Vimeo Introduces AI-Powered Script Generator And Text-Based Video Editor
Aloud could be a helpful tool even with its limited language selection as more and more creators add multi-language dubs to their videos. Additionally, users may listen to a sample of Aloud’s output by seeing this video from the Amoeba Sisters channel and listening to the Spanish dub track.
YouTube is eventually “working to make translated audio tracks sound like the creator’s voice, with more expression, and with lip sync,” according to Hanif. According to Gibby, those features will be unveiled in the year 2024.
