Ph.D. scholars from the International Institute of Information Technology (IIIT) Hyderabad are developing a novel artificial intelligence (AI)-powered tool that can be used to replace subtitles on OTT platforms.
Two Ph.D. scholars from IIT Hyderabad’s Center for Visual Information Technology have come up with an AI-powered online tool named Way2Lip that can drastically change the use of subtitles on online video streaming platforms.
In today’s time, when the gen-z is shifting towards OTT platforms such as Netflix, Amazon Prime, Disney+ Hotstar, and are readily consuming entertainment pieces from various parts of the globe, it sometimes becomes difficult to cope with the visuals and subtitles simultaneously. Therefore, the overall viewing experience of multimedia consumers gets hindered.
Read More: Sonos to launch new Voice Assistant
In a couple of minutes, the patented tool NeuralSync AI can morph authentic-looking dialogues utilizing a single video clip of a human or digital avatar in the viewer’s preferred dialect, making it a potential replacement for traditional subtitles.
According to the developers of this unique AI application, it can automatically dub foreign languages into a language chosen by viewers to help them better consume video content online.
Under the leadership of Prof CV Jawahar and Prof Vinay Namboodiri, Rudrabha Mukhopadhyay and Prajwal KR created this US-patented technology. When Way2Lip gets integrated into an OTT platform, subscribers in any part of the country will be able to watch a video in any language of their choice with dubbed dialogue.
Co-developer Rudrabha claims that except for Mandarin, almost all European and Asian languages can be easily dubbed, and with AI integrating with video production, mismatched lip motions will be a thing of the past.
