Wednesday, May 25, 2022
HomeNewsIIIT Hyderabad Ph.D. Scholars Develop AI tool to replace Subtitles on OTT

IIIT Hyderabad Ph.D. Scholars Develop AI tool to replace Subtitles on OTT

The app can automatically dub foreign languages into a language chosen by viewers to help them better consume video contents online.

Ph.D. scholars from the  International Institute of Information Technology (IIIT) Hyderabad are developing a novel artificial intelligence (AI)-powered tool that can be used to replace subtitles on OTT platforms. 

Two Ph.D. scholars from IIT Hyderabad’s Center for Visual Information Technology have come up with an AI-powered online tool named Way2Lip that can drastically change the use of subtitles on online video streaming platforms. 

In today’s time, when the gen-z is shifting towards OTT platforms such as Netflix, Amazon Prime, Disney+ Hotstar, and are readily consuming entertainment pieces from various parts of the globe, it sometimes becomes difficult to cope with the visuals and subtitles simultaneously. Therefore, the overall viewing experience of multimedia consumers gets hindered. 

Read More: Sonos to launch new Voice Assistant

In a couple of minutes, the patented tool NeuralSync AI can morph authentic-looking dialogues utilizing a single video clip of a human or digital avatar in the viewer’s preferred dialect, making it a potential replacement for traditional subtitles. 

According to the developers of this unique AI application, it can automatically dub foreign languages into a language chosen by viewers to help them better consume video content online. 

Under the leadership of Prof CV Jawahar and Prof Vinay Namboodiri, Rudrabha Mukhopadhyay and Prajwal KR created this US-patented technology. When Way2Lip gets integrated into an OTT platform, subscribers in any part of the country will be able to watch a video in any language of their choice with dubbed dialogue. 

Co-developer Rudrabha claims that except for Mandarin, almost all European and Asian languages can be easily dubbed, and with AI integrating with video production, mismatched lip motions will be a thing of the past.

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our Telegram and WhatsApp group to be a part of an engaging community.

Dipayan Mitra
Dipayan Mitra
Dipayan is a news savvy writer, who does not leave a single page of news paper unturned. He is also a professional vocalist who enjoys ghazals. Building a dog shelter is his forever dream.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular