ElevenLabs Launches Dubbing Studio: Revolutionizing Video Localization with AI

www.analyticsdrift.com Image source: Analytics Drift

Dubbing Studio's Introduction

[{"selector":"#anim-4d17606c-bd14-4320-84ff-f007e64ee90f","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-64d8a01f-5509-4fa9-ab1f-adb606f41e76","keyframes":{"transform":["translate3d(0px, 175.19839%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1ad3e398-4dcd-44e6-979b-77323e984cdc","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f9989c23-10ee-4ce2-bf58-fb6d342e1fea","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] ElevenLabs unveils Dubbing Studio, a cutting-edge tool offering automatic, end-to-end video translation across 29 languages. Image source: Canva

Hands-On Localization Control

[{"selector":"#anim-8464b3f9-9421-4ec1-90e4-a18f6a32fd7d","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0778502e-6e9f-459a-a46a-cfcbf401857b","keyframes":{"transform":["translate3d(0px, 203.62051%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-fb00eeed-e5de-4c98-bf86-4af3f37a4dc4","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3e091242-a4c8-40e7-95dd-9e03a65c2aae","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] With Dubbing Studio, users gain detailed control over transcript, translation, and timing for precise localization. Image source: Canva

Advanced Transcription and Translation

[{"selector":"#anim-c3ca947d-444d-48b5-9f8c-e46c9b4df693","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-5720ada4-6b07-44e2-ab74-26efa1a09d14","keyframes":{"transform":["translate3d(0px, 193.50815%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f17dcf69-b873-497b-bd17-f08b18d9166e","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-6648f8b9-f27c-46f5-a73f-0fbd32a5e95d","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] The tool automatically transcribes content, translates it, and generates a new audio track in the chosen language. Image source: Canva

Voice Cloning for Consistency

[{"selector":"#anim-94db52c8-72f3-40f1-9c95-15d789a85323","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ddda88ed-77b3-4479-accb-c6913ccab6e2","keyframes":{"transform":["translate3d(0px, 229.30753%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dbea7163-339d-4d0b-827f-bdbb33d03d8d","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-aa66abd7-0edb-49c8-8ac6-5aa862be940c","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Unique voice cloning ensures each speaker maintains the same voice across different languages. Image source: Canva

Editable Transcripts and Translations

[{"selector":"#anim-2e4fbf7a-3c18-4369-ba74-0b047ae53abb","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-6c168828-16f1-49de-bf72-7060d542db06","keyframes":{"transform":["translate3d(0px, 198.00254%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0d3dd4db-7626-4b03-980e-b82b3ba58166","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-00d54a8d-ec20-4018-8792-d0f2d981779f","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Users can generate, edit, and re-generate transcripts and translations for tailored localization. Image source: Canva

Customizable Voice Settings

[{"selector":"#anim-da8481d2-d75b-4ab0-860d-2febd94af8fa","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3b772d25-ae75-43ff-bc1e-51bc3dbfe526","keyframes":{"transform":["translate3d(0px, 198.00254%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-713cd8ba-8a38-4a91-9bea-a02cd83cf146","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e08c9b94-f776-4d2f-9f2a-3097c29ff8a2","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Dubbing Studio allows adjustments in voice stability, similarity, and style for each audio track. Image source: Canva

Synchronizing Dialogue with Action

[{"selector":"#anim-d37dce16-c3b5-4006-a22f-325e9fec3742","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bb55398a-a92b-4c95-96ae-a117225dc8e0","keyframes":{"transform":["translate3d(0px, 227.85827%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-5d606486-5c56-4102-aa4a-a5aa6d544c30","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4f8f703e-6b67-45e2-a51c-abe5d3a840a0","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Adjust timecodes in the tool to ensure dialogue aligns perfectly with on-screen action. Image source: Canva

Enhancing Translation Accuracy

[{"selector":"#anim-171efe92-bbaa-4d98-9dfd-40514a95a74b","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4fe2f031-2d7e-4607-80f6-5e50ec62af2d","keyframes":{"transform":["translate3d(0px, 191.26099%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-90f6dd6d-ebf1-4c70-886a-af2baed06ed8","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7b6284cc-2a8f-4ed8-8953-1f3518580f67","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Edit translations for more natural language use, like avoiding repetitive words for better audience engagement. Image source: Canva

Seamless Language Addition

[{"selector":"#anim-3a0ff880-b7e2-437e-a5d1-1ef418076333","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8f3a543b-77a0-446e-bb96-fbf0ae931628","keyframes":{"transform":["translate3d(0px, 224.95976%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-63302cf0-86a4-41e3-a89c-11be11386d50","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-aa4592e2-f5cf-4583-a0d5-f2852b85ba10","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Easily add more languages to your project, expanding global reach and accessibility. Image source: Canva

Conclusion

[{"selector":"#anim-99daee75-e171-49a8-831d-dcad5d7a8836","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-566e903a-7d1b-4d35-b391-7a7599b43e3b","keyframes":{"transform":["translate3d(0px, 210.36213%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d7526fd3-044f-4ee5-b166-6fada750be92","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-14dc008e-c25d-484e-9924-1af204fc55d3","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Dubbing Studio by ElevenLabs marks a significant leap in video localization, offering unparalleled control and customization. Image source: Canva Read more

Get the latest updates on AI developments

[{"selector":"#anim-01fd98a7-111e-4fdd-8ded-3243612626c4","keyframes":{"opacity":[0,1]},"delay":200,"duration":1500,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-cfc1ea14-ab5e-4834-bc02-63b3039320b3","keyframes":{"transform":["translate3d(-103.35917%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-192224d3-4360-4950-a879-80257f97ebcd","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-16bf57ae-1501-4e86-bd3a-ed84cdd0c903","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-429385c3-4b39-4017-92e3-9f4ccad70c6c","keyframes":{"transform":["translate3d(134.00810%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-064fec45-431b-4164-8bf4-252e3762169e","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2777a791-bc62-443e-be3a-5ae3fc302ccd","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-8edbd53a-6b16-47f0-8421-5316c636a43e","keyframes":{"transform":["translate3d(129.34363%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ae709b8e-de3d-458a-a19f-2bf163363c0f","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3df7a153-6ddc-4f66-b907-6db41fd4cf98","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] Produced by: Analytics Drift Designed by: Prathamesh Join Now