Adobe VideoGigaGAN Makes Blurred Video Sharper by 8x

www.analyticsdrift.com Image source: Analytics Drift

Introducing Adobe VideoGigaGAN

[{"selector":"#anim-f5c04ddb-0ab5-4c75-b448-eb7339072fd6","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-59e3d3b4-0b2a-42b2-aa9f-b262b0efed87","keyframes":{"transform":["translate3d(0px, 171.49762%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e9071f5a-8e18-4a43-82d0-255f0e92ccbf","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7b0b0888-4ae6-47dc-a4c6-f30d8b430340","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Adobe launched a paper on April 18th on a new generative AI, VideoGigaGAN, which upscales low-quality videos by 8x their original value. Image source: Adobe

GigaGAN Gets Temporal Boost

[{"selector":"#anim-c48b3bee-b09a-48e0-b02d-8db18b870836","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c3225916-7b0d-4935-a7c9-825896560341","keyframes":{"transform":["translate3d(0px, 149.43637%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8c5c5599-90a0-4ff6-87a5-4a6240cfe9ac","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-82c7be61-43f1-48c5-baee-6f6d390beecf","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] VideoGigaGAN is built upon the large-scale image upscale GigaGAN and has significantly improved the temporal consistency of upsampled videos by adding temporal modules. Image source: Adobe

Higher Resolution

[{"selector":"#anim-44dc03cf-c1b9-43b6-a0d8-150ef3fc2651","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-abdd115d-178b-4d06-9f27-e3df2fc38717","keyframes":{"transform":["translate3d(0px, 181.93242%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d1167a30-f82c-47bf-8919-0d5529a48ed9","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-fa8c9915-55e4-4077-9bd5-899c2506f5dd","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] VideoGigaGAN aims to provide the best of both worlds—the higher image/video quality of GAN models with few flickering or distortion issues across output frames. Image source: Canva

AI Upscaling Tech Tackles Detail Loss for Smooth Results

[{"selector":"#anim-34a4a674-8a77-4e7b-a17a-245c105c1766","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3cd6036d-4c94-4c79-936e-a3da67f213f6","keyframes":{"transform":["translate3d(0px, 161.06282%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-05a762ee-b5e8-4baa-bab8-fbdcfcb8149d","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7413a061-4b8c-4ef8-b1f0-ee41193d5a06","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] They introduced a “flow-guided propagation module” and a “high-frequency features shuttle” for sudden drops in detail to ensure consistency among a video's frames. Image source: Canva

Video Upscaling Demo

[{"selector":"#anim-0ad26057-53e4-4360-b23a-3218d14d3da9","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ea1b5a17-3cbf-4e2c-a93f-905a9872df15","keyframes":{"transform":["translate3d(0px, 172.36717%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-08104c4e-a86e-4553-83f4-a742dc41c654","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bf396c08-7028-46ad-8b10-12b14f33a3ff","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] To show its potential, they have given a demo where an old movie from the 1940s goes from running at a 480x360 image resolution to a crisp 1280x960. Image source: Adobe

Adobe’s AI Push

[{"selector":"#anim-b7a4af56-e493-431c-80cc-a8179c794ffd","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-309e9277-40e0-4b65-aa0d-1d3e39199847","keyframes":{"transform":["translate3d(0px, 176.71504%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c0118602-7056-4e2b-ae9d-362686ca8eb2","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-b5df2caf-dbff-4789-9e52-0d290e923a22","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] In the past year, the company has been focusing heavily on implementing AI into its software from the launch of Firefly and Acrobat’s new assistant. Image source: Adobe

Not In Promo Yet

[{"selector":"#anim-13ad8298-7382-4e13-b101-ef648d137db5","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c4b11cc6-c15e-4459-9110-6b199db95ab6","keyframes":{"transform":["translate3d(0px, 174.97588%, 0)","translate3d(0px, 0px, 0)"]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4b5bee35-42bd-4918-9427-938bc8da5e1c","keyframes":{"opacity":[0,1]},"delay":120,"duration":1300,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f294c2b8-3f4b-4b8b-9e4c-74b291ece130","keyframes":{"opacity":[0,1]},"delay":120,"duration":1200,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] For now, VideoGigaGAN is just a research preview, and there are no immediate plans to bring it to Premiere Pro or its Creative Cloud Suite. Image source: Canva

Get the latest updates on AI developments

[{"selector":"#anim-05bbb3f0-3e8b-471e-84f2-001fb224aae7","keyframes":{"opacity":[0,1]},"delay":200,"duration":1500,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e8aa9100-515a-40e3-af3f-ce94f1a1afc9","keyframes":{"transform":["translate3d(-103.35917%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4e1ad352-5857-4064-8bfc-fb01f0fdfff1","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1d631bd3-d0e2-4226-85d0-7af5c84240c3","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-2097bfa5-6a80-4c62-b807-a14724a627aa","keyframes":{"transform":["translate3d(134.00810%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-5e0c0633-dd3a-44eb-aade-50027f682da2","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-da1da7ab-e79d-4c37-b11b-71c4d5df7bbe","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-05c3a5c3-e2a5-499c-9095-38b31464328f","keyframes":{"transform":["translate3d(129.34363%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d80566ac-bfaf-4d9b-9a0b-ef53e806919b","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a93ec8d1-e4f7-4ad6-a613-b6a90afb585b","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] Produced by: Analytics Drift Designed by: Prathamesh Join Now