www.analyticsdrift.com
Image source: Meta
On October 18, 2024, Meta announced the open sourcing of Movie Gen Bench, its audio and video media generation benchmarks.
Image source: Meta
Meta recently unveiled the Movie Gen AI model, which generates 1080p HD videos with various aspect ratios and synchronized audio.
Image source: Meta
Benchmark data was introduced in the Movie Gen model to promote its continuous development. Benchmarking is a process of comparing different AI system’s performance to enhance models.
Image source: Meta
Movie Gen Video Bench is a benchmark for evaluating text-to-video generation. It consists of 1000+ prompts to test motion levels of entities ranging from humans to unusual subjects.
Image source: Meta
Movie Gen Audio Bench helps evaluate video-to-audio and (text+video)-to-audio generation with 527 generated videos containing sound effects and music prompts for diverse ambiance.
Image source: Meta
In its X post, Meta said these two open-sourced benchmarks will help the AI research community develop more efficient audio and video generation models.
Image source: Canva
These newly released benchmarks contain non-cherry-picked videos and audio from Movie Gen to facilitate ethical comparison.
Image source: Canva
Meta has announced its collaboration with Hollywood’s Blumhouse Productions. Blumhouse is known for producing horror movies like The Purge and Get Out to test the Movie Gen Model.
Image source: Blumhouse