Six months after OpenAI launched Sora, a groundbreaking tool for generating videos from text prompts, Meta has introduced Movie Gen. This new software allows users to create realistic videos and professional-sounding audio using simple text inputs. In this article, we will discuss everything about the latest Meta Movie Gen
Meta Movie Gen Overview
Features
Movie Gen is powered by a 30-billion parameter AI model, capable of generating 16-second HD videos from text prompts. The AI has been pre-trained on a large dataset of one billion images and 100 million videos, carefully selected to improve quality. In addition, users can input a photograph along with a scene description, enabling the AI to create a video of an animated actor and environment based on the provided information.
The tool offers a range of camera movements and angles, including wide shots, tilts, and pans, allowing users to simulate virtual camera setups similar to real-world shots.
Sound Effects and Music with Movie Gen Audio
🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date.
Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in… pic.twitter.com/NDOnyKOOyq
— AI at Meta (@AIatMeta) October 4, 2024
In addition to video generation, Meta has introduced Movie Gen Audio, a 13-billion parameter AI model for generating sound effects and music. The model is pre-trained on one million hours of audio, producing 48 kHz sound effects and music based on text prompts. While Movie Gen Audio can generate several minutes of music, video clips are limited to 16 seconds due to computational demands.
- Also, read
This AI can create realistic on-screen and off-screen sounds, such as footsteps and background music, that align with on-screen action and support the scene’s emotional tone.
Meta Movie Gen Availability
Meta researchers tested Movie Gen against other leading generative AI tools, including OpenAI’s Sora. However, Meta is still working on adding safety measures before releasing the tool to the public.
- Meanwhile, check out our review of the S24 FE
