Meta Unveils MovieGen: AI-Driven Video Creation and Editing Revolution
Meta Group on Friday introduced its new generative AI interface, Movie Gen, which allows the creation of videos with audio based on text or images, something other leading AI services allow.
Movie Gen is Meta Group’s third image generation model, following a first model in July 2022 and a second in November 2023.
None of the three interfaces have been made available to the public, as they are currently being tested by content creators and directors who evaluate Movie Gen and help improve the program. Meta has not announced a release date for Movie Gen.
Christianna Silva
In addition to the explanatory videos, the group published a research paper on Friday describing the new model.
Language models are programs that rely on large databases, allowing them to generate content, from text, images, video, audio or information code, in response to a request formulated in everyday language.
Movie Gen can produce a video based on a written request, as well as from an image. It also provides editing functions for existing videos.
The model also allows for adding a soundtrack to the video, based on the same principle based on requests in everyday language. In a short clip posted on Meta, it is enough to say a single sentence to modify a video by adding scenes of a four-wheel drive vehicle in the desert with the sound of a roaring engine and a guitar melody.
Meta hinted that a version of Movie Gen could one day be available for use on Instagram and Facebook, or even via WhatsApp messages.
Meta is not the first AI player to develop a video generation model.
Runway, from startup Runway AI, lets you create a few seconds of footage, turn a series of still images into a short video, or reconfigure an existing sequence to transform it, with a written request.
OpenAI also launched its version called Sora in February, while Google is working on a model called Lumiere.
Meta says Movie Gen “outperforms comparable industry models when evaluated by humans.”
Features of MovieGen
- Text-to-Video Generation: Create videos from written prompts.
- Image-to-Video Generation: Generate videos using an input image as a base.
- Video Editing Tools: Edit existing videos with AI-driven features.
- Customizable Outputs: Adjust video styles, transitions, and effects.
- High-Quality Video Outputs: AI-generated videos with impressive detail and coherence.
- Real-Time Feedback: Interactive editing with immediate preview of changes.
- Flexible Formats: Supports various video lengths and resolutions.
- Content-Specific Optimization: Tailored video generation for different genres or themes.
Christianna Silva
