Meta, challenging OpenAI, announces new AI model that can generate video with sound

NEW YORK: Facebook owner Meta announced on Friday (Oct. 4) that it has built a new artificial intelligence model called Movie Gen that can create realistic-looking video and audio clips in response to user suggestions, saying it can compete with tools from leading media generation startups like OpenAI and ElevenLabs.

Movie Gen samples provided by Meta included videos of animals swimming and surfing, as well as videos using real photos of people to depict them performing activities such as painting on canvases.

Movie Gen can also generate background music and sound effects in sync with movie content, Meta said in a blog post.

According to the company, users can also use this tool to edit existing videos.

In one example video, Meta used a tool to place pom-poms into the hands of a man running alone in the desert, while in another he transformed a parking lot into a video of a man riding a skateboard from dry ground to an area covered with water splashes. puddle.