Deep Mind showed off the latest results from its generative AI video-to-audio research on Tuesday. It's a novel system that combines what it sees on-screen with the user's written prompt to create synced audio soundscapes for a given video clip.
The V2A AI can be paired with vide -generation models like Veo, Deep Mind's generative audio team wrote in a blog post, and can create soundtracks, sound effects, and even dialogue for the on-screen action. What's more, Deep Mind claims that its new system can generate "an unlimited number of soundtracks for any video input" by tuning the model with positive and negative prompts that encourage or discourage the use of a particular sound, respectively.
