Adobe is introducing generative AI filmmaking tools focused on enhancing sound effects and video control. Users can leverage voice recordings akin to onomatopoeia for custom sounds alongside text prompts in the Firefly app. The Generate Sound Effects tool in beta allows for real-time audio matching with footage. The new Text-to-Video generator includes advanced controls, such as the Composition Reference feature for better mirroring of uploaded videos, and Keyframe cropping for smooth transitions between frames, enhancing user creativity and control in video creation.
The Generate Sound Effects tool that's launching in beta on the Firefly app can be used with recorded and generated footage, and provides greater control over audio generation than Google's Veo 3 video tool. The interface resembles a video editing timeline and allows users to match the effects they create in time with uploaded footage.
Users can now use onomatopoeia-like voice recordings to generate custom sounds, and use reference footage to guide the movements in Firefly-generated videos. For example, users can play a video of a horse walking and simultaneously record 'clip clop' noises in time with its hoof steps.
New advanced controls are coming to the Firefly Text-to-Video generator. Composition Reference allows users to upload a video alongside their text prompt to mirror the composition of that footage, making it easier to achieve specific results.
Keyframe cropping will let users crop and upload images of the first and last frames that Firefly can use to generate video between, and new style presets provide additional options for content creators.
Collection
[
|
...
]