Adobe is entering the AI video space with its new Firefly video model

Adobe is entering the AI video space with its new Firefly video model

Adobe has announced Firefly Video, a new artificial intelligence video generation model that offers the ability to create short clips from text, images, or videos 

The new model will be integrated into future versions of Premiere Pro and will be available as a standalone tool This is similar to how Adobe deployed Firefly AI image generator in Photoshop and as a standalone app I'm not sure yet if it will be one of the best AI video generators1 

Adobe works with creative professionals and the video editing community when creating video models, and only with "commercially safe" videos that have been licensed This is the same approach that Adobe has done with the Firefly image model

Unlike other video models, Adobe focuses on adding to human-created content, including clip extensions and alternative perspective generations You can also generate stand-alone clips from images and text Firefly Video will be available on Adobe's website and within adobe Premiere Pro later this year, and the generative clip extension will also be available

 

In the text-to-video model, you can use descriptive prompts in the same way as Runway or Luma Labs Dream Machine

Adobe is throwing it as a way to generate a b-roll that "seamlessly fills the timeline gap" or enhance the actual footage with effects The model also includes camera controls such as angle, motion, and zoom, as we recently saw on Dream Machine

Other use cases include creating atmospheric elements such as fire, smoke, and dust particles in a video With AI, these can be "superimposed on existing content using blend mode, or keyed within Adobe tools such as Premiere Pro and After Effects"

Adobe says the image-to-video model will allow users to retrieve and move existing images This includes animation of text or objects Adobe plans to embed the generated AI through the Firefly video model into Adobe Premiere Pro and do what it did to the image in Adobe Photoshop against the video

It is a gap in the footage to hold longer shots than users could shoot to help for smooth and "fully timed" editing

"Our Firefly foundation video editor, based on our basic Firefly model for imaging, design and vector creation," "The Firefly Foundation Video Editor," "The Firefly Foundation Video Editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation video editor," "The Firefly foundation Video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation Video editor," "The Firefly foundation "We are excited to bring a new level of creative control and efficiency to video editing with Generative Extend, powered by Firefly in Premiere Pro," the video Editor model said in a statement, adding that the professional video community is "excited to bring a new level of creative control and efficiency to video editing with Generative Extend, powered by Firefly in Premiere Pro""I don't know how this will stack up to 3rd generation AI video tools like Kling, Runway Gen-3, Luma Labs Dream Machine, and OpenAI's Sora, until I try, but it needs important features that other models don't haveIt is "commercially safe," verifiable, and integrated into Adobe products

Categories