Users will have the opportunity to try Adobe's artificial intelligence model for video generation before the end of 2024. The company has announced that features powered by the Firefly Video model will be available in both the beta version of Premiere Pro and a free website. Currently, three tools are in a private testing phase but are expected to be accessible to the public soon: Generative Extend, Text to Video, and Image to Video.
AI-powered features: What to expect
The Generative Extend tool, which allows users to extend any video by two seconds, will be integrated into the Premiere Pro beta by the end of this year. Meanwhile, the Text to Video and Image to Video models, which generate five-second videos from text or images, will be available on Firefly's dedicated website around the same time. Adobe has noted that this time limit may increase.
For decades, Adobe software has been a favorite among creatives. However, the arrival of generative AI tools like Firefly could transform the creative industry by making it possible to create clips in minutes, something that previously took hours. While these initial tools have been criticized for their unpredictability in professional settings, Adobe is betting on controllability as its main differentiator.
According to Ely Greenfield, Chief Technology Officer of Digital Media at Adobe, there is great interest in Firefly's tools to complement or accelerate current workflows. An example of their success is the generative fill tool in Photoshop, which has become one of the most widely used features since its introduction.
Firefly's impact on content creation
The Generative Extend model can predict and seamlessly add two extra seconds of footage. The tool uses the last frames of a scene and generates the continuation through AI prediction. In terms of audio, it recreates background sounds like traffic or nature, but not voices or music, due to music licensing restrictions.
Additionally, Text to Video and Image to Video allow the creation of up to five seconds of video from text descriptions or images. These features will be available on firefly.adobe.com, likely with some usage limits. Adobe has also implemented safeguards to prevent the generation of inappropriate or controversial content, such as videos involving nudity or drugs, and ensures that public figures are not used to train its AI.
