Adobe has announced new video creation features for its Firefly AI platform just before its Adobe MAX event on Monday. From today onwards, users in a limited beta can test out Firefly’s video generator on Adobe’s website or try out the new AI-powered video feature, Generative Extend, in the Premiere Pro beta app.
On the Firefly website, users in the limited beta can experiment with a text-to-video model or an image-to-video model, both capable of producing up to five seconds of AI-generated video. While the web beta is free to use, there are likely rate limits in place.
Adobe has trained Firefly to generate both animated content and photo-realistic media based on user prompts. The platform can also create videos with text, which AI image generators have historically struggled to produce. The Firefly video web app includes settings to adjust camera pans, the intensity of camera movement, angle, and shot size.
In the Premiere Pro beta app, users can try out Firefly’s Generative Extend feature, which can extend video clips by up to two seconds. This feature aims to add an extra beat in a scene, continuing camera motion and subject movements. Additionally, the background audio will be extended, providing a glimpse into the AI audio model Adobe has been developing.
Adobe’s AI features aim to strike a balance with its creative audience. It aims to lead in a competitive field of AI startups and tech companies showcasing impressive AI models while also acknowledging concerns from creatives who fear AI may replace traditional methods. Firefly’s first video feature, Generative Extend, tackles an existing issue faced by video editors – the need for longer clips, instead of creating entirely new content from scratch.
Adobe executives have high hopes for Firefly’s video capabilities, building on the success of its image model in Photoshop. They are mindful of creatives’ concerns, compensating contributors for training its AI model. Despite some creatives being wary of AI tools, Adobe believes that generative AI tools will increase demand for their work, rather than making them obsolete.
Firefly also includes automatic “AI-generated” watermarks in video metadata to distinguish AI-generated content. The platform was specifically designed to generate “commercially safe” media by avoiding potentially unsafe content like drugs, nudity, violence, political figures, or copyrighted materials. By providing access to Firefly’s video model, Adobe hopes to validate its commitment to creating safe and useful AI tools for content creation.
