Adobe Firefly Comes to Adobe Premiere Pro 2024
Adobe introduces Adobe Firefly, Adobe’s generative artificial intelligence (AI) which is a text-to-image converter that drives generative replenishment for Photoshop and the latest into a text-to-vector tool in Illustrator in Adobe Premiere Pro 2024. Firefly 2024 will drive three AI video tools inside Premiere Pro video editing software: Generative Extend, Object Addition and Removal, and Text to Video.
Premiere Pro has enabled video editors to integrate Adobe creative cloud software such as After Effects (motion graph) and Audition (sound mixing). Today’s announcement confirms that Adobe will take the same approach as AI. The company also announced that it was in “early browsing” to integrate the video generation from OpenAI (Sora), Runway, and PIKA Labs into Premiere.
Last week, Adobe showed this new generation AI tool for Indiewire and shared examples (see video at the top of the page) of what will be available inside Premiere Pro before the end of this year.
Generative Extend: Make Transitions More Smooth
Every editor must have hoped for some additional frames in order to be able to edit or transition more smoothly. The Gen Extend tool will allow the editor to use AI to create new frames up to “a few seconds” promised by Adobe to “add up the frame seamlessly to make the clips longer.”
In the preview video, this tool extends the actress’ performance realistically by a few seconds to fill the gap in the editor’s timeline. Although prolonging performance raises ethical and unity issues, filmmakers have long used visual effects tricks to mix footage to get some extra frames. This tool can allow editors to create real-time solutions within Premiere.
object addition & Removal: Editing images easily
Adding and removing objects from frames often involves time-consuming VFX work, but the Firefly tool will allow an editor to do so in real-time. The key to success is whether generative AI can maintain photorealism. The examples offered in the Adobe preview (add a pile of diamonds into the bag and remove the electrical box from the frame) look photorealistic, by maintaining the consistency of the image and lighting. Both in a press release and in a briefing session with IndieWire, Adobe confirmed that these pixels were produced by the upcoming Firefly video model without further manipulation.
The initial results look promising, but until the editor tests on various footage, we won’t know how applicable these tools are in the near future.
Text to Video: Transform text into video
Firefly is nothing new in terms of the ability to use text-to-video tools to create scenes. What’s interesting is that Adobe will give the filmmaker the ability to access text to video from within the premiere, and will include Firefly competitors such as Sora, Runway, and Pika Labs. It is clear that Adobe anticipates editors using these tools in their daily workflow.
Copyright & Content credentials
Many generative AI images and videos are built on copyrighted material. In an embarrassing interview, CTO Openai Sora couldn’t even answer direct questions about what trained her generative video model.
However, the filmmaker has praised Adobe for only using licensed images to train Firefly. Adobe executives confirmed to IndieWire that the soon-to-release Firefly video model will continue to comply with these rules.
Therefore, it is interesting to note that Adobe will integrate third party AI companies which are far less ethical regarding copyright. However, Adobe said that they will continue to use content credentials.
Improved audio workflow
In May, the Audio Premiere workflow will get an improved set of tools, some of which are supported by AI and have been available in beta for some time. These include:
- Interactive Fade Handle: The editor can create custom audio transitions by pulling the clip handle to create audio fades.
- Signs Essential Sound with Audio Category Tagging: AI automatically marks audio clips as dialog, music, sound effects, or atmosphere.
- Effect sign: The visual indicator shows which clip has the effect, quickly adds a new one, and automatically opens the effect parameters of the sequence.
- Redesigned sound waves in Timeline: Sound waves intelligently adjust size when track height changes on clips, while new colors make sequences easier to read.
- AI-supported Enhance Speech Tool: Removes unwanted noise and improves poorly recorded dialog; It has been available in general since February.
FAQs Related to Adobe Premiere Pro 2024:
- What is Firefly?
- Firefly is the generative artificial intelligence of Adobe that drives various tools for video editing in Adobe Premiere Pro 2024.
- What is meant by generative extend?
- Generative Extend is a tool that allows the editor to use AI to create new frames in the video, automatically extending the clip for smoother transitions.
- how to object addition & Removal Working at Premiere Pro?
- object addition & Removal is a tool that allows the editor to add or remove objects from the frame in real-time, with the ability to maintain photorealism.
- Why is content credentials important in the use of AI tools?
- Content credentials are important because they ensure that the content generated using AI tools complies with copyright and ethics, and provides transparency to users about the origin of the content.
- What is AI-Powered Enhance Speech in Premiere Pro?
- AI-Powered Enhance Speech is a tool that uses artificial intelligence to eliminate unwanted noise and improve the quality of poor dialogue recordings in audio editing in Adobe Premiere Pro.
