Adobe has previewed new innovations in generative AI in Adobe Premiere Pro that will reshape video creation and production workflows.
New generative AI tools launching in Premiere Pro this year allow users to streamline editing of any video, including adding or removing objects in a scene or augmenting an existing clip. These new editing workflows are supported by a new video model that complements the Firefly model family, which includes image, vector, layout and text effects. Adobe continues to develop Firefly AI models in categories where it has deep experience, such as images, video, audio and 3D, and will deeply integrate these models into Creative Cloud and Adobe Express.
The company has also previewed its vision to integrate third-party generative AI models directly into Adobe applications such as Premiere Pro. This could make Premiere Pro the most flexible and feature-rich professional video tool on the market.
The range of generative AI for multimedia tools is growing
The first images show how video editors can use the video generation models OpenAI and Runway, integrated into Premiere Pro to create B-rolls for editing in your project. It also shows how you can use it Pika Labs with the Generative Extend tool to add a few seconds to the end of a recording. Therefore, users can leverage these artificial intelligences to:
- Generative expansion – Seamlessly add frames to extend clips, making it easier to perfectly time edits and add smooth transitions. This innovative technology solves a common problem professional editors face every day, allowing them to create additional opportunities to adjust edits, hold a shot for a longer period of time, or better cover a transition.
- Add and remove objects – Easily select, track and replace objects. Remove unwanted elements, change an actor’s costume, or quickly add decorations like a painting or photorealistic flowers to a desk.
- Text to video – Create completely new footage directly in Premiere Pro. Simply enter text in a message or upload reference images. These clips can be used to ideate and create storyboards or create B-roll to complement live-action footage.
“Adobe is reinventing every step of the video creation and production workflow to give creators new power and flexibility to bring their vision to life.” said Ashley Still, senior vice president of Adobe’s Creative Products Group. “By integrating generative AI innovations into Premiere Pro’s core workflows, we’re solving real problems video editors face every day, while giving them more space to focus on their craft.”.
AI-powered audio workflows are generally available in Premiere Pro
Adobe has also announced that it will introduce AI to Premiere Pro to improve sound, including:
- Interactive fade controllers – Editors can create custom audio transitions faster than ever by simply dragging clip handles to create audio crossfades.
- New Essential Sound badge with audio category designation – AI automatically tags audio clips as dialogue, music, sound effects or atmosphere and adds a new icon to give editors instant access to the right controls for the job with one click.
- Effect badge – New visual indicators make it easy to see which clips have effects, quickly add new ones, and automatically open effect parameters directly from the sequence.
- Redesigned waveforms in the timeline – Waveforms intelligently resize as track height changes in clips, while beautiful new colors make sequences easier to read.
Additionally, the AI-powered Enhance Speech tool, which instantly removes unwanted noise and improves poorly recorded dialogue, has been generally available since February.
