Adobe Launches Firefly Video Model and Enhances Image, Vector and Design Models

MIAMI BEACH, Fla. – October 14, 2024 – Today, at Adobe MAX – the world’s largest creativity conference – Adobe (Nasdaq: ADBE) announced the expansion of its Firefly family of creative generative AI models to video, in addition to new breakthroughs in its Image, Vector and Design models and significant momentum in Firefly’s adoption by leading brands and enterprises. The Firefly Video Model, now in limited public beta, is the first publicly available video model designed to be commercially safe. Since Firefly’s first beta release in March 2023, it has been used to generate more than 13 billion images – an increase of more than 6 billion over the past six months.

“The usage of Firefly within our creative applications has seen massive adoption, and it’s been inspiring to see how the creative community has used it to push the boundaries of what’s possible,” said Ely Greenfield, chief technology officer, digital media at Adobe. “We’re thrilled to bring creative professionals even more tools for ideation and creation, all designed to be commercially safe.”

New Firefly-powered Offerings

The Firefly Video Model (beta) extends Adobe’s family of generative AI models, which already includes an Image Model, Vector Model and Design Model, making Firefly the most comprehensive model offering for creative teams. It is available today through a limited public beta to garner initial feedback from a small group of creative professionals, which will be used to continue to refine and improve the model.

Within one year of being launched, Firefly was brought into Photoshop, Express, Illustrator, Substance 3D and more, while supporting various workflows in Creative Cloud applications. Firefly also supports text prompts in over 100 languages and enables users around the world to create stunning content that is designed to be safe for commercial use.

New Firefly offerings in Creative Cloud available today include:

• Generative Extend (beta) for perfectly timed video edits: Powered by the Firefly Video Model and now available in the Premiere Pro beta, Generative Extend allows you to extend clips to cover gaps in footage, smooth out transitions, or hold on shots longer for perfectly timed edits.
• Text to Video & Image to Video (beta) for improved user controls and stunning video clips: Powered by the Firefly Video Model and now rolling out in limited public beta in the Firefly web app, creators can access new Text to Video and Image to Video capabilities. With Text to Video, video editors can generate video from text prompts, access a variety of camera controls such as angle, motion and zoom to finetune videos, and reference images for B-Roll generation that seamlessly fill gaps in a video timeline. Image to Video capabilities allow creators to bring still shots or illustrations to life by transforming them into stunning live action clips.
• Firefly Image 3 enhancements for faster generations: With the latest evolution of Firefly Image 3 Model, creators of all levels can ideate by generating images in seconds with results that are up to 4x faster than previous models – available today on the Firefly web app.
• Generative Workspace (beta) in Photoshop: Powered by Adobe Firefly, Generative Workspace in Photoshop allows designers to ideate, brainstorm and iterate concepts simultaneously to achieve their vision while producing stunning visuals faster and more intuitively than ever before.
• Firefly Vector Model (beta) Advancements in Illustrator: Adobe Illustrator brought Generative Shape Fill (beta), Generative Recolor and Text to Pattern, all powered by the latest Firefly Vector Model (beta) earlier this year, empowering designers to quickly ideate or add detailed vectors in their own unique style to existing artwork and designs. With the latest version of Firefly Vector Model, creators can now further control the density of elements in a single pattern to change how tightly the elements are packed together.

Adobe also previewed Project Concept, a new capability for multiplayer, collaborative, creative concept development bringing the ability to remix images in real time so creative professionals can concept live in a single canvas.

Content Creation at Scale with New Enterprise Offerings

Additionally, in Firefly Services, a collection of creative and generative APIs for enterprises, Adobe unveiled new offerings to scale production workflows. This includes Dubbing and Lip Sync now in beta, which uses generative AI for video content to translate spoken dialog into different languages, while maintaining the sound of the original voice with matching lip sync. Additionally, ‘Bulk Create, Powered by Firefly Services’ is now in beta and will enable creative professionals to edit large volumes of images more efficiently, streamlining tasks such as resizing or background removal.

To date, Adobe Firefly has been used by Adobe customers including PepsiCo/Gatorade, IBM, Mattel, IPG Health, Deloitte and others, to optimize workflows and scale content creation so creatives can spend more time exploring their creative visions.

Driving Responsible Innovation with Adobe Firefly

Firefly powers generative AI tools designed for creative needs, use cases, and workflows. Adobe trained its Firefly generative AI models on licensed content, such as Adobe Stock and public domain content. In addition, Adobe’s AI features are developed in accordance with the company’s AI Ethics principles of accountability, responsibility, and transparency.

Since founding the Content Authenticity Initiative in 2019, Adobe has championed the widespread adoption of Content Credentials as the industry standard for transparency in digital content, now supported by over 3,700 members. Content Credentials, which act like a “nutrition label” for digital content to show how it was created and edited, are applied to select Firefly-powered features across Creative Cloud to indicate the use of generative AI.

Pricing and Availability

The Firefly Video Model is in limited public beta on firefly.adobe.com. Join the waitlist here. During this limited public beta, generations are free. Adobe will share more information about Firefly video generation offers and pricing when the Firefly Video Model moves out of limited public beta.

About Adobe

Adobe is changing the world through digital experiences. For more information, visit www.adobe.com.

© 2024 Adobe. All rights reserved. Adobe and the Adobe logo are either registered trademarks or trademarks of Adobe in the United States and/or other countries. All other trademarks are the property of their respective owners.

Public relations contact

Cassandra Beck
Adobe
cbeck@adobe.com