In 2023, Photoshop developer Adobe jumped into generative AI with its launch of Firefly. Firefly has since evolved into an all-in-one creative AI studio, where users can create, edit, and enhance images, video, and audio with professional tools and AI models from Adobe, Google, OpenAI, Runway, Kling AI, Luma AI, and more.
Now, Adobe is pushing Firefly’s sound capabilities further.
A new suite of audio tools gives users access to music, voiceovers, and sound effects–all of which are “commercially safe,” Adobe said in an official blog post.
Subscribe to get the latest creator news
- Generate Music will output universally licensed music the company says will be tuned to a video’s length and mood
- Generate Speech will turn a script into “clear, natural voiceovers with control over voice, pacing and emotion”
- and Generate Sound Effects will match the “action, timing and energy of your content”
“Sound is often the last thing you add and the first thing people notice,” Adobe added.
As our Tubefilter readers know, video creators face frequent issues with music licensing, and often rely on royalty-free tracks to ensure their videos won’t be copyright claimed.
“The right music can transform a piece of content, bringing the story to life and creating the emotional connection that makes it resonate with an audience,” Meg Donovan, Adobe’s Senior Director of Product Marketing for Generative AI & Creators, tells Tubefilter. “One of our newest features in Firefly now available to all, Generate Music, is designed for exactly those moments, when a creator needs original music tailored to a specific piece of content, with the control to shape that track into exactly what they’re picturing in their imagination, and the confidence that it’s licensed for use.”
Donovan says it was important for Adobe to wrap audio generation into Firefly alongside image and video, because its goal is to give creators (and other users) a one-stop shop for their workflows.
“Creators constantly tell us that the hardest part of their work isn’t coming up with ideas, it’s everything that gets in the way of finishing them: the tab-switching, tool-jumping, model-switching and all those other little moments when momentum slips away,” she says.
Creators have already explored Firefly’s new capabilities. Fashion, beauty, and lifestyle influencer Esther Rehema (@soestherr) says she balances school with content-making, and that “can get really overwhelming.”
“Being able to find music that is safe for commercial use and fits my content is such a game changer,” she says. “What used to take me hours and hours of searching for the right song can now take seconds.”
Madeline Salazar (@immadsal), a Photoshop and VFX-focused creator, says Firefly audio has been a big part of her brand deals, because she knows there won’t be any rightsholder complications with the songs it outputs.
“When I am making content for a brand, there is always the complication of licensing background music. Using Firefly’s Generate Music feature, I am able to create a soundtrack that is unique to the video I’m making, and it gives me peace of mind because I know the music is safe for commercial use,” she says. “When I deliver something to a client, I’m putting my name behind the entire project, so being able to create original music for the piece, and feel confident about handing it over, is really important to me.”
Donovan says the stressors Rehema and Salazar experience are part of the crushing pressure all modern creators face.
“Creators today are being asked to produce more content across more formats and platforms than ever before, all while the bar for standing out has never been higher,” she explains. “Firefly can help remove some of that friction, making it faster to explore ideas, iterate and take on parts of the creative process that previously felt impossible.”
Along with adding audio capabilities, Adobe is rolling out free access to Firefly AI Assistant, a text prompt-based agent that it says acts as a creative partner walking users through their projects.
Adobe introduced AI Assistant earlier this year, and says to date, two of its most popular tools are Create Storyboard and Create Brand Kit.
“Whether you’re turning a product into a set of branded mockups, generating a storyboard before production, or developing content for a campaign, these skills help creators move from idea to finished content faster,” Donovan says.
The free version of Firefly AI Assistant allows a limited amount of daily generations. Upgrading to a subscription with 2,000+ generative credits per month starts at $9.99/mo.
Adobe is a Tubefilter partner.
