No need for a piano! Adobe allows you to create music tracks from text prompts.

No need for a piano! Adobe allows you to create music tracks from text prompts.

Adobe has announced Project Music GenAI Control, a new generative artificial intelligence tool that helps create music from simple text prompts.

This is the latest move by Adobe into this area since the Firefly text-to-image model was released last year and may find its way into Premiere Pro in the future.

Dubbed "Photoshop for Music" by Adobe researchers, it goes beyond other text-to-music tools in that it adds fine-grained control to the process, allowing for a more fitting sound to the project.

Adobe's Project Music GenAI Control was built by Adobe Research to be a co-creator of music, rather than a tool that itself creates tracks end-to-end like other generative AI music models.

A number of text-to-music models of varying quality are already available, including Google's MusicFX, StabilityAI's Stable Audio, and Meta's open source AudioCraft. There is also complete music creation with Suno, Cassette AI, and Splash Music.

However, Adobe claims that its tools give the end user more control, allowing them to create styles, sounds, and even breaks to fit any project.

Says Nicholas Bryan, senior research scientist at Adobe Research: "Whether you're a broadcaster, a podcaster, or just someone who needs audio with just the right mood, tone, and length, we can help you create music for your project. .

Like other tools of its kind, it is based on an underlying AI model. New workflows are built on top of the model to facilitate editing of tracks that have been trained and generated in a variety of sounds and musical styles.

The tool demo shows a text prompt requesting a specific music style, followed by additional prompts to change the intensity, add a style overlay, or introduce additional instruments.

You can also generate a loop track or a specific loop to drop into a larger mix. Simply describe what you want it to sound like and the tool will make it a reality.

"The exciting thing about these new tools is that they don't just generate audio, they bring it to the level of Photoshop by giving creators the same deep control to shape, tweak, and edit the audio . It's like pixel-level control for music," says Brian.

Currently, this is an experimental feature being run by Adobe Research. As such, the name may seem inconvenient.

However, Project Music GenAI Control fits the style of other Adobe Labs projects, such as Project All of Me, an AI costume editor, and Project Beyond the Seen, which creates 360-degree panoramas from 2D images.

It will not be a tool in its own right when it graduates to the lab bench. It may be seen as "Photoshop for music," but in reality it will be part of the broader Adobe product line.

Adobe may launch a standalone version as part of a podcast studio, like Firefly for images, but the main access would be to Premiere Pro for adding scores to movies and backtracking video clips It is likely that the company will release a stand-alone version as part of Podcast Studios.

Categories