I put ElevenLabs new AI Sound Effect Generator to the test — its great for AI video

I put ElevenLabs new AI Sound Effect Generator to the test — its great for AI video

Leading AI audio company ElevenLabs has released its latest product, generative sound effects, after months of beta testing. It allows you to create any noise from a simple text prompt.

I've been using it myself for the past couple of months and it creates incredibly accurate sounds and even when pushed backgra

The company has described it as "turning imagination into audio" and is able to capture everything from diving into the water, jigging coins and galloping horses. It suggests that you can make a sound and make a sound in a few seconds.

In the beta preview, users were given 4 samples based on text prompts, each with their own interpretation by the AI model. In the final release has increased to six.

The ElevenLabs Sound Effects Engine is like any generated AI model, a lot of training data and how to interpret and convert text into sound

This is a sound engine from ElevenLabs including its very realistic voice engine that can replicate and replicate anyone's voice in minutes. A growing collection of brand-based models

Mati Staniszewski, CEO and co-founder of Elevenlabs, said in a statement:"Last year, we revolutionized the voice of AI by creating the first truly emotional, human-like text-to-speech platform. With the launch of text-to-sound effects, we're taking another big step in giving creators more audio tools to produce high-quality content."

giving it video in the future because they are also working on new music models, elevenlabs will track interactions, sound effects and soundtracks for an immersive experience

The new sound effects model data will be created as part of a new partnership with Shutterstock." It was a great experience. This allowed Elevenlabs to use the Shutterstock audio library for licensed tracks to tweak the model because the Shutterstock library has an exact label.

To test the sound effects feature of ElevenLab, I came up with 7 videos with obvious and not-so-obvious sounds. And each generated audio. The video was created using Pika Labs from a simple 1 paragraph text prompt.

I gave the same prompt to the Pika Labs and ElevenLabs sound effects. It worked on all of the prompts to create a more complete sound away from the fire. For that I had to simplify just to "roar fireplace" as I continued to create confusing and overly complex soundscapes.

Prompt: "In a cozy roaring fireplace in a rustic log cabin, flames dance vividly, logs crackle, sparks fly through the chimney. A warm glow illuminates the wooden interior, casting flickering shadows.

Prompt: "A bustling city street filled with traffic jams, car squeal and passing buses. Skyscrapers are woven into the background, neon signs flicker, and people rush along the sidewalk. The scene captures the busy and noisy atmosphere of the city.

Prompt: "A calm beach at sunset when gentle sea waves collide with the shore." The sky is painted in shades of orange and pink, with seagulls flying overhead. The sound of the waves creates a pleasant atmosphere.

Prompt: "Dark clouds, flashes of lightning, heavy rain, dramatic thunderstorms over open fields." Thunder rings, the wind blows violently, bending the tree to feel its raw power.

Prompt: "A bustling outdoor market in a vibrant city with stalls selling fresh ingredients, spices and handmade goods. Vendors speak to customers, people haggle prices, and the sound of chatter and laughter fills the air. The market is colorful, vibrant and full of energy.

Prompt: "A busy construction site with cranes, bulldozers and workers wearing hard hats. As new buildings take shape, the sounds of hammers, excavations and machines fill the air. Dust rises from the ground and the scene is a hive of activity.

Prompt: "An authentic rock concert with a band playing on stage under colorful lights." The crowd is cheering, clapping and singing together. The lead singer's voice rises above the powerful music, and the electric guitar and drums create a thrilling and energetic atmosphere."

.

Categories