I tried Hedra - a new AI video tool that allows you to create animated speaking characters, and I was blown away

I tried Hedra - a new AI video tool that allows you to create animated speaking characters, and I was blown away

There seems to be an announcement of new AI videos every day, and the latest is from Hedra, a startup that is taking a character-first approach to moving ideas.

This week alone, we saw new features in the Luma Labs Dream Machine and the announcement of the new Sora-like Gen-3 on Runway.

Character-1 is a research preview of the upcoming foundation video model that gives users granular control over how they animate virtual characters using AI.

In the preview, you can give it an audio and a picture Unlike other lip sync tools as it creates a lip sync video showing that character in your photo story, this adds a higher level of expression and movement than I've seen before.

Hedra is free to create videos of any length during this research preview. The company uses it to test issues with both models and moderation tools before deploying more advanced features.

Character-1 is a new underlying AI model designed to create fully controllable and realistic characters using AI. The company says they would be able to make expressive stories, songs and even rap in potentially endless periods.

For now, it's pretty easy to use it. Once registered, you generate audio from the text or give it your own audio and create a character. It can generate pictures, AI images, or images in Hedra with text. Then just click "Generate video" and wait.

There are similarities in features with lip sync tools in some open source projects, research previews, and even platforms like Runway and Synclabs, but what makes Hedra stand out for me is the promise of the future and the representation of the video.

The company says of its plans for the future: "This is accessible to everyone so that creators have complete control over emotional dialogue, movement and (yes) the whole world."

Since this is the first phase of the new model, there have been teething problems, especially with overly strict moderation AI, but it has not generated. There was no problem with the video that was made.

It is currently limited to 30 seconds, so if, like me, you have to do it in two sections, you can upload your own image, which seems to work most effectively with Hedra-generated images.

Currently, it only offers square-format video, not widescreen or portrait, and has relatively low resolution. But this isn't about creating production-ready content, it's a research preview to showcase the features, and it shows what's actually coming.

To put it to the test, I created a short story of an alien invasion. This will produce 3 alien and 4 human generals characters from the galactic fleet. Compared to human acting, it's as wooden as you'll find in student melodramas — for AI-based lip sync, that's what I've seen before.

Categories