Meta's latest speech generator Audiobox Maker

Dec 21, 2023#AI166

AI Translation

This post is translated from Chinese into English through AI.View Original

AI-generated summary

Audiobox Maker is a tool that allows even inexperienced users to design and generate voice files for different characters, adding various sound effects. It combines different files like building with Lego blocks to create stories. Audiobox is a collection of six AI tools, including voice cloning, text-to-voice, and text-to-sound effects. It claims to have reduced FAD (Frechet Audio Distance) by 50%, making the audio quality comparable to real audio.

If you are interested, here is a link: https://audiobox.metademolab.com/ (no magic required)

Through Audiobox Maker, even novice users can design and generate voice files for different characters (such as Little Red Riding Hood, the Big Bad Wolf, and Grandma), while adding different sound effects. By dragging and arranging various files (like building with Lego), you can create and direct your own story.

In fact, you can think of Audiobox as a "model series" that brings together six AI tools, including voice cloning, text-to-speech, text-to-sound effects (such as applause, dog barking, car horns, thunder), and adding or removing sound effects in specific places.

The results are as follows:

Meta claims that compared to previous state-of-the-art products, Audiobox has reduced the FAD (Frechet Audio Distance, where a smaller FAD value is better) by 50%, making it comparable to real audio in terms of quality and fidelity.