Join us as we return to New York on June 5 to work with executive leaders to explore comprehensive methods for auditing AI models for bias, performance, and ethical compliance in diverse organizations. Find out how you can get involved here.
Starting up speech AI ElfLabs offers an early look at a new model that turns a prompt into lyrics. To raise awareness, it follows a similar playbook that Sam Altman used back then OpenAI introduced Sorathe video-generating AI, which generates ideas on social media and converts them into lyrics.
Founded by former Google and Palantir employees, ElevenLabs specializes in using machine learning to clone and synthesize voices in different languages. It offers many tools, including a tool that can dub entire movies. It is not surprising that the company has set its sights on the music industry.
Imagine the possibilities of using this model: generate a fun lullaby to play for your kids to put them to sleep, produce a clever jingle for a marketing campaign, develop a peppy music intro for your podcast, and more . Is there any chance that someone will use ElevenLabs' AI to develop the next hit? There are already many AI music startups popping up, such as Harmonai, Lyrical Labs, Suno AI, Loudly and more.
It is also possible that users can sell these AI-generated songs on the ElevenLabs marketplace launched in January. The company's Voice Library currently allows users to sell their AI-cloned voice for money while retaining control over its availability and how they are compensated.
VB event
The AI Impact Tour: the AI audit
Join us as we return to New York on June 5 to engage with top executives and delve into strategies for auditing AI models to ensure fairness, optimal performance, and ethical compliance across organizations. Secure your attendance for this exclusive, invitation-only event.
Request an invitation
But AI music generation is not welcomed by everyone. As with all generative AI applications, the question is what ElevenLabs trained this model on and whether it contains copyrighted material – and if so, whether it has received permission from the rights holder or considers that training without permission is protected by fair use . Some oppose the development of such technology because artists may be left without jobs. The concern is that the AI could easily replicate the style of a particular artist and then you would no longer need them to release new music. Don't they want to make that Christmas album? No problem. Just use AI for that. And let's not forget the possibility of this being used to produce deepfakes.
VentureBeat has reached out to ElevenLabs for additional comment on its music model and will update this post if we hear back. We don't know the maximum song length it can produce, but based on the example that Ammaar Reshi, the company's head of design, posted at X, it's likely that the AI will generate lyrics for a three-minute piece.