Submitted by HelloGoodbyeFriend t3_ycql5p in singularity
I’ve been hoarding acapella tracks from my favorite artists so I can hopefully use them to train and AI to recreate their voice with custom lyrics & melodies in the future. Curious if anyone is aware if there’s any emerging AI companies working on this? I’ve heard some of the rapper ones and I feel like Joe Rogan has been solved at this point lol. So I’d imagine vocalists are next up.
It's already being done. Here is a Ted talk about it.
Holy shit. Thank you!!
I just happened to hear her on TED radio hour a few months back. I'm still amazed they could change his voice in real time!
i saw holly herndon at a show in austin in 2015 and shook her hand afterwards lol, i was shy. i tried to get through the ted talk but it was too unnerving. the singularity is coming.
I think it will be possible in 1 year or less.
RemindMe! 1 year
I will be messaging you in 1 year on 2023-10-25 00:37:55 UTC to remind you of this link
6 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
^(Parent commenter can ) ^(delete this message to hide from others.)
| ^(Info) | ^(Custom) | ^(Your Reminders) | ^(Feedback) |
|---|
We can do it now, albeit very poorly. I'd imagine in 5 years we will have close to perfect mimicry of anybody's voice given enough sampling.
You highly underestimate pace of progress
Can you explain this to me? Persuade me that it'll happen in less than 5 years. It seems insane to me, but I'm not well educated enough on it.
Just imagine how many people work on it. How they want to be the first to create AGI. And their number quickly increase.
Imagine how right now many new models are being trained on GPUs. Moore's law still works. Hardware becomes better and better.
We've already recreated many brain's algorithms (art, speech, face recognition, driving and many more). All that's left is to teach a machine how to learn by itself.
And by the way, we already can copy singer's voice, read other comments
That makes sense. Thanks.
Do you think it'll rapidly help with things like CRISPR gene editing as well?
If AGI is benevolent, it will help with everything.
All things that may increase intelligence, like neurointerfaces, gene editing and maybe unknown drugs, are other ways to singularity. Everything is connected. That's why the progress is exponential. Thought AI way seems the most possible to me
2024, which is also my answer for most synthetic media predictions, as that's the year I think AI will become so advanced that people will use AI to create their own personalized entertainment.
You already can wasn’t there text to sound websites for the past years SpongeBob, trump etc?
That’s speech though. I’m curious about re-creating a singers voice.
Singing is just speech that's modulated by the vocal cords to harmonize.
When we speak normally all that happens is also just notes sounding out in sequences that we are familiar with and have memorized those sequences as words. With singing the notes are just chosen in such an order that they sound good with each other.
Sampling singing voice is not different than sampling speaking voice. Although with current ai models the same person's singing voice and speaking voice would need to be trained on separately. As the common database of both spoken and sung voice would confuse the ai in terms of how to "pronounce" things. As it cannot naturally tell a difference between sung and spoken word.
Singing is going to be much harder.There’s so much variation. Plus words just requires it to sound natural, singing requires much more of a performance and we have all kinds of other aspects. Like singing softly, loudly, vibrato, portamento, rhythm, not it mention notes themselves,
This might make it clear. We can do synthesized percussion much better than we can do synthesized tonal instruments like violins, flutes etc. sampling percussion has always been the easiest thing to get realistic and 100% synthesized instruments are no different.
If you want to sample percussion all you really need aside from recording quality is sampling multiple repetitions and a shit-ton of dynamic layers. The best percussion sample libraries today will have like maybe 10-20 dynamic layers and 5+ to 10+ repetition samples sometimes. You don’t even need that many to make it sound convincing. But with instruments like vocals, violins flutes etc that’s not scratching the surface. These are complex on much higher dimensions and you need completely different techniques to capture them, and even then it’s still not quite right or it’s highly limited in it’s use
Wouldn’t be that harder tho I think we can right now
The voice or the singing?
Like others said, computer generated speech mimicry has been demonstrated already.
Singing. For example, I have an instrumental track of Fleetwood Mac’s - Landslide and I want Freddy Mercury to sing it.
Found this after I made this post.
I’m thinking a product that’s available for the masses will be available in 10 years. I wouldn’t be surprised if a proof-of-concept product hasn’t already been created.
10 years.. No way. Competition is a powerful driver. If it's not already available in beta it'll be available by a dozen vendors in 6 months to a year max
I hope you’re right…
That sounds a lot like: "yea, dalle-mini is neat but it'll be at least 20 years until it can make anything close to what a real artist can do"
lol if you say so
Descript has a consumer product you can train with less than 1 hr of audio… i use a digital version of both my podcast hosts with this tool (sparingly - single words and short phrases ) the intonation needs work but its pretty solid
Check out the composer Holly Herndon and Holly+.
Just saw the Ted Talk. Spot on. Thank you
No problem. Cheers!
It’s not possible already?
A few years from now music composers will be able to make completely virtual works of music using anyone's voices (it's just a particular timbre of the human throat instrument) and instruments to create virtual studio performances.
Well, I came across respeecher. You should really try it out.
From what I’ve seen, NVIDIA’s Tacotron2 can already be used to create some pretty convincing singing voices, though the examples I’ve seen are mostly rap, so I’m not sure how good they are at more complex singing styles.
Exactly what I was looking for thank you. Found this tutorial, gonna give it a try.
Damn thats pretty good. I've heard a few decent Juice WRLD ones too.
I think it'll take someone to make a convincing MJ cover of a popular new pop song to make this thing blow up and get everyone talking about it.
Can a singer claim copyright over the sound of their voice?
Hopefully, and probably yeah Music Industry is very strict with this sort of thing.
look up TorToiSe Text-to-Speech
Perhaps you could train it one someones singing voice
Hope they don't copyright voices. Something that can be easily achieved should never be copyrighted. If we can create artificial singer voices and enjoy creating our own music, it will be a mini musical revolution.
I can tell you now the AI overlords are not going to like all this copyright/trademark/patent bullshit that people are so obsessed with.
[removed]
Jukebox AI has done it pretty well
Disney’s doing to Darth Vader’s voice so not far off
Can’t wait to hear that song 😉
We haven’t even done perfect regular speech yet
Sandbar101 t1_itnuyak wrote
Today my guy just not public tech yet