Submitted by CeFurkan t3_1091e54 in MachineLearning
Hello. Recently VALL-E has been announced. It is just awesome.
I could use it to fix my bad audio quality previously recorded lectures.
So any model like that available currently for public usage?
You can check VALL-E examples here : https://valle-demo.github.io/
>ortoise-tts
thanks i will check out
it can produce my voice?
Yeah. It supports zero shot voice cloning using a reference clip.
check coqui TTS they have all kinds of models and they own yourtts compared in the paper. It is also way faster than tortoisetts
It's worth noting that it's still heavily influenced by whatever the initial training data is. I had a play with the model here: https://replicate.com/afiaka87/tortoise-tts and everything comes out with an American accent.
Are you able to generate speech based on given timings like providing a str, vtt file or convert speech audio into equivalent timed speech?
​
ty so much for answers.
>coqui TTS
thanks a lot i should test
We put up a free, open source API for tortoise recently, will be adding improvements to this over time & appreciate contributions: https://github.com/metavoicexyz/tortoise-tts-modal-api
Currently it can't hit timings of an srt file, what are you looking to achieve exactly... I can probably help out?
Other than tortoise tts as mentioned above, probably best to watch the Microsoft github page. They have a section for vall-e and they do tend to release some of their source codes for their other models.
Might take a while as the paper was just publish like a week and and still says, "work in progress."
https://github.com/microsoft/unilm/blob/master/valle/README.md
I hope they release model. without model source code useless since i don't have gpu power or dataset to train :(
Currently none are available. I am eagerly waiting for them too. https://medium.com/p/c24f1b22a235
Man, that doesn't work at aaaaaall. Sounds like the worst robot and nothing like me
Voice.ai
Atom_101 t1_j3voh2m wrote
Checkout tortoise-tts