Other than tortoise tts as mentioned above, probably best to watch the Microsoft github page. They have a section for vall-e and they do tend to release some of their source codes for their other models.

Might take a while as the paper was just publish like a week and and still says, "work in progress."

https://github.com/microsoft/unilm/blob/master/valle/README.md