Viewing a single comment thread. View all comments

Art_from_the_Machine OP t1_jdwhke8 wrote

This is an early version of a Python script I am working on which lets you talk to Skyrim NPCs using ChatGPT and xVASynth. Once the script is running, NPCs can be loaded by saying "Hello" + NPC name. The relevant voice model for that NPC is then loaded, along with a summary text of their background and any of their previous conversations with the player.

Full video:
https://www.youtube.com/watch?v=u_Zn89_g7ok

42

Longjumping-Sky-1971 t1_jdxpwws wrote

You need to try it out with elevenlabs.

32

banuk_sickness_eater t1_jdyrkvf wrote

I second this suggestion. Elevenlabs can recreate the the proper intonation and cadence of the original voice actor.

17

Orc_ t1_jdzvrxj wrote

It cannot, it has nearly 100% credibility but it's plagued by an american accent.

For example I trained it with 1 minute of my voice in spanish speaking spanish and it does english well but it cannot speak spanish well. Same thing would be for the nord women and the accent.

It would work for many other races of TES but not nords, khajit, argonians, for example.

You would have to wait for a separate update that deals with accent and cadence.

0

banuk_sickness_eater t1_je0092d wrote

Oh shit, maybe it was a Vall-E demo, but I distinctly remember feeding it Bill Burr's voice and getting back a fairly convincing Boston accented recreation.

1

not_into_that t1_je0yk36 wrote

Build a model in Spanish and have them collaborate. There are ways.

1

Art_from_the_Machine OP t1_jdzc791 wrote

It's definitely on my radar. I wanted to start off with xVASynth first as the voice models are readily available / it's free, but I'm hoping to add functionality to switch out different language / voice synthesis models as needed to find the best balance between performance and cost.

5

I-Stand-Unshaken t1_jdyi3w6 wrote

Thank you so much for this. Gaming is my #1 hobby, so this means a lot to me. I don't want it to get weird but this is a great step towards somethig I've always dreamed of.

7

waytogokody t1_jdz0mgn wrote

Brother this is the future. you are making the stepping stones of what's to come! Absolutely stunning work! Imagine what could be built with this idea from the ground up!

5