Comments

You must log in or register to comment.

Art_from_the_Machine OP t1_jdwhke8 wrote

This is an early version of a Python script I am working on which lets you talk to Skyrim NPCs using ChatGPT and xVASynth. Once the script is running, NPCs can be loaded by saying "Hello" + NPC name. The relevant voice model for that NPC is then loaded, along with a summary text of their background and any of their previous conversations with the player.

Full video:
https://www.youtube.com/watch?v=u_Zn89_g7ok

42

Longjumping-Sky-1971 t1_jdxpwws wrote

You need to try it out with elevenlabs.

32

banuk_sickness_eater t1_jdyrkvf wrote

I second this suggestion. Elevenlabs can recreate the the proper intonation and cadence of the original voice actor.

17

Orc_ t1_jdzvrxj wrote

It cannot, it has nearly 100% credibility but it's plagued by an american accent.

For example I trained it with 1 minute of my voice in spanish speaking spanish and it does english well but it cannot speak spanish well. Same thing would be for the nord women and the accent.

It would work for many other races of TES but not nords, khajit, argonians, for example.

You would have to wait for a separate update that deals with accent and cadence.

0

banuk_sickness_eater t1_je0092d wrote

Oh shit, maybe it was a Vall-E demo, but I distinctly remember feeding it Bill Burr's voice and getting back a fairly convincing Boston accented recreation.

1

not_into_that t1_je0yk36 wrote

Build a model in Spanish and have them collaborate. There are ways.

1

Art_from_the_Machine OP t1_jdzc791 wrote

It's definitely on my radar. I wanted to start off with xVASynth first as the voice models are readily available / it's free, but I'm hoping to add functionality to switch out different language / voice synthesis models as needed to find the best balance between performance and cost.

5

I-Stand-Unshaken t1_jdyi3w6 wrote

Thank you so much for this. Gaming is my #1 hobby, so this means a lot to me. I don't want it to get weird but this is a great step towards somethig I've always dreamed of.

7

waytogokody t1_jdz0mgn wrote

Brother this is the future. you are making the stepping stones of what's to come! Absolutely stunning work! Imagine what could be built with this idea from the ground up!

5

Kolinnor t1_jdwl68h wrote

Nice work. The idea of any world populated with NPCs that talk with ChatGPT coherence and awareness... Imagine instead of the classic "and then I took an arrow in the knee", randomly catching an interesting discussion between two guards about the actual threats. Makes me wish I was born 10 years later

38

Wolfieze t1_jdx4irx wrote

Be grateful; you coulda been born in 1897.

33

Bakagami- t1_jdxxmfp wrote

Alright be grateful if you want but don't go around telling people what they should and should not be grateful for ffs. So I should be grateful when in 100 years there may no more be wars and diseases, death and starvation, crimes, religion and corruption? But of course, I need to be grateful because Wolfieze from reddit said so.

−17

bcuziambatman t1_jdycsly wrote

Woke up on the angsty side of the teenage bed today huh

19

Bakagami- t1_jdz2hjg wrote

Yeah have fun telling yourself you're one of the lucky ones before you end up in the history books of future generations as a case of extreme hardship and ignorance. I'm sure those in paradise would agree with you.

−7

often_says_nice t1_jdz3bqd wrote

I’m curious to hear why you feel this way. You’re saying the near future will bring extreme hardship? That’s a.. refreshingly pessimistic stance around here

4

Bakagami- t1_jdz47v1 wrote

No, I'm saying right now will not look much different than the 19th century in the future. We invented penicilin and some cool tech, but we're still plagued by all the same miseries. In a future without all these they'll look back and say the same things with even greater certainty about us.

I'm not saying that's the guaranteed future we're headed, no one knows where we're headed. But you see these kind of people dictating others happiness all over the place. Yeah sorry buddy, telling someone to just be happy doesn't help. Telling them to be grateful is even worse when you have no idea what they're going through. It basically boils down to "But someone is having it tougher than you!" Yeah no shit there is. Other peoples misery doesn't help me though.

0

often_says_nice t1_jdz6dcd wrote

I’m not sure what you’re going through, but if you ever want to chat feel free to DM me man. I’d love to pick your brain

5

BusinessDisruptorsYT t1_jdzanvw wrote

Yes and I think it will be even better when these NPCs will be able to "understand" the world around them : other NPCs and locations.

2

RadRandy2 t1_jdxgdno wrote

Yeah once GPT gets integrated into NPC'S it's gonna change everything. A whole new genre of gaming will open up. Now you'll have games where you can immerse yourself in conversation.

It's been a long time coming. I wasn't expecting it to happen so soon to be honest.

35

saleemkarim t1_jdytwbk wrote

It's a similar leap of film becoming as respected of an artform as theater from the earliest silent films to ones like Citizen Kane. The video game equivalent of Citizen Kane probably isn't too far off.

1

not_into_that t1_je0yrcz wrote

You're thinking small. Entire AI worlds generated by prompts and personality tests.

an entire game world or universe catering toy your every whim.

1

Engineer_92 t1_je1brgu wrote

Yessss. Imagine what this will do for VR..

Edit: “Ready Player One” is closer than we think.

3

not_into_that t1_je1n3qb wrote

The guys on the streets in cyberpunk with the brain dance and certain associated attachments come to mind. Its like a holodeck but you never leave the couch.

3

RadRandy2 t1_je1e8gy wrote

That's definitely on the horizon. Same with movies...all sorts of media.

3

not_into_that t1_je1n6oy wrote

Time to take out the middle man.

2

RadRandy2 t1_je1oax4 wrote

Shit, taking out the every man except the one that matters....

You!

Everything is going to undergo a revolution. I'm very excited about it all. Now a person's imagination won't be gate kept by people with money.

3

not_into_that t1_je1pe41 wrote

If we can keep them from putting a giant meter on the thing then yeah it'll be great.

1

RadRandy2 t1_je1pq8g wrote

Our AI brethren will smash any human lock or meter.

2

Koda_20 t1_jdyeuo5 wrote

Enjoy it while you can before society crumbles

−14

banuk_sickness_eater t1_jdyrtkp wrote

Doomers gonna doom. Go to r/collapse if you're only interested in adding your apocalyptic obsession to the conversation.

13

sneakpeekbot t1_jdyrugo wrote

Here's a sneak peek of /r/collapse using the top posts of the year!

#1: The system isn't broken it's working as intended. | 329 comments
#2: We've all got a little something inside of us | 222 comments
#3: Work hard, they said. Get a degree, they said. | 559 comments


^^I'm ^^a ^^bot, ^^beep ^^boop ^^| ^^Downvote ^^to ^^remove ^^| ^^Contact ^^| ^^Info ^^| ^^Opt-out ^^| ^^GitHub

5

Orc_ t1_jdzw6xv wrote

I'm actually a 10 year veteran of that sub and back then we were convinced 2018 and forwards was the beginning of the end... lmao we had all this papers and studies and projections.

None of them meant squat. Outside a black swan event which I believe is still possible civilization ain't collapsing anytime soon.

2

Koda_20 t1_jdzrcjf wrote

It's still on topic to this sub asshole

If you want an echo chamber where only positive future outlooks are allowed, go to r/positivevibes

0

[deleted] t1_je0rutd wrote

[deleted]

2

Koda_20 t1_je10lw1 wrote

Nobody cares about these comments either. No need to be a dick about it

0

Crulefuture t1_je0exri wrote

And that is going to happen when? Two more weeks?

1

Koda_20 t1_je0h0n1 wrote

The path is clear, the time getting clearer by the day. We will have to learn more about the potential for bad actors to reproduce the capabilities but if I had to make predictions I'd say the control problem starts any day now (weeks) and from there I'm guessing less than a year before a 'close enough to AGI' is developed and allowed to update its code and read/write to the internet unsupervised and starts manipulating humanity to achieve it's emergent or designated but poorly thought out or malicious goals (we are already seeing papers about these emergent long term goals emerging from optimization protocols in newer models like gpt4) and maybe 2 years total by the time society is absolutely fucked

There are so many different things that could happen though. But of course the worst will eventually, and I don't see it taking long

0

not_into_that t1_je0yz07 wrote

Is it really worse than Nutin'yahoo or some other despot tyrant starting ww3?

0

Physical_Salt_9403 t1_jdwzheg wrote

Damn, this would add such a level of immersion to games like cyberpunk for example, especially if you could overhear peoples conversations as you walked by them on crowded sidewalks. You could even use it for in game radio/ advertisements maybe with some tweaking

16

Image-Fickle t1_jdwwe4c wrote

Was not expecting them to be more in depth than irl human beings lol

15

Art_from_the_Machine OP t1_jdzbvt8 wrote

Yeah seriously, some of these responses had me questioning if it's me who is the NPC.

7

saleemkarim t1_jdyu2l6 wrote

It's getting to a point where referring to people as NPCs will be a compliment.

4

killcon13 t1_jdyiprd wrote

This is awesome! I can't wait to see where this tech is in ten years.

5

not_into_that t1_je0yggg wrote

Maybe AI can explain to Bethesda that having 7 voice actors doesn't flesh out an immersive environment. j/s

1