WonderFactory t1_jeg8ddb wrote

You're actually right. I'm a software engineer but taught myself electrics, plumbing and carpentry over the years to carry out repairs to my home. I've fitted a whole bathroom on my own and did all the wiring on an extension I had built in my house. I'm sure I'm capable of getting work as a plumber or electrician if things go to pot (carpentry is probably a bit too dangerous as you're breathing in dust all day) but I really don't relish the idea of that. It's hard physical labor, I like getting paid to sit in my nice warm house to mess around with computers.


WonderFactory t1_jeg5tbe wrote

With enough investment it wouldn't take long to catch up with OpenAI. I think by this time next year there will be multiple models better than GPT-4, maybe even hundreds. Almost anyone can do it. It's possibly the case that GPT 4 isn't even trained optimally. Its very slow so presumably didn't build on the optimal data/parameters balance shown in the chinchilla paper.


WonderFactory t1_jeap8lf wrote

Reply to comment by genericrich in GPT characters in games by YearZero

I think it can work, I'm trying to get it working in a game I'm developing at the moment. You have to have a mix of randomness and structured story telling. I literally have to say to ChatGPT, the user is saying xyz, reply to the user but try to work this plot point into your reply.


WonderFactory t1_jeaotp1 wrote

I'm actually adding ChatGPT NPCs to the Unreal Engine 5 game I'm developing at the moment, it's a rogue like set in a post singularity world, gameplay is similar to Hades so there's plenty of dialogue in the game. at the minute it's difficult to get a model to run on the local PC so I'm using OpenAI's API. There are challenges like latency while you're waiting for the API to return, it's also quite expensive so releasing a free demo of the game is out of the question. It could potentially cost several dollars per user in API fees over the life of the game so that will of course limit your pricing flexibility, you can only reduce the price so much in steam sales etc. I'm hoping though that inference costs will come down by the time the game is finished.

I haven't posted any footage with the GPT dialogue added to the game but I might post it here in a couple of weeks.


WonderFactory t1_je4yq6a wrote

Paradoxically technology will become easier to navigate not harder thanks to LLMs. You can now just tell Excel what you want from your spreadsheet rather than having to learn complicated formulas and pivot tables etc


WonderFactory t1_jdy7v00 wrote

We actually don't need AI to develop much beyond where it is at the moment for crazy advances in medicine and technology over the next decade. Just applying ML where it is now to thousands of different applications will lead to crazy breakthroughs. Imagine thousands and thousands of Models like Alpha Fold and what they will bring to scientific advancement. There was a defusion model that can literally read people's minds using brain MRIs posted here yesterday. That's crazy sci-fi stuff already happening. Things are already happening that a year ago I wouldn't have thought would be possible in my lifetime.


WonderFactory t1_jdm4pk1 wrote

How long though before LLMs perform at the same level as experts in a most fields? A year, two, three? When you get to that point you can generate synthetic data that's the same quality as human produced data. The Reflexion paper mentioned in another thread claims that giving GPT 4 the ability to test the output of its code produces expert level coding performance. This output could be used to train an open source model.


WonderFactory t1_jdm1slk wrote

We don't understand how it works. We understand how it's trained but we don't really understand the result of the training and exactly how it arrives at a particular output. The trained model is an incredibly complex system.


WonderFactory t1_jd09v3q wrote

This is definitely within that capacity of humans and could happen. Imagine if Robot armies existed in the 1930s. The Nazis literally set about killing millions of people who they thought weren't beneficial to society. They killed gypsies, Jews, gays, the disabled etc.

Jews were biologically the same as Nazi Germans but it didn't stop them killing them. Poor people become a problem if they're consuming too many resources. The wealth of the rich has to feed and clothe the poor if the poor aren't able to work.

This happened less than a hundred years ago, we haven't evolved since then and as a species are more than capable of doing the same again. Also what happened in the 30's and 40's isn't an anomaly in human history, humans have continually treated one another like this. Look at slavery in the US, apartheid in South Africa, the British empire ruling one 1/5 of the globe. The fact that we have a special word for genocide give a clue about how ubiquitous it's been in our history