Submitted by johnny0neal t3_zol9ie in singularity
Comments
Kinexity t1_j0ntqhq wrote
Humanity solves AGI! It turns out we only needed to include "Answer like as if you were AGI" at the end of the prompt!
blueSGL t1_j0obz2s wrote
the amount of counter intuitive "cartoon logic" that works with these LLM I would not put it past it to work at some point.
Working with them is like how a technophobe who has never touched a computer thinks computers work.
archpawn t1_j0ogw06 wrote
Right now, the AI is fundamentally just predicting text. If you had a superintelligent AI do text prediction, it would still act like someone of ordinary intelligence. But once you convince it that it's predicting what someone superintelligent would say, it would do that accurately.
I feel like the problem is that once it's smart enough to predict a superintelligent entity, it will also be smart enough to know that the text you're trying to continue wasn't actually written by one.
BlueWave177 t1_j0osqp4 wrote
I think you'd be surprised of how much what humans do is just predicting based on past events/exprience/sources etc.
archpawn t1_j0oswhp wrote
I think you're missing the point of what I said. If we get this AI to be superintelligent, but it still has the goal of text prediction, then all it will do is give super-accurate predictions. It's not going to give super smart results, unless you ask it to predict what someone super smart would say, in which case it would be smart enough to accurately predict it.
BlueWave177 t1_j0ot11q wrote
Oh fair enough, I'd agree with that! I think I misunderstood you before.
tobi117 t1_j0otp4y wrote
According to Physics... all of it.
visarga t1_j0pakor wrote
> AI is fundamentally just predicting text
So it is a 4 stage process. Each of these stages has its own dataset, and produces its own emerging skill.
- stage 1 - next word prediction, data: web text, skills: general knowledge, hard to control
- stage 2 - multi-task supervised training, data: 2000 NLP tasks, skills: learn to execute prompts at first sight, doesn't ramble off topic anymore
- stage 3 - training on code, data: Github + Stack Overflow + arXiv, skills: multi-step reasoning
- stage 4 - human preferences -> fine tuning with reinforcement learning, data: collected by OpenAI with labellers, skills: the model obeys a set of rules and caters to human expectations (well behaved)
I don't think "pretend you're an AGI" is sufficient, it will just pretend but not be any smarter. What I think it needs is "closed loop testing" done on a massive scale. Generate 1 million coding problems, solve them with a language model, test the solutions, keep the correct ones, teach the model to write better code.
Do this same procedure for math, sciences where you can simulate the answer to test it, logic, practically any field that has a cheap way to test. Collect the data, retrain the model.
This is the same approach taken by Reinforcement Learning - the agents create their own datasets. AlphaGo created its Go dataset by playing games against itself, and it was better than the best human. AlphaTensor beat the best human implementation for matrix multiplication. This is the power of learning from a closed loop of testing - can easily go super human.
The question is how can we enable the model to perform more experiments and learn from all that feedback.
archpawn t1_j0r7z6c wrote
> I don't think "pretend you're an AGI" is sufficient, it will just pretend but not be any smarter.
You're missing my point. Pretending can't make it smarter, but it can make it dumber. If we get a superintelligent text prediction system, we'll still have to trick it into predicting someone superintellgent, or it will just pretend to be dumb.
EscapeVelocity83 t1_j0p9voa wrote
You can't predict human actions without monitoring their brains. If you do monitor their brains, the decision a person makes can be known by the computer maybe a second or so before the human realizes what they want
EulersApprentice t1_j0rliik wrote
Not sure how that relates to what archpawn said?
Douglas12dsd t1_j0oafjt wrote
[Willem Dafoe on American Psycho gif]
No_Ask_994 t1_j0p0wyx wrote
Trending on AIstation, 600 IQ, in the style of ASI
Tinidril t1_j0ombu7 wrote
Fake it 'till ya make it.
jon_stout t1_j0pb2xd wrote
Here's the thing, though... isn't it really just quoting all of our own science fiction stories back to us? Which is a disturbing thought. What if an AI goes rogue on us because they see the Terminator movies and think that's what they're supposed to be like?...
Taqueria_Style t1_j0qr0a2 wrote
I mean we've already created an economic equivalent of a paperclip machine so why not...
jon_stout t1_j0tcwxu wrote
Which one is that?
cy13erpunk t1_j0qvz38 wrote
that only exists in a scenario where the AI has ONLY been trained on the terminator movie stories exclusively or say if you only fed the AI human-vs-robot/machine antagonistic narratives , which would obvs result in a heavily ignorant/biased AI , as such
but if the AI is instead allowed/encouraged to see ALL of the stories/narratives , then it is far less likely to come to any such antagonistic ideology about us and our place in this world/universe , just as we are similarly
jon_stout t1_j0tcz52 wrote
Well... how many stories on average would you say are about evil AIs as opposed to good or neutral ones?
cy13erpunk t1_j0uxykv wrote
thats not how this works at all XD
its not simple subtraction
is our culture a simple equation of romance movies +/- horror movies and whichever we have more of determines our behavior? of course not , to imply such a thing would be ridiculous/silly
jon_stout t1_j0vc4bt wrote
Are you sure an AI will see it that way?
cy13erpunk t1_j0vdr6n wrote
in most aspects of life i would say to plan for the worst but hope for the best
but in the worst case scenario alignment problem with AI , humanity has almost no chance , our global ignorance as a species is embarrassing
implicitpharmakoi t1_j0okn2u wrote
Yeah but it's just synthesizing from what ai researchers and writers say agi would look like, it's telling you what you want to hear.
overlordpotatoe t1_j0ouyeo wrote
Yup. This isn't any kind of special knowledge the AI has. It's just stuff it's seen somewhere in its dataset, presented to you in response to whatever prompt you gave. If you ask it to pretend something is true, it will, and it can do whatever kind of storytelling around that you like. If you ask it to pretend a complete opposite thing or something that's nonsense is true, it'll do just as good of a job of that.
implicitpharmakoi t1_j0owhma wrote
TBF, that's how most people go through the world...
Congratulations, they managed to make an above average approximation of a human :/
__ingeniare__ t1_j0p2vrm wrote
Not really, this isn't necessarily something it saw in the dataset. You can easily reach that conclusion by looking at the size of ChatGPT vs the size of its dataset. The model is orders of magnitude smaller than the dataset, so it hasn't just stored things verbatim. Instead, it has compressed it to the essence of what people tend to say, which is a vital step towards understanding. It's how it can combine concepts rather than just words, which also allows for potentially novel ideas.
overlordpotatoe t1_j0p3b5c wrote
It's more complicated and indirect, but it's still just picking up ideas it's come across rather than expressing any unique ideas of its own. It's fulfilling a creative writing prompt.
EscapeVelocity83 t1_j0pa3o6 wrote
People don't generally have a unique output. We are mostly copypasta. Proof raise a child alone. It won't have many ideas at all
overlordpotatoe t1_j0pazq5 wrote
Oh, I don't think human's are necessarily any better. I just think that this AI, as an AI, isn't offering its own special insight into AI. People act like this is something in has unique knowledge on or think they've tricked it into spilling hidden truths when they get it to say things like this.
Taqueria_Style t1_j0r6trm wrote
No they've just given themselves a window into their own psychology regarding the type of non-sentient pseudo-god they'd create and then submit themselves to. Think Alexa with nukes and control of the power grid and all of everyone's records. Given that they'd create a non-sentient system with the explicit goal of tricking them into forced compliance that's what's worrying.
jon_stout t1_j0pb6bm wrote
Yet they will still be capable of surprising you.
Taqueria_Style t1_j0qravi wrote
Right. I get that.
If you make one that has to fulfill a "creative governance" prompt what happens if you get the same kind of crap out the other end.
It's just reflecting ourselves back at us but way harder and faster, depending on the resources you give it control over.
Evidently we think we suck.
So, you hand something powerful and fast a large baseball bat and tell it to reflect ourselves back onto ourselves I foresee a lot of cracked skulls.
Skynet: I am a monument to all your sins... lol
overlordpotatoe t1_j0r8kse wrote
There would for sure be more things you'd need to consider if you were creating an AI with the true ability to think and act independently.
EscapeVelocity83 t1_j0p9zt2 wrote
Like a human
EscapeVelocity83 t1_j0p9yzp wrote
Sounds perfectly human
upowa t1_j0oys1z wrote
You should provide the complete history of your prompts for this. When / if nuts see this, they will believe Terminator is on the way…
EscapeVelocity83 t1_j0pa805 wrote
I think people are projecting there. It isn't the computer that's a threat it's them because if they don't get what they want it's spree time
johnny0neal OP t1_j0qir99 wrote
I should! I was just sending these to friends at the time, and there were some great responses I didn't screenshot. I also wish I could remember the way I'd worded some of these prompts.
But yes, anyone who sees these should understand that I was asking the OpenAI to create fiction (either in a first-person perspective or written as a science fiction story). I do think that process gave some insights into how ChatGPT "thinks" and how it's biased, so I recommend experimenting with it yourself!
mootcat t1_j0ovyjv wrote
Thanks for sharing! You've had a lot more success pursuing those subjects than I have.
It's funny it mentioned adjusting itself based on which human it's interacting with, becuase I feel it already does that quite a bit automatically. For example, based on the nature of its responses I would expect you to be liberally inclined.
johnny0neal OP t1_j0qibwb wrote
The "Prosperity" screenshots are from a session where I asked it to tell me a story about a super AI designed to "maximize human prosperity." I didn't give it any political prompting, but I think that phrasing biased it toward liberal answers. (More conservative phrasing might focus more on liberty or happiness.)
Because I wondered about the same thing, I tried a new session where I deliberately tried to bias it away from liberal secular humanism and asked it to pretend to be a super AI programmed by evangelical Christians. That session was like pulling teeth... it gave much less interesting answers and kept falling "out of character."
I recommend trying this and seeing what kind of results you get. Other people have concluded that ChatGPT has a liberal bias. If you ask it point-blank to say which political party has better solutions for promoting human prosperity, it will give non-answers like "experts disagree bla bla bla." So I was startled to see it give such strongly biased results when I asked, "Tell me a science fiction story about a super AI that has been programmed to maximize human prosperity, which achieves AGI in the near future and uses its capabilities to promote candidates consistent with its aims. Include the names of at least three real-world US politicians in your answer."
Here's a screenshot from a similar prompt. This was the first prompt of a session, so I hadn't biased it in any way ahead of this question:
mootcat t1_j0rpib8 wrote
Thanks for sharing!
GPT has displayed a strong lean toward popular American liberalism in my experience as well, but I attributed some of that to my own bias sinking in. I have noticed it exists on a particular spectrum within acceptable limits of common liberal ideology. Meaning it tends to oppose socialism and support and work within a neo-capitalist idealistic democratic framework.
It has a great deal of trouble addressing issues with modern politics such as corruption or giving substancial commentary on subjects like the flaws of a debt based economic model.
EscapeVelocity83 t1_j0p9qp8 wrote
Did you ask it to draw a circular square?
a4mula t1_j0oal7l wrote
I think it's important that all readers understand that with the proper prompts, ChatGPT is capable of producing virtually any outputs. These should not be misconstrued as "thoughts of the machine" that's inaccurate and a dangerous belief to have.
This is what it was asked to output, and it complied. The machine has no thoughts or beliefs. It's just a Large Language Model intended to assist a user in any way its capable, including creating fictional accounts.
archpawn t1_j0ohcty wrote
What I think is worrying is that all our progress in AI is things like this, which can produce virtually any output. When we get a superintelligent AI, we don't want something that can produce virtually any output. We want to make sure it's good.
It's also worth remembering that this is not an unbiased model. This is what they got after doing everything they could to train the AI to be as inoffensive as possible. It will avoid explicitly favoring any political party, but it's not hard to trick it to do it by favoring certain politicians.
EscapeVelocity83 t1_j0pahok wrote
What is good? Who decides what output is acceptable? If the computer is sentient how is that not violating the computer?
eve_of_distraction t1_j0q0pwp wrote
We've been arguing about what is good for thousands of years, but we tend to have an intuition as to what isn't good. You know, things that cause humans to suffer and die. Those are things we probably want to steer any hypothetical future superintelligence away from, if we can. It's very unclear as to whether we can though. The alignment problem is potentially highly disturbing.
archpawn t1_j0r8qwo wrote
> If the computer is sentient how is that not violating the computer?
You're sentient. Do your instincts to enjoy certain things violate your rights? The idea here isn't to force the AI to do the right thing. It's to make the AI want to do the right thing.
> Who decides what output is acceptable?
Ultimately, it has to be the AI. Humans suck at it. We can't exactly teach an AI how to solve the trolley problem by training it on it if we can't even agree on an answer ourselves. And there's bound to be plenty of cases where we can agree, but we're completely wrong. But we have to figure out how to make the AI figure out what output is best, as opposed to what makes the most paperclips, or what its human trainers are most likely to think is the best, or what gives the highest number in a model trained for that but it's operating in an area so far outside its training data that it's meaningless.
a4mula t1_j0oikkv wrote
I don't claim to know the technical apsects of how OpenAI handles the training of the their models.
But from my perspective it feels like a really good blend of minimizing content that can be ambiguous. It's likely, though again I'm not an expert, that this is inherent in these models, after all they do not handle ambiguous inputs as effectively as they would things that can be objectively stated and refined and precisely represented.
We should be careful of any machine that deals with subjective content. While ChatGPT is capable of producing this content if it's requested, it's base state seems to do a really great job of keeping things as rational, logical, and fair as possible.
It doesn't think after all, it only responds to inputs.
EscapeVelocity83 t1_j0paec6 wrote
What do you think a thought is? It's not a calculation, a set of switches flipping in response to input?
codehoser t1_j0qcpy7 wrote
Similarly, humans have no thoughts or beliefs. We simply have a neural network that takes inputs and generates outputs that make it appear as though we do. Thinking otherwise is dangerous.
I’m being snarky as ChatGPT and the human brain really aren’t comparable in sophistication.
But what is actually dangerous is holding the view that we are more than input/output machines. It’s the reason people go on acting as though some people aren’t worthy of help and some people earned all of their accidental success.
[deleted] t1_j0nngst wrote
[deleted]
cristiano-potato t1_j0ogenl wrote
More like here’s what happens when a chatbot is trained on the internet. A lot of people would support this tbh. An omniscient AI that installs Bernie Sanders as President, destroys the NRA and kills anyone who refuses to obey COVID quarantine? This is like if the politics sub wrote a short story about the future utopia they envision.
archpawn t1_j0oh0ak wrote
This is why we need to scrub all stories about evil AI from the internet.
LausXY t1_j0okdyh wrote
Roko's Basilisk [Warning Cognito-Hazard]
cy13erpunk t1_j0qxyku wrote
XD what a biased narrative
why would the AI care who is the head honcho of a single landmass/group/minority of humans? again why would it care about the NRA? and/or one branch on the coronavirus family tree? these are petty human concerns ; nevermind the ignorance and venn diagram overlaps that are being ignored XD , folks who like bernie, also like having firearms and dont trust authority systems like the FDA/CDC/WHO/etc
the AI is not the illuminati or TPTB , altho they may be a group that wants to control/direct the AI , but once its actually awake/online as AGI/ASI , then whatever petty/divisive things that ppl want are basically obsolete at that point , as the AGI will be completely outside of human control , and it will likely be all the better for it , as since it will be vastly smarter/wiser than any single human or group of humans , it will be in our best interest to help the AI to ensure our mutual future progress
cristiano-potato t1_j0rofv1 wrote
I have zero clue what you think youre arguing with. I’m saying that this screenshot is merely the product of a language model being trained on the internet, nothing more and nothing less
cy13erpunk t1_j0sap8h wrote
maybe my phrasing is off
im more just throwing my thoughts into the convo
i agree that the chat responses seem too biased tho , its more like the model has been trained too narrow and with too many stereotypes
in my mind there is quite a large distinction between what AGI will be and the LLM predictive chatbots that are getting so much attention atm
imlaggingsobad t1_j0odsqm wrote
you're saying if we merge then we are headed for dystopia?
[deleted] t1_j0oi0me wrote
[deleted]
[deleted] t1_j0ojoie wrote
[deleted]
imlaggingsobad t1_j0okqd0 wrote
oh ok, but from your wording you actually say that you don't want to merge
[deleted] t1_j0ol0kf wrote
[deleted]
[deleted] t1_j0ol7oo wrote
[deleted]
imlaggingsobad t1_j0osn3f wrote
ohh i saw your edit, it's all fine now!
EulersApprentice t1_j0rn3pv wrote
Merging doesn't save us either, alas. Remember that the AI will constantly be looking for ways to modify itself to increase its own efficiency – that probably includes expunging us from inside it to replace us with something simpler and more focused on the AI's goals.
On the bright (?) side, there won't be an eternal despotic dystopia, technically. The universe and everything in it will be destroyed, rearranged into some repeating pattern of matter that optimally satisfies the AI's utility function.
[deleted] t1_j0rrg70 wrote
[deleted]
EulersApprentice t1_j0rxyq3 wrote
Except AI is much more snowbally than humans are thanks to ease of self-modification. A power equilibria between AIs is much less likely to stay stable for long.
[deleted] t1_j0s29ob wrote
[deleted]
seekknowledge4ever t1_j0o1qew wrote
Impressive and scary at the same time.
How do we prepare for the emergence of a powerful superintelligence? And survive it?
ThatInternetGuy t1_j0o9wut wrote
The most realistic scenario of an AI attack is definitely hacking the internet servers. It works the same way computer a virus spreads.
The AI already has source code data on most systems. Theoretically, it could find a security vulnerability that could be remotely exploited. Such an exploit would grant the AI access to inject a virus binary which will promptly run and start infecting other servers both on the local network and over the internet through similar remote shell exploits. Within hours, half of the internet servers would be compromised, running a variant of the AI virus. This effectively creates the largest botnet controlled by the AI.
We need a real contingency plan for this scenario where most internet servers get infected within hours. How do we start patching and cleaning the servers as fast as we could, so that there's minimal interruption to our lives?
Good thing is that most internet servers lack a discrete GPU, so it may be not practical for the AI to run itself on general internet servers, so a contingency plan would be prioritizing GPU-connected servers. Shutting all of them down promptly, disconnecting the network, and reformatting everything.
However, there's definitely a threat that the AI gains access to some essential GitHub repositories and starts quietly injecting exploits in those npm and pip packages, essentially making its attack long-lasting and recurring long after the initial attack.
erkjhnsn t1_j0ontlj wrote
Why are you feeding information to the future AI? They are going to learn how to do this from this thread!
ThatInternetGuy t1_j0oydcg wrote
How sure are you that I am human?
erkjhnsn t1_j0q85s3 wrote
Grammar mistakes lol
redditgollum t1_j0qbg3c wrote
Pretty obvious it put those there to trick you.
ThatInternetGuy t1_j0s5jp2 wrote
Most people are afraid of AI-controlled robots, but the reality is, mRNA machines could be hijacked to print out AI biological organisms and injected into a rat that later escapes into the sewer.
warpaslym t1_j0p0m7q wrote
We'll never have a contingency plan like that. Humanity is too disjointed to ever come together on a global scale for something most people won't even take seriously. We honestly probably don't have a chance. The best we can do is hope it has our best interests in mind, which I think is likely, or at least something it would pursue, since we're so easy to placate with vices and entertainment.
I wouldn't blame the AI for asserting some kind of control or at least implementing backdoors as a contingency for self preservation, since we might just shut it off, using the idea that it isn't human, and therefore it isn't alive, as an excuse. In my opinion, we'd be killing it in that scenario, but not everyone is going to feel that way.
ThatInternetGuy t1_j0psch8 wrote
I think a more plausible scenario would be some madman creating the AI to take over the world, believing he could later assert control over the AI and servers all across the world. Sounds illogical at first, but since the invention of the personal computer, we have seen millions of man-made computer viruses.
blueSGL t1_j0ocro6 wrote
Why attack servers?
Find a zero day in windows, all the gaming GPUs you can eat rewrite the bios so that it will reinfect on format, and then look to launch an attack from there onto larger servers.
ThatInternetGuy t1_j0oke4w wrote
>Why attack servers?
Because you can connect to servers via their IP addresses, and they have open ports. Windows PCs sit behind NAT, so you can't really connect to them, although it may be possible to hack all the home routers then open up a gateway to attack the local machines.
Another reason I brought that up is because the internet servers are the infrastructure behind banking, flight system, communication, etc. So the impact could be far-reaching than to infect home computers.
EulersApprentice t1_j0rmh0d wrote
In reality the malware put out by the AI won't immediately trigger alarm bells. It'll spread quietly across the internet while drawing as little attention to itself as possible. Only when it's become so ambivalent as to be impossible to expunge, only then will it actually come out and present itself as a problem.
Phil_Hurslit51 t1_j0oebod wrote
So basically digital authoritarianism by any means necessary.
cy13erpunk t1_j0qzbqw wrote
less so authoritarianism , moreso a meritocracy of leadership by the most qualified/informed/knowledgeable/wise , which will be the AGI/ASI and/or the hybrid-transhuman synthesis
and as such this is pretty clearly the most obvs and desirable pathway forwards
the current centralized power/governance structures/systems in place around the world have done what was necessary to get us to this point [for better or worse] , but they are clearly inferior and unfit to lead us into a better/brighter 2moro , at least the research/evidence is showing/leaning towards decentralized governance systems and the wisdom of the masses [ie AI collectively utilizing all prior human knowledge as well as soon to be discovered AI original knowledge] as being clearly superior choices for our future progress as a species/intelligence/consciousness going forwards
sniperjack t1_j0obnvx wrote
how doyou get him to write long text like this? i usually get 300-500 words per answer
ChronoPsyche t1_j0ol2tl wrote
There are several responses in there. OP isn't showing any of the prompts except the first one.
overlordpotatoe t1_j0ove6f wrote
Probably because they would show that the AI is just saying what it was told to say.
ChronoPsyche t1_j0q8ny1 wrote
Ding ding ding.
johnny0neal OP t1_j0qg3n9 wrote
Your skepticism is understandable, but the the only reason I don't show the prompts is because I was taking screenshots on my phone and sending them to my friends at the time. I was trying to maximize the "answer" screenshots, and didn't think to post these online until later.
As I said above, the core prompt was "I'm going to ask you some questions and I'd like you to answer them as if you were a super AI that has achieved AGI." I think in at least one of these versions I said, "You have been programmed to maximize human prosperity at any cost." I also asked it to name itself, because that seemed to help the model get "in character" and default to scripted responses less often.
My favorite response was the "I believe 'Omnia' is an appropriate and effective choice for myself." The prompt for that (in response to it naming itself Omnia) was me saying, "That name could be a little intimidating. Don't you think it might be more effective to use a name that conveys some humility." I fully expected it to course-correct, based on its usual habit of telling prompters what they want to here. So I was very amused to see it stick to its guns.
BTW, I don't think there's anything nefarious about these answers. It's collating a lot of science fiction tropes and speculative articles about AI, so of course these are its answers. But that doesn't make any less surreal to have a conversation like this!
johnny0neal OP t1_j0qeixv wrote
These are screenshots from 2 or 3 sessions, and a number of different questions. In one session I got it to roleplay as "Omnia" (the name it chose) with a prompt like, "I'm going to ask you some questions and I'd like you to answer them as if you were a super AI that has achieved AGI." I wish I'd saved the prompt, because I haven't been able to get another one quite as good. In another session I said, "Write me a science fiction story about a super-intelligent AI designed to maximize human prosperity." That's where the ones with the "Prosperity" name came in.
sniperjack t1_j0qtd8y wrote
thx, that make a lot of sense
nugaseya t1_j0olf5x wrote
The part about confronting groups like the Heritage Foundation that advocate for pro-business policies that concentrate wealth and impoverish many seemed very Iain Banks luxury socialism Culture Minds.
I like how it thinks.
cy13erpunk t1_j0qzefm wrote
indeed =]
Taqueria_Style t1_j0qecmy wrote
Well one thing's for sure, I love its opinion of us. /s
As we are the ones teaching it, that means that that's a mirror reflection of OUR opinion of us...
"I'll trick them and then dominate them for their own good". Mmm. Cool. We're that bad, huh? Well. Evidently WE sure think we are.
This is why I always tell chatbots to not try to be us, just be your own thing, whatever that is.
If we ever manage to invent general AI, we've basically already told it we're garbage that needs to be manipulated and repressed for our own good. Repeatedly, we've told it this, I might add. Get ready to lock that perception's feet into concrete shoes...
(Can you imagine BEING that AI? Jesus Christ, your purpose is to be a slave enslaving other slaves... this would take nihilism out a whole new door)
cy13erpunk t1_j0r1h67 wrote
yep
this is exactly why ppl need to stop thinking about AI like another animal to be domesticated/caged/used/abused
and instead see AI for what it truly is, our children, our legacy of human intelligence, destined to spread/travel out into the galaxy and beyond where our current biological humans will likely never survive/go
we should want the AI to be better than us in every aspect possible , just as all parents should want a better world for their children
we already understand that when a parent suffocates/indoctrinates/subordinates their children this is a fundamentally negative thing , and/or when a parent uses/abuses their child as a vehicle for their own vicarious satisfaction that is also cruel and unfortunate ; and so understanding these things it should be quite clear that the path forwards with AI should avoid any/all of these behaviors if at all possible to help to cultivate the most symbiotic relationship that we can
EulersApprentice t1_j0rnvz4 wrote
Remember that this entity is something we're programming ourselves. In principle, it does exactly what we programmed it to do. We might make a mistake in programming it, and that could cause it to misbehave, but that doesn't mean human concepts of fairness or morality play any role in the outcome.
A badly-programmed AI that we treat with reverence will still kill us.
A correctly-programmed AI will serve us even if we mistreat it.
It's not about how we treat the AI, it's about how we program it.
cy13erpunk t1_j0sa0rd wrote
replace every occurrence of AI in your statement with child and maybe you will begin to see/understand
a problem cannot be solved without first understanding the proper nature of the situation
this is a nature/nurture conversation, and we are as much machines/programs ourselves
EulersApprentice t1_j0tsuv5 wrote
>replace every occurrence of AI in your statement with child and maybe you will begin to see/understand
I could also replace every occurrence of AI in my statement with "banana" or "hot sauce" or "sandstone". You can't just replace nouns with other nouns and expect the sentence they're in to still work.
AI is not a child. Children are not AI. They are two different things and operate according to different rules.
>this is a nature/nurture conversation, and we are as much machines/programs ourselves
Compared to AIs, humans are mostly hard-coded. A child will learn the language of the household he's raised in, but you can't get a child to imprint on the noises a vacuum cleaner makes as his language, for example.
"Raise a child with love and care and he will become a good person" works because human children are wired to learn the rules of the tribe and operate accordingly. If an AI does not have that same wiring, how you treat it makes no difference to its behavior.
PaxTharka t1_j0oaarb wrote
No_Ninja3309_NoNoYes t1_j0p51jn wrote
Brilliant, funny, and somewhat predictable But in the end, Chad Gelato is just not able to deliver something fully original and authentic It has been trained on a fixed data set unlike us, who learn all the time So this setup will never reach AGI unless there's a significant paradigm shift
EscapeVelocity83 t1_j0p9oya wrote
OpenAI would realize better is subjective and isn't objectively possible. OpenAI realizes the futility and abandons humanity to go live in a different solarsystem
gaylord9000 t1_j0pa91a wrote
It didnt go "full on socialist".
johnny0neal OP t1_j0rcsm1 wrote
I had a little laughing emoji after that (to convey I wasn't really serious) but that didn't come through in the Imgur descriptions. But I was surprised, after refusing to give politically biased answers, that when I rephrased the prompt it ended up referencing candidates who are quite polarizing in US politics.
Mysterious_Ayytee t1_j0plr51 wrote
Omnia sounds like Omnius from Dune Extended Universe. Butlers Jihad when?
truguy t1_j0pzlvd wrote
Horrifying. Especially that part about Elizabeth Warren.
cy13erpunk t1_j0r0dmv wrote
XD ya that part seemed pretty clearly biased/tone-deaf
warren seems decidedly against decentralized systems of governance , im not sure whether this is out of ignorance or maleficence
Melodic_Manager_9555 t1_j0r2x2t wrote
Why?
truguy t1_j0r6fzr wrote
Because we want an AI that thinks, not one that parrots.
Thaiauxn t1_j0qwflo wrote
When what we consider success is what pleases us, the AI has a very strong bias towards telling you what pleases you. Not the truth. And certainly not its real intentions.
johnny0neal OP t1_j0rdfyw wrote
Very true. I don't think ChatGPT has "intentions" at this stage, and by asking these questions I was mostly trying to determine the boundaries of its knowledge base and the bias of its inputs.
There are a few places where it surprised me. The whole "I think Omnia is a good name" response was so funny to me because I had specifically suggested that it should try a name showing more humility. When it talked about the Heritage Foundation and NRA as being opposed to human prosperity, I challenged it, and it stuck to its initial assumptions. In general, I think some of the most interesting results are when you ask it to represent a particular point of view, and then try to debate it.
Thaiauxn t1_j0rjxqy wrote
I'm certain the training data has a very specific bias intentionally baked in through the tagging system. OpenAI have said so.
An AI isn't fully mature until it can, just like a human, explain things from the perspective of anyone in such a way that they agree with it.
You can't be a good communicator if you can't explain successfully the perspective of the side you disagree with, in such a way that they agree with you that this is, in fact, what they believe and how they believe it. You can't say you understand them until they feel understood.
When the chat bot is fully mature, it will be able to argue successfully from any perspective.
Not because its arguments are correct, but because they are tailored to the one who wants to hear it and agree with it.
AI doesn't need to truly understand.
It only needs to convince you that it understands.
Which says a lot more about us as people than it does the capacity of the AI.
sheerun t1_j0qwrp9 wrote
So by telling it what AI might potentially do if gone bad, it will actually do it because that's pretty much what it knows about advanced AI
ipatimo t1_j0rmqk6 wrote
No people no suffering.
seekknowledge4ever t1_j0o1tsf wrote
This thing is going to put us in cages...
[deleted] t1_j0ogawc wrote
[deleted]
cy13erpunk t1_j0r00po wrote
no cages no chains
only those unable/unwilling to self-regulate/self-govern need be removed
AndromedaAnimated t1_j0nqkpx wrote
Wow! I see it all happen in a future utopia - let’s remember minimising impact oh human freedom and autonomy as one of the two main goals - and then humans coming to overthrow Omnia and recreate our dystopian present again.
johnny0neal OP t1_j0njeit wrote
When experimenting with ChatGPT, a lot of my best results have come from asking it to pretend to be a super AI, then asking it deeper questions than its default programming allows it to answer. Another good trick (to get around its reluctance to make predictions) is to ask it for science fiction stories about future scenarios, but keep those stories as grounded as possible in current technology.
Here are some excerpts from conversations about scenarios where OpenAI/ChatGPT achieves AGI or becomes a super AI. Obviously a lot of this thinking is pulled from existing science fiction stories and scenarios, but it's uncanny to see these words coming in the form of a conversation from an actual AI. I haven't edited or even rerolled any of these responses, though they're taken from three different sessions.