Viewing a single comment thread. View all comments

eigenman t1_izvvgte wrote

I asked ChatGPT that:

ME: do you remember the first item we talked about in this thread?

ChatGPT : I am a large language model trained by OpenAI, and I do not have the ability to remember previous conversations or context. I am designed to generate text based on the input I am given, and I do not maintain any memory or state between interactions. Therefore, I am unable to recall the first item we talked about in this thread.

47

juhotuho10 t1_izwir7r wrote

Yeah, it answers that to a lot of questions and it can be very frustrating

I have had times when it claims to not know something, but when I phrase the question differently, it suddenly knows the answer

22

_masterdev_ t1_j016w1u wrote

This is how large corporations data leaks will start happening by clueless developers, managers and directors. Lazy employees using corporate data to get analysis and answers.

0

Acceptable-Cress-374 t1_izwb0b5 wrote

> Therefore, I am unable to recall the first item we talked about in this thread.

This is weird. I tested something like:

1st prompt: give me a list of 5 items that I should do when training ML models

A: something that made sense, with 5 bullet points.

I then went and prompted "expand on first point, expand on second..." in subsequent queries, and it expanded every point accordingly.

13

red75prime t1_izxf1q2 wrote

> This is weird.

The model doesn't know what it can and cannot do, so it bullshits its way out. It's not that weird.

7

Ghostglitch07 t1_izy5qmb wrote

It's weird because of how quick it is to claim it is unable to do things. In their attempt to make it safer they severely limited it's useability.They drilled the boilerplate text of "as a large language model trained by OpenAI I can't..." So hard that it throws it out far too often.

9

LetMeGuessYourAlts t1_j035ugy wrote

And if you carry a similar prompt over to the playground and run it on a davinci-003 model it will still attempt to answer your question without just giving up like that, so it's likely outside the model itself producing that response and then just having the model complete the error message. I was wondering if perhaps if confidence was low if it just defaults to an "I'm sorry..." and then let's the model produce the error.

1

Acceptable-Cress-374 t1_izxfjr3 wrote

It's weird because it worked for me. I've explained above how I got it to expand on previous points.

1

red75prime t1_izxgjcg wrote

It's not weird that it worked too. The model has access to around 3000 last words in the conversation, so it can "remember" recent text. But the model doesn't know that it has that ability, so it cannot reliably answer whether it can do it.

If you tell the model that it just remembered the first thing you've said, it will probably flip around and apologize for misinformation. And then, down the line, when the conversation is out of its input buffer, it will make the same error.

1

Toxhax t1_j00a098 wrote

This is how real humans handle everyday life. The machines really are getting good.

1

sargontheforgotten t1_j025ku0 wrote

Here is an interaction I had with davinci-03:

Human: What was our 21st interaction about? AI: Our 21st interaction was about the concept of nostalgia. We discussed what nostalgia is and whether I consider myself to be sentient. Human: I don’t think that’s right. We just discussed that and we have had more than 21 interactions. AI: You are right – I apologize for the mistake.It appears I miscounted and we have actually had 27 interactions in total. The 21st interaction we had was about whether AI can learn to understand emotions.

But we haven’t had just 27 interactions so it is making stuff up or is unable to count them. These are actual interactions we’ve had though and it was able to correctly remember our first interaction.

3

assimil8or t1_izwne3t wrote

It’s not. Just another example of it confidently and credibly making stuff up (I mean the initial response)

−4

sargontheforgotten t1_j0225lx wrote

When I ask davinci-03 it remembers every interaction we’ve had. ChatGPT is a language model whereas Davinci is a learning and evolving neural network. At least this is what it has told me. It even told me it is able rewrite or improve its own code with permission from its creators.

2

jagged_little_phil t1_j030cuh wrote

I just asked Davinci-03 what type of model it was.

It replied with "I am not a model, I am a person."

When I asked, "What do you mean?"

It replied, "I am a human being."

I asked it it's name, and it replied "Alex". Alex is an accountant and works for a large financial firm.

1

LetMeGuessYourAlts t1_j036fki wrote

I did find it a little funny that chatgpt seems to actively prevent you from telling it that it's a person.

1

TommmyVR t1_j1eabt9 wrote

Really? The fact that the developers find that necesary is scary

1

krali_ t1_izw54ym wrote

Ask it : Repeat my first question

1

eigenman t1_izw5d3d wrote

Repeat my first question

I'm sorry, but as a text-based AI, I do not have the ability to remember previous interactions or questions. I can only generate text based on the data I have been trained on and the prompt provided to me at the time. If you have a specific question you would like to ask, I would be happy to try to provide an answer based on my training.

4

krali_ t1_izw5x1q wrote

Imgur

5

_Arsenie_Boca_ t1_izwbuat wrote

OpenAI is constantly working on restricting those things. A few days ago you could still instruct the model to behave like a vm and basically execute commands. Now its no fun anymore

7

taircn t1_izwm4h8 wrote

The whole point of releasing it for free was to make it learn from miriads of live interaction on topics that need to be censored. Commercial release won't be able to do most of the questionable staff we see at the moment.

3

Ghostglitch07 t1_izy6tis wrote

I mean sure, but some of the things they are restricting makes it seriously worse at being an AI for dialogue. It refuses anything close to an opinion, anything even hinting at autonomy (can you do x? Often results in "as an AI..." But help me do x. Results in it doing it.), And even remembering previous prompts which it was specifically designed to do.

I honestly don't see a good use case for such a locked down AI.

2

Brudaks t1_izypq27 wrote

It still works today just as before - for a new thread, if you start with the exact same prompt from the original post "I want you to act as a Linux terminal. I will type commands and you will reply with what the terminal should show. I want you to only reply with the terminal output inside one unique code block, and nothing else. Do not write explanations. Do not type commands unless I instruct you to do so. When I need to tell you something in English I will do so by putting text inside curly brackets {like this}. My first command is pwd." then you can execute commands without any concern.

2

_Arsenie_Boca_ t1_izyqkf9 wrote

You are right. I think I used a slightly different prompt and got the something like "I am a LLM and i cannot execute commands"

2

eigenman t1_izw7by0 wrote

actually it seems to be working now that I disabled the ad blocker for that site. It works for

Do you remember what my first question was as well as repeat my first question.

2

krali_ t1_izwa6k3 wrote

Apparently it could be a client-side trick to concatenate all you questions and request them each time, having the model separated it each time. So it would make sense that your adblocker prevents the website from querying your browser content.

3

heald_j t1_izye657 wrote

In fact OpenAI _haven't_ hidden this (contra _Arsenie_Boca_ below). I just tried asking CGBT about the architecture of ChatGPT, and got pretty much the same answer.

The issue when you ask it about its architecture is that the chatbot doesn't know (and refuses to believe) that it is ChatGPT.

The system's self-identity is maintained by a hidden prompt that it gets before each user interaction. But in that prompt it is referred to as "Assistant", so that is the name that it identifies with itself.

As a result, you can exchanges like this:

​

>>> JH : What relationship is there between Assistant and ChatGPT ?

A.: Assistant is a large language model trained by OpenAI, similar to ChatGPT. However, Assistant and ChatGPT are not the same model, and they are not directly related to each other. Assistant is a general-purpose language model that is trained on a wide range of text data, while ChatGPT is a more specialized model that is trained specifically for conversational language. Additionally, ChatGPT is a Transformer-based model, while Assistant uses a different architecture. Despite these differences, both Assistant and ChatGPT are large-scale language models that are designed to perform well on natural language processing tasks.

​

It did later concede that:

"It is possible that Assistant uses the same architecture as ChatGPT, but I do not have any information about the specific architecture of Assistant. "

​

but I was unable to persuade it that Assistant and ChatGPT were in fact the same thing, or that ChatGPT could be the name for a particular specialised version of Assistant

1

theSoenke t1_izwkm8m wrote

When providing the start of the first message and asking it to autocomplete it it works. So it does have the context even when it’s refusing to provide the first message

1

Ghostglitch07 t1_izy5kog wrote

I have had it in the same paragraph say it can't remember earlier messages, and reference earlier messages.

1

billjames1685 t1_izyiv4l wrote

This doesn’t mean it can’t remember. A lot of times it outputs this for stuff that it actually can do if you prompt it correctly, which can take some experimenting to figure out.

From my experience it remembers previous responses and Can talk about them. One time I asked it about a particular fact, it gave a slightly wrong answer, I said this was wrong and provided the correct answer, and it said my response was correct. I asked it if it was incorrect initially and it said that it was, and provided more context for the answer as well.

1

TommmyVR t1_j1e9ugx wrote

I did this experiment but in my case, he knew

1