Acceptable-Cress-374 t1_izxfjr3 wrote
Reply to comment by red75prime in [D] - Has Open AI said what ChatGPT's architecture is? What technique is it using to "remember" previous prompts? by 029187
It's weird because it worked for me. I've explained above how I got it to expand on previous points.
red75prime t1_izxgjcg wrote
It's not weird that it worked too. The model has access to around 3000 last words in the conversation, so it can "remember" recent text. But the model doesn't know that it has that ability, so it cannot reliably answer whether it can do it.
If you tell the model that it just remembered the first thing you've said, it will probably flip around and apologize for misinformation. And then, down the line, when the conversation is out of its input buffer, it will make the same error.
Acceptable-Cress-374 t1_izxhst7 wrote
Ooooh, gotcha. You're saying that the answer provided to OP was not weird. I agree.
Viewing a single comment thread. View all comments