Viewing a single comment thread. View all comments

[deleted] t1_izvm5ob wrote

Reply to comment by patient_zer00 in [D] - Has Open AI said what ChatGPT's architecture is? What technique is it using to "remember" previous prompts? by 029187

[deleted]

−16

MaceGrim t1_izvnq8t wrote

It’s definitely some form of a Large Language Model implemented through a transformer neural network. GPT references the large language models that OpenAI previously built (GPT-3), and it’s also likely that ChatGPT is a finely-tuned and/or optimized version dedicated to chatting.

20

Duckdog2022 t1_izvtrg2 wrote

Pretty unlikely it's that simple.

6

p-morais t1_izvz91t wrote

Not “pretty unlikely”. The architecture is literally in the name: Generative Pretrained Transformer

19

5erif t1_izwnbsq wrote

Their comment was colloquially synonymous with

> I doubt it's that simple.

Your comment could just as easily have started with

> You're right, it's not that simple.

But reddit is what you might call a generative adversarial network.

9