this was one of the first things I asked it, it sounds like its some flavor of recurrent layer with attention thats used as input to the followup question. their servers are timing out at the moment but I believe they call it a "context-aware mechanism" which sounds more like branding than anything conceptually new
Pondering_Moose t1_izumqxu wrote
Reply to [D] - Has Open AI said what ChatGPT's architecture is? What technique is it using to "remember" previous prompts? by 029187
this was one of the first things I asked it, it sounds like its some flavor of recurrent layer with attention thats used as input to the followup question. their servers are timing out at the moment but I believe they call it a "context-aware mechanism" which sounds more like branding than anything conceptually new