Viewing a single comment thread. View all comments

ghostfaceschiller t1_jdenoo2 wrote

Reply to comment by BigDoooer in [N] ChatGPT plugins by Singularian2501

Here's a standalone product which is a chatbot with a memory. But look at LangChain for several ways to implement the same thing.

The basic idea is: periodically feed your conversation history to the embeddings API and save the embeddings to a local vectorstore, which is the "long-term memory". Then, any time you send a message or question to the bot, first send that message to embeddings API (super cheap and fast), run a local comparison, and prepend any relevant contextual info ("memories") to your prompt as it gets sent to the bot.

14

xt-89 t1_jdessgl wrote

This also opens the door to a lot of complex algorithms for retrieving the correct memories

7