Viewing a single comment thread. View all comments

BigDoooer t1_jdele0p wrote

Reply to comment by ghostfaceschiller in [N] ChatGPT plugins by Singularian2501

I’m not familiar with these. Can you give the name/location if one to check out?

2

ghostfaceschiller t1_jdenoo2 wrote

Here's a standalone product which is a chatbot with a memory. But look at LangChain for several ways to implement the same thing.

The basic idea is: periodically feed your conversation history to the embeddings API and save the embeddings to a local vectorstore, which is the "long-term memory". Then, any time you send a message or question to the bot, first send that message to embeddings API (super cheap and fast), run a local comparison, and prepend any relevant contextual info ("memories") to your prompt as it gets sent to the bot.

14

xt-89 t1_jdessgl wrote

This also opens the door to a lot of complex algorithms for retrieving the correct memories

7