Viewing a single comment thread. View all comments

Board_Stock t1_jczmxht wrote

Hello, I've been running the alpaca.cpp on my laptop, and have you figured out how to make it remember conversations yet? sorry if this is a beginner question

1

j-solorzano t1_jd16nfb wrote

Language models don't remember conversations by themselves. You'd have to implement a memory and then add retrieved memories to the prompt.

1

Board_Stock t1_jd1z78z wrote

Yes that's what I meant, I want run the alpaca.cpp in an api like way so that it will automatically enter the previous convo along with the new message in the prompt

1