darkbluetwilight OP t1_je99g95 wrote on March 30, 2023 at 10:32 AM

Reply to comment by machineko in [D]Suggestions on keeping Llama index cost down by darkbluetwilight

Correct, it's for personal use only. I did look into a few different options - Huggingface, Alpaca, BERT, Chinchilla, Cerebras but they all appear to have charges too (with the exception of Alpaca which was taken down). I already had openai nicely implemented in my GUI so wasn't really drawn by any of them.
Can you suggest a model that is free or cheaper than openai that I could integrate into my python gui?
On the database side I tried Mongo DB and Atlas but found these very difficult to use. Since I only need to generate the database once, Llama index was fine to use

machineko t1_jecw2v4 wrote on March 31, 2023 at 2:17 AM

Cerebras-GPT models are Apache-2.0. You should be able to use them for free. Not sure what you mean by charges. Are you referring to using the hosted APIs?

Btw, you should use the ones that are instruction fine-tuned.

darkbluetwilight OP t1_jeesol1 wrote on March 31, 2023 at 2:21 PM

Thanks, I'll give Cerebras another look. Yes, I'm using the APIs