👋 Hey all, we just launched ChatLLaMA. An experimental chatbot interface for interacting with variants of Facebook's LLaMa. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early version isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's OpenAssistant dataset and more as we explore what this model is capable of.

If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss here: https://github.com/basetenlabs/alpaca-7b-truss

We'd love to hear any feedback you have!

Comments

Viacheslav_Varenia t1_jd91mou wrote on March 22, 2023 at 6:25 PM

My first impressions.

Chatllama gives an accurate answer based on data later than 2021. And that's its advantage over chatGPT.
If you ask a general clarifying question, Chatllama loses the context and gives an irrelevant answer.

imgonnarelph OP t1_jd9m0pg wrote on March 22, 2023 at 8:34 PM

Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting fresh with each prompt. We have some ideas for how to improve this though... more soon :)

Viacheslav_Varenia t1_jd8ytxg wrote on March 22, 2023 at 6:08 PM

Great job. Been waiting a long time for someone to be able to deploy this model for testing. I'll give it a try now. I will watch for updates. Thanks.

APUsilicon t1_jdaui8z wrote on March 23, 2023 at 1:43 AM

can we run this locally?

BreadSugar t1_jdbqq4d wrote on March 23, 2023 at 6:57 AM

I love these chatbots especially for their cute portraits. lol

KingsmanVince t1_jdazrlk wrote on March 23, 2023 at 2:22 AM

Impressive, (required a bit human prompt changes tho) the small model got similar answer as the big model.

Alpaca 7b

oasst-sft-1-pythia-12b

big_ol_tender t1_jdct16f wrote on March 23, 2023 at 2:04 PM

I’d love to try this out but isn’t there an issue with licensing? OpenAI said you can’t use their model output to train competitors to chatgpt (which is total BS) and the alpaca dataset is all davinci output. I’m desperately trying to find some open source alternative that I can use for some experiments at work because I don’t want to give closedai any $.

Difficult_Bid_9828 t1_jddys16 wrote on March 23, 2023 at 6:32 PM

I think this might be exactly what you're looking for https://github.com/declare-lab/flan-alpaca

big_ol_tender t1_jdefnc7 wrote on March 23, 2023 at 8:19 PM

thanks for this- very cool project, this indeed solves the issue with LLama weights but nfortunately the issue remains with the alpaca dataset license itself being non commercial:
https://github.com/tatsu-lab/stanford_alpaca/blob/main/DATA_LICENSE

Electric-Gecko t1_je8rtly wrote on March 30, 2023 at 6:22 AM

I am not a programmer, though I have managed to compile programs on Linux before. Is there any way for me to contribute to this without programming knowledge, or detailed knowledge on the working of this software. It's based on reinforcement learning, right? Will I be able to train it?