Necessary_Ad_9800 t1_jc1j36g wrote on March 13, 2023 at 11:04 AM

Reply to comment by MorallyDeplorable in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692

Where can I see stuff generated from this model?

MorallyDeplorable t1_jc1umt7 wrote on March 13, 2023 at 1:03 PM

I'm not actually sure. I've just been chatting with people in an unrelated Discord's off topic channel about it.

I'd post some of what I've got from it but I have no idea what I'm doing with it and don't think what I'm getting would be decently representative of what it can actually do.