Justice43 t1_je7vbe7 wrote on March 30, 2023 at 1:17 AM

I recommend looking into Lambda Cloud VMs. They're much cheaper than AWS, and their largest machine (8x A100, 80GB VRAM for each A100) should be enough to finetune the 65b LLaMA model.

Business-Lead2679 OP t1_je9erdj wrote on March 30, 2023 at 11:33 AM

Just checked it out - looks interesting. Unfortunately, the availability of this instance is quite limited, so I'm not sure if I can get access to it

nmfisher t1_jeco3nx wrote on March 31, 2023 at 1:15 AM

Someone also mentioned https://jarvislabs.ai/ to me the other day, haven't used it myself but it looks promising.