Justice43 t1_je7vbe7 wrote on March 30, 2023 at 1:17 AM Reply to [D] Training a 65b LLaMA model by Business-Lead2679 I recommend looking into Lambda Cloud VMs. They're much cheaper than AWS, and their largest machine (8x A100, 80GB VRAM for each A100) should be enough to finetune the 65b LLaMA model. Permalink 3
Justice43 t1_je7vbe7 wrote
Reply to [D] Training a 65b LLaMA model by Business-Lead2679
I recommend looking into Lambda Cloud VMs. They're much cheaper than AWS, and their largest machine (8x A100, 80GB VRAM for each A100) should be enough to finetune the 65b LLaMA model.