Viewing a single comment thread. View all comments

machineko t1_jecvhyt wrote on March 31, 2023 at 2:12 AM

Reply to comment by Evening_Ad6637 in [D] Training a 65b LLaMA model by Business-Lead2679

16gb of RAM is not enough for even the smallest LLaMA 7b model. You can try doing LoRA with int8 listed above. Did you try the python script I linked above?