calv420 t1_j15ytb1 wrote on December 21, 2022 at 10:26 PM Reply to comment by gBoostedMachinations in [D] Running large language models on a home PC? by Zondartul Don't see why you're getting down voted, inference requires significantly less compute vs training. Permalink Parent 5
calv420 t1_j15ytb1 wrote
Reply to comment by gBoostedMachinations in [D] Running large language models on a home PC? by Zondartul
Don't see why you're getting down voted, inference requires significantly less compute vs training.