Rockingtits t1_j9afl0a wrote on February 20, 2023 at 2:15 PM Reply to [D] Large Language Models feasible to run on 32GB RAM / 8 GB VRAM / 24GB VRAM by head_robotics Why not look into distilled models like DistilBERT Permalink 2
Rockingtits t1_j9afl0a wrote
Reply to [D] Large Language Models feasible to run on 32GB RAM / 8 GB VRAM / 24GB VRAM by head_robotics
Why not look into distilled models like DistilBERT