I'm a super learning noob, but is there a reason you can't substitute large amounts of VRAM with large amounts of DRAM?
I know RAM bandwidth is important, but does it make that much of a difference if I got 256GB of quad channel DRAM and only 8GB VRAM? Compared to a more typical 32GB DRAM and 24GB VRAM?
Snoo9704 t1_j9e8k2w wrote
Reply to [D] Large Language Models feasible to run on 32GB RAM / 8 GB VRAM / 24GB VRAM by head_robotics
I'm a super learning noob, but is there a reason you can't substitute large amounts of VRAM with large amounts of DRAM?
I know RAM bandwidth is important, but does it make that much of a difference if I got 256GB of quad channel DRAM and only 8GB VRAM? Compared to a more typical 32GB DRAM and 24GB VRAM?