Viewing a single comment thread. View all comments

iNstein t1_j2l04ge wrote

Reply to comment by CeFurkan in You can get used computers with 1TB RAM for around 5k - 10k UK pounds ($7k) by MrEloi

Maybe op should look at multiple 4080s running together, something like used when mining crypto? I know you can get special motherboards that are designed to allow you to have multiple cards connected, just need a honking great power supply.

3

MrEloi OP t1_j2wlzzz wrote

Good idea.

I have checked the pricing of 12gb & 24GB GPUs ... not too bad currently.

I suspect that say 5 x 24GB GPUs would come to under $10k.

Add in the special motherboard and maybe we are looking at around $15k for a complete hardware system.

With careful purchasing that could possibly come down to under $10k total.

And, yes, GPT can be run across multiple GPUS, both when training and for running.

1