I'd like to build a deep learning home server - any resources?

Submitted by The_Poor_Jew t3_z3itco in deeplearning

I'd like to build a deep learning server for about 4 RTX 4090s. I know that power spikes can cause each of them to go up to 1000W, so I would need to have a 4kW PSU. Anyone know of PSUs for 4kW? I looked some up on the internet but would like to know what this community could recommend :). Also, do you know any resources/blogs which help in building such machines?

0

Comments

You must log in or register to comment.

suflaj t1_ixlvb01 wrote

You'll probably need 2 computers or a server rack then (which also means the drastically more expensive Threadripper platform)

There is no commercial consumer PSU like that, but you can always buy 2 PSUs.

2

The_Poor_Jew OP t1_ixlvdok wrote

I've read that 2 PSUs is not recommended. What do you think?

1

suflaj t1_ixlvsbg wrote

The solution for 2 power supplies refers to the 2 computers solution. For a singular 4kW power supply you'll need to go beyond consumer products, into industrial power supplies for high performance servers or supercomputers. At that point you're no longer building a PC, and I don't know how you'd handle it, sorry. IMO it's just better to build 2 machines.

2

The_Poor_Jew OP t1_ixlw06g wrote

Ah okay, thanks for the input. Yes, my goal is to build a $10-15k server, so looking if someone knows here how to buikd such machines

1

suflaj t1_ixlwf2t wrote

You'll probably have to look hard, as a power supply needed to do this, its installation and modification for computer components is anywhere from 2-5k$ alone. Server components cost way more than PC components. Good luck.

2

incrediblediy t1_ixm8sku wrote

I think you might find more info on such a rig, if you search about building a "mining rig", it is quite the same. I have seen they have used multiple 1200 W server PSU's connected together with interface board.

> power spikes can cause each of them to go up to 1000W

:O that's quite a lot, is this for a commercial application or home project, otherwise you might be able to find 4 used 3090s with better ROI

2

The_Poor_Jew OP t1_ixm9jj8 wrote

Thanks for your input. Yes, it's a home project, but I'd possibly start using it for commercial in the future. Otherwise why do you think 3090s would give me a better ROI?

1

liaminwales t1_ixmhyfb wrote

It may be worth talking to a specialised PC shop, you may also need to check your house electrics will support that kind of setup. You may need an electrocution to come in to do some work for you.

https://www.pugetsystems.com/labs/articles/1-7x-nvidia-geforce-rtx-4090-gpu-scaling/

Puget has some info on power use that may be of interest, that link is for 1-7 RTX 4090's scaling. They may also be worth talking to if you want some one to make your setup for you.

1