I'd like to build a deep learning home server - any resources?

Submitted by The_Poor_Jew t3_z3itco in deeplearning

I'd like to build a deep learning server for about 4 RTX 4090s. I know that power spikes can cause each of them to go up to 1000W, so I would need to have a 4kW PSU. Anyone know of PSUs for 4kW? I looked some up on the internet but would like to know what this community could recommend :). Also, do you know any resources/blogs which help in building such machines?

0

Comments

You must log in or register to comment.

suflaj t1_ixlvb01 wrote

You'll probably need 2 computers or a server rack then (which also means the drastically more expensive Threadripper platform)

There is no commercial consumer PSU like that, but you can always buy 2 PSUs.

2

suflaj t1_ixlvsbg wrote

Replying to The_Poor_Jew (#648,337)

The solution for 2 power supplies refers to the 2 computers solution. For a singular 4kW power supply you'll need to go beyond consumer products, into industrial power supplies for high performance servers or supercomputers. At that point you're no longer building a PC, and I don't know how you'd handle it, sorry. IMO it's just better to build 2 machines.

2

suflaj t1_ixlwf2t wrote

Replying to The_Poor_Jew (#648,415)

You'll probably have to look hard, as a power supply needed to do this, its installation and modification for computer components is anywhere from 2-5k$ alone. Server components cost way more than PC components. Good luck.

2

incrediblediy t1_ixm8sku wrote

I think you might find more info on such a rig, if you search about building a "mining rig", it is quite the same. I have seen they have used multiple 1200 W server PSU's connected together with interface board.

> power spikes can cause each of them to go up to 1000W

:O that's quite a lot, is this for a commercial application or home project, otherwise you might be able to find 4 used 3090s with better ROI

2

liaminwales t1_ixmhyfb wrote

It may be worth talking to a specialised PC shop, you may also need to check your house electrics will support that kind of setup. You may need an electrocution to come in to do some work for you.

https://www.pugetsystems.com/labs/articles/1-7x-nvidia-geforce-rtx-4090-gpu-scaling/

Puget has some info on power use that may be of interest, that link is for 1-7 RTX 4090's scaling. They may also be worth talking to if you want some one to make your setup for you.

1