Graphics Card set up for deep learning

Submitted by boosandy t3_zgn046 in deeplearning

I bought an RTX 2060 12 gigs vram for my DL projects. But my desktop already has a GTX980. Now if I connect my 2060 along with the gtx 980, and connect my display to the 980 , will pytorch be use the whole vram of 2060 ?

Is this even a valid set up? Please help.

0

Comments

You must log in or register to comment.

Volhn t1_izhrkd8 wrote

Yes. You might have to specify which device to use though. You also can’t combine memory into one pool, but you can parallelize.

3

WhizzleTeabags t1_izhxbho wrote

Unless he gets nvlink

1

Volhn t1_izhxupy wrote

Is that confirmed to work? I’ve read mixed on same GPU connected by NVLINK.

1

WhizzleTeabags t1_izhyccl wrote

Works fine with my A5000s

1

Volhn t1_izhyjsl wrote

Cool might try that with my 2080s then. Thnx.

1

computing_professor t1_izitpwa wrote

Here is a thread where we talked about this with GeForce cards. It's not treated as a single GPU and apparently you still need to parallelize. At least that's what I was told in that thread.

1

computing_professor t1_iziungw wrote

How would a 2x A5000 system differ from a single A6000 in actual use? Are your cards treated as a single card by the software?

1

incrediblediy t1_izi6n58 wrote

>Now if I connect my 2060 along with the gtx 980, and connect my display to the 980 , will pytorch be use the whole vram of 2060 ?

Yes, I have a similar setup, RTX3090 - No display (full VRAM for training), RTX3060 - 2 Monitors

When I play games, I connect 1 monitor to RTX3090 and play on that, other monitor on RTX3060

2

boosandy OP t1_iziy5do wrote

Depending on my set up, do you think 850 watt PSU will be good enough ? My CPU is i7 6700k.

1

incrediblediy t1_izm4ey7 wrote

Looks like, GTX980 4GB = 165 W & RTX2080 6GB = 160 W, which would be 325 W. I haven't used Intel K CPUs, so I am not that familiar with power usage of that. But I think 850 W would be more than enough, if it is a proper 850 W PSU, even considering power usage by other components like motherboard, RAM, SSD etc.

You can use this to calculate power requirement https://outervision.com/power-supply-calculator

My power usage is AMD Ryzen 5600x (75 W) + RTX3060 (170W) + RTX3090 (350W) = 595 W at max, I think with other components total was 750 W ( System power budget : https://outervision.com/b/8XoZwf ).

I have a 850 W, Tier A - Deepcool PQ850M which is a Seasonic based 80+ Gold. I have power stress tested with OCCT and it was fine.

1

boosandy OP t1_izmkhg7 wrote

Oh nice set up. I have thermaltake 850w 80+ gold. Judging by your answer i think my desktop will be okay.

1