Mondukai t1_jcy3tu4 wrote on March 20, 2023 at 1:26 PM

This might help:

https://timdettmers.com/2023/01/16/which-gpu-for-deep-learning/

Numerous_Talk7940 OP t1_jd6ksav wrote on March 22, 2023 at 5:02 AM

I am not confident comparing these charts perfectly, it 'looks like' the 4090 is superior to the 3090 (3090 because it has the same VRAM, which is an important factor as I have learned), but by how much? Does the price justify the advantages of the 4090?

GrandDemand t1_jd96065 wrote on March 22, 2023 at 6:53 PM

No. I'd get a used 3090. Save the rest of your money for when you have more experience and a better grasp of the kinds of problems you'd like to solve and the hardware needed to run the corresponding models. Then you'll realize either that your hardware is sufficient as is (with a 3090), a 4090 would actually benefit you, a card with 48GB of VRAM is essential (ie. You need either an Ada Titan if it comes out or 2x 3090s), or it's way too expensive to run on consumer hardware and just use cloud GPU instances with A100s or H100s instead. But the 3090 will be a great card for now, and a used one in great condition (sometimes even open box or with an active warranty) can be found easily on the hardwareswap subreddit for $800 or even less.

Numerous_Talk7940 OP t1_jd990x3 wrote on March 22, 2023 at 7:12 PM

I see and took a look, the 3090 ti is sometimes available for only 100 euros more (used that is). Is that something I could consider aswell?

GrandDemand t1_jd9w0n4 wrote on March 22, 2023 at 9:39 PM

Yes that's likely better actually since its a much newer card (less likely to have been mined on) just make sure you look into tuning it for efficiency as the card is designed to run at 450W (which is insane). I can't direct you to any guides for the 3090Ti specifically but I'd just google 3090Ti undervolt. The 3090 should probably also be undervolted too, you really don't need these cards to be hitting their power limits of 450W and 350W respectively, tuning them to a more reasonable 325-350W and 280-300W makes way more sense.

GrandDemand t1_jd9w67s wrote on March 22, 2023 at 9:40 PM

Although since you are in Europe, what does pricing look like roughly for used 3090s/3090Tis versus new 4090s?

Numerous_Talk7940 OP t1_jdb6dt1 wrote on March 23, 2023 at 3:15 AM

3090 900-1000, 3090ti 1200-1300 4090 new 1750, which is why I considered still a new 4090, because the price gaps between those 3 Options seem odd.

GrandDemand t1_jdbi5kd wrote on March 23, 2023 at 5:07 AM

I'd say in that case just go new 4090 unless you can get a used 3090 for half that or a used 3090Ti for a little over half. I'm surprised that the difference is that small, I guess I'm accustomed to the used market in the US which I imagine is quite a bit larger

Numerous_Talk7940 OP t1_jdbifz9 wrote on March 23, 2023 at 5:10 AM

I see, thanks for your help! The 4090 is from palit though while the used 3090/3090ti are from MSI or Gigabyte, which are more expensive in general. For my use case however, the brand should not matter. Does the advice for undervolting still hold for the 4090?