Greetings!

In my adventures of Pytorch, and supporting ML workloads in my day to day job, I wanted to continue homelabbing and buildout a compute node to run ML benchmarks and jobs on.

This brought me to the AMD MI25, and for $100 USD it was surprising what amount of horsepower, and vRAM you could get for the price. Hopefully my write up will help someone in the machine learning community.

Let me know if you have any questions or need any help with a GPU compute setup. I'd be happy to assist!

https://www.zb-c.tech/2022/11/20/amd-instinct-mi25-machine-learning-setup-on-the-cheap/

Comments

You must log in or register to comment.

gradientpenalty t1_j2u9byl wrote on January 4, 2023 at 12:02 AM

Do you have any benchmarks to share? Would be very nice if this is available

zveroboy152 OP t1_j2uuiy1 wrote on January 4, 2023 at 2:32 AM

Those are coming soon. I'm working on collecting a few sub $100 GPU's and running them through a suite of benchmarks from PyTorch's Repo:

https://github.com/pytorch/benchmark

I'll be sure to follow up and post some numbers. :-)

currentscurrents t1_j2uul25 wrote on January 4, 2023 at 2:32 AM

Interesting how that card went from $15k to $100 in the space of five years.

I'm holding out hope the A100 will do the same once it's a couple generations old.

5death2moderation t1_j2wrwrl wrote on January 4, 2023 at 2:21 PM

Tesla m40s and now p100s were 200 dollars a piece just four years after release. V100s have not depreciated as quickly though, presumably because the tensor cores keep their performance competitive. I would assume a100s will suffer the same fate of being very expensive for many years to come sadly.

SnooHesitations8849 t1_j2uwal3 wrote on January 4, 2023 at 2:45 AM

It doesnt have fans and Video output for gamer, so it went down quickly

CrashTimeV t1_j3zt9sk wrote on January 12, 2023 at 4:33 AM

Are you the person from craft computing’s discord who is running stable diffusion on his MI25?

zveroboy152 OP t1_j41idsx wrote on January 12, 2023 at 3:10 PM

I am not, but that sounds like a very cool thing to run on it. :-) (I'm a big fan of craft computing)

CrashTimeV t1_j41im7e wrote on January 12, 2023 at 3:11 PM

You should look into P100s in the future. They are coming down in price pretty fast I think you can get one for around 200$ US

zveroboy152 OP t1_j41q48e wrote on January 12, 2023 at 4:01 PM

I ordered one three days ago for $170. ;-) I hope to be doing some testing and write ups on it soon.

CrashTimeV t1_j41qigp wrote on January 12, 2023 at 4:03 PM

Let me know if you figure out gpu direct storage. I just got 2x P100s and a R730 for my ML rig later found out my ssds were not the correct ones so waiting for the new ones to arrive. Can’t wait to integrate this into my lab and workflow

zveroboy152 OP t1_j472zg8 wrote on January 13, 2023 at 4:55 PM

That sounds like a pretty sick machine! I'll check out GPU Direct Storage and see if I can get it working. :-)

SnooHesitations8849 t1_j2uw5u7 wrote on January 4, 2023 at 2:44 AM

If AMD was good at providing a good driver this would be a game changer for beginner. LoL.

zveroboy152 OP t1_j2v9h5g wrote on January 4, 2023 at 4:27 AM

The driver is a bit akward to deal with, but isn't terrible. Working inside of a docker container for GPU workloads isn't terrible either if you know your way around in containerization.

But, I do agree. NVIDIA's driver's are easier to deal with (Referencing my K80 Driver install experience: https://www.zb-c.tech/2022/12/11/how-to-install-drivers-on-ubuntu-for-the-nvidia-tesla-k80/ )

currentscurrents t1_j2uxtmv wrote on January 4, 2023 at 2:56 AM

Yeah... it's no A100, but it's on par with the high-end gamer cards of today. For much less money.

zveroboy152 OP t1_j2v9jj8 wrote on January 4, 2023 at 4:28 AM

Agreed! 16GB of HBM memory is impressive for the price. :-)

fakesoicansayshit t1_j3dd43i wrote on January 7, 2023 at 7:37 PM

Would this run on windows?

Iwishtoeatfish t1_j3rcglx wrote on January 10, 2023 at 3:32 PM

It can. You would need to flash the vbios to a wx9100. It would only have a single mini-displayport out though