Viewing a single comment thread. View all comments

maizeq t1_j162xtk wrote

Reply to comment by limapedro in [D] Running large language models on a home PC? by Zondartul

How is the tooling and performance for the A770 on machine learning workloads? Do you have any experience with it?

1

limapedro t1_j175nby wrote

No, I haven't! Although in theory it should be really good, you could still run Deep Learninig using Directml, but a native implemenation should be really fast because of its XMX cores, they're similar to Tensor Cores.

1

wywywywy t1_j18a6g2 wrote

I haven't tried it myself but Intel has their own dist of Python and they also have their own Pytorch extension. They seem to be quite usable from looking at some of the github comments.

1