learn-deeply t1_j1xjm5p wrote on December 28, 2022 at 3:20 AM

This benchmark is not representative of real models, making the comparison invalid. The model has ~5,000 parameters, while the smallest resnet (18) has 10 million parameters. You're essentially just comparing the overhead of PyTorch and CUDA, which isn't saying anything about the actual performance of the different GPUs.

zveroboy152 OP t1_j1xrwio wrote on December 28, 2022 at 4:29 AM

It sounds like I have a lot to learn for PyTorch then. :-)

I'll work on re-working the script to reflect better numbers. If you have any pointers, or ideas, I'd love to hear it.

learn-deeply t1_j1yd1z6 wrote on December 28, 2022 at 8:27 AM

TorchBench (https://github.com/pytorch/benchmark) is used by PyTorch core developers to test performance across a wide variety of models. I've never used it personally though.