LetterRip t1_irt4luw wrote on October 10, 2022 at 8:57 PM

You might check DeepSpeed MII, Facebook AITemplate, and Google XNNPACK and see how their CPU conversions compare.

and see how those compare,

also

SEND_ALL_DOG_PICS t1_irwqg0s wrote on October 11, 2022 at 4:45 PM

I would look into Torchdynamo before those.

I thought that AITemplate can only run on GPU? But if it supports the CPU in some way, then it would be interesting to test it.

There is a CPU implementation of HIP that runs unmodified HIP code,

Seems some interesing. Thanks! Will try this