I need to produce estimates for these metrics. I tried the torchmetrics implementation, however they’re giving me completely wrong results (I tried FID using the same dataset as both real and fake data and it gave me an incredibly high number). Are you guys aware of other available implementations?

Comments

You must log in or register to comment.

guru_chicken t1_j9reeor wrote on February 24, 2023 at 12:42 AM

Check out sg2ada pytorch implementation on github, or Clean-FID!

Skylion007 t1_j9rxyp0 wrote on February 24, 2023 at 3:07 AM

https://github.com/GaParmar/clean-fid/ is my goto. https://github.com/mseitzer/pytorch-fid isn't bad either.

buffleswaffles t1_j9rc8aa wrote on February 24, 2023 at 12:27 AM

Try studiogan's implementation on FID

toshass t1_ja4klld wrote on February 26, 2023 at 8:14 PM

Try torch-fidelity : https://github.com/toshas/torch-fidelity

donshell t1_j9spgvp wrote on February 24, 2023 at 7:36 AM

I think you are looking for TorchMetrics: https://torchmetrics.readthedocs.io/

PHEEEEELLLLLEEEEP t1_j9wnx8o wrote on February 25, 2023 at 2:22 AM

>I tried the torchmetrics implementation, however they’re giving me completely wrong results

ats678 OP t1_ja1imvy wrote on February 26, 2023 at 3:31 AM

Same, the torchmetrics implementation is completely off