In my opinion the main problem with GANS is how unstable they are, you will spend a lot of time just to make it sure it won't output garbage. Taking only that in consideration is already enough to me to enjoy diffusion more.