yanivbl t1_iwgjnht wrote on November 15, 2022 at 2:06 PM Reply to comment by ButterscotchLost421 in [D] How long should it take to train a diffusion model on CIFAR-10? by ButterscotchLost421 No, not Adam, I was referring to the model from the diffusion beats Gans paper. I never trained such model, just read it. But yeah it's most likely what you said (a.k.a data parallelism) Permalink Parent 2
yanivbl t1_iwgb683 wrote on November 15, 2022 at 12:51 PM Reply to [D] How long should it take to train a diffusion model on CIFAR-10? by ButterscotchLost421 They had more GPUs, training in parallel. Not sure about cifar10 but I read the number for ADM with imagenet is ~1000 days for a single V100. Permalink 4
yanivbl t1_iwgjnht wrote
Reply to comment by ButterscotchLost421 in [D] How long should it take to train a diffusion model on CIFAR-10? by ButterscotchLost421
No, not Adam, I was referring to the model from the diffusion beats Gans paper.
I never trained such model, just read it. But yeah it's most likely what you said (a.k.a data parallelism)