Submitted by Itachi_99 t3_zp6ll4 in MachineLearning

There are several resources to understand how to make a GAN from scratch. But with Diffusion Models, the DDPM paper code and especially the Improved DDPM paper code are so hard and complicated to understand.

I'm currently doing research on Diffusion Models. I understand the math very well from the paper: "Understanding Diffusion Models: A Unified Perspective". It gives a very intuitive and step by step guide to the mathematics and intuition behind Diffusion Models. I loved the paper. But from that paper, I don't have the necessary talent or skill to reproduce the code. It's too big of a project for me to do on my own from scratch.

So, I wanted help from this community which can give me some guide on how to find articles, GitHub repos or YouTube videos which gives me step by step guide on how to build research level code on Diffusion models from scratch.

The closest I found was the annotated diffusion model from the Huggingface community but that was very basic and when I wanted to reproduce their own repo on GitHub(annotated diffusion is the name of the blog but they have their own repo on Diffusion model in Pytorch which is in research level) in Pytorch, that was too heavy for me.

Also, maybe some other guides maybe also helpful on how can I can start from scratch and build models and eventually go to a stage where I can reproduce results like in the Improved DDPM paper.

I have the hardware resources in my laboratory. But no one in my lab has done any projects on Diffusion Models. So, I'm the first one. That's why I had to find resources on my own.

It will be a big help for me if I can find some help from this community. Thank you very much in advance.

54

Comments

You must log in or register to comment.

pilooch t1_j0tjsw7 wrote

Hello, the goto tutorial I do recommend around to colleagues and customers/researchers is the one from CVPR 2022: https://cvpr2022-tutorial-diffusion-models.github.io/ Some do skip the score-based presentations, and/or start from the applications instead. Very informative in all cases !

6

yabik t1_j0r8dxp wrote

https://www.youtube.com/watch?v=a4Yfz2FxXiY This video might be a starting point. I also look for a more updated version.

5

Itachi_99 OP t1_j0rbeey wrote

Thank you very much. I watched the video previously. But I wanted a more robust and updated video for a research level architecture and code explanation. But this is also helpful. Thank you! Kind stranger.

1

Chrex_007 t1_j0txkmh wrote

Thanks, this helped me too.

2