Submitted by Itachi_99 t3_zp6ll4 in MachineLearning
There are several resources to understand how to make a GAN from scratch. But with Diffusion Models, the DDPM paper code and especially the Improved DDPM paper code are so hard and complicated to understand.
I'm currently doing research on Diffusion Models. I understand the math very well from the paper: "Understanding Diffusion Models: A Unified Perspective". It gives a very intuitive and step by step guide to the mathematics and intuition behind Diffusion Models. I loved the paper. But from that paper, I don't have the necessary talent or skill to reproduce the code. It's too big of a project for me to do on my own from scratch.
So, I wanted help from this community which can give me some guide on how to find articles, GitHub repos or YouTube videos which gives me step by step guide on how to build research level code on Diffusion models from scratch.
The closest I found was the annotated diffusion model from the Huggingface community but that was very basic and when I wanted to reproduce their own repo on GitHub(annotated diffusion is the name of the blog but they have their own repo on Diffusion model in Pytorch which is in research level) in Pytorch, that was too heavy for me.
Also, maybe some other guides maybe also helpful on how can I can start from scratch and build models and eventually go to a stage where I can reproduce results like in the Improved DDPM paper.
I have the hardware resources in my laboratory. But no one in my lab has done any projects on Diffusion Models. So, I'm the first one. That's why I had to find resources on my own.
It will be a big help for me if I can find some help from this community. Thank you very much in advance.
FyreMael t1_j0rdyv5 wrote
Annotated PyTorch Paper Implementations:
https://nn.labml.ai/diffusion/ddpm/index.html