thecodethinker t1_j3pichs wrote on January 10, 2023 at 4:14 AM

Attention is still pretty confusing for me. I find diffusion much more intuitive fwiw.

DigThatData t1_j3v2gjs wrote on January 11, 2023 at 6:40 AM

attention is essentially a dynamically weighted cross-product. if you haven't already seen this blog post, it's one of the more popular explanations: https://jalammar.github.io/illustrated-transformer/

I have an earlier blog post which is intended precisely to build intuition about diffusion :) https://benanne.github.io/2022/01/31/diffusion.html

i think you read that comment backwards :)