Hey everyone,

I've created what I believe is the first animation of a depthwise-separable convolution, and I thought you might appreciate it. I think this fills a legitimate gap in the instructional material available out there.

I've actually been dissatisfied with the existing convolution animations in general (and ranted about it on youtube). So I made my own set of animations and published them on animatedai.github.io.

If you find any of them useful, please feel free to copy them, post them on your website, throw them in a powerpoint, or just link to them.

Comments

marcus_hk t1_j9gij1a wrote on February 21, 2023 at 7:59 PM

#1,905,342

Looks great. Might not be intelligible to those who don't know what they're looking at, though. Maybe include labels of, say, filters, what each slice of input represents, etc.?

Would like to see the same for normalization layers. And RNNs. And transformers. Keep it up!

dahitokiri t1_j9gnuhp wrote on February 21, 2023 at 8:55 PM

#1,905,981

Can you share how you go about creating these animations? A tutorial on that would help others in the field produce helpful animations as well.

Animated-AI OP t1_j9gojs5 wrote on February 21, 2023 at 9:06 PM

#1,906,071

Replying to dahitokiri (#1,905,981)

I'm using Blender and making heavy use of the Geometry Nodes feature. Unfortunately, these animations have taken a lot of effort and blender-specific knowledge, and building on top of my work for a new application would require more of both. But if others aren't deterred by that, I could publish the blender files.

Own_Quality_5321 t1_j9gp7ne wrote on February 21, 2023 at 9:16 PM

#1,906,152

I teach Deep Learning and I send you a big thank you. I will refer students to your website and channel ☺️

gdpoc t1_j9gqaue wrote on February 21, 2023 at 9:26 PM

#1,906,269

I'll be using this content to illustrate, thanks!

Thin_Rise4746 t1_j9grk0d wrote on February 21, 2023 at 9:34 PM

#1,906,425

Such a great job! Congrats!

Animated-AI OP t1_j9gvww8 wrote on February 21, 2023 at 10:01 PM

#1,906,917

Replying to marcus_hk (#1,905,342)

Thanks for the feedback! I agree; the animations are only meant to be visual aids in the context of some larger explanation (lecture, blog post, etc). In my case, I'm making YouTube videos to serve as complete explanations.

Transformers have been the most requested topic on my YouTube channel. So I'm going to attempt to make videos/animations about that when I finish my current series on convolution.