Viewing a single comment thread. View all comments

carlthome t1_iv0gzvw wrote

Interesting to mention layer normalisation over batch normalisation. I thought the latter was "the thing" and that layernorm, groupnorm, instancenorm etc. were follow-ups.

12

acertainmoment t1_iv1ddh0 wrote

yup, same thoughts. BatchNorm was the OG norm. The cousins came later

3