Viewing a single comment thread. View all comments

IntelArtiGen t1_jcyqmdu wrote

Do you use another kind of normalization? You can try InstanceNorm / LayerNorm if you can't use batchnorm.

5

Blutorangensaft OP t1_jcywm46 wrote

I don't. I have heard of using layer norm for RNNs, but I am unfamiliar with instance norm. Will look into it, thank you.

1