[R] [N] Dropout Reduces Underfitting - Liu et al.Submitted by radi-cho t3_11izjc1 in MachineLearning
alterframe t1_jb1txte wrote
Reply to comment by jobeta in [R] [N] Dropout Reduces Underfitting - Liu et al. by radi-cho
Early stochastic depth. That's where you take a ResNet and randomly drop residual connections so that the effective depth of the network randomly changes.
WandererXZZ t1_jb3wyfc wrote
It's actually, for every layer in the ResNet, dropping everything else except residual connections with a probability p. See this paper Deep Network with Stochastic Depth
alterframe t1_jb4nwrt wrote
Yes, I worded it badly.
Viewing a single comment thread. View all comments