[R] [N] Dropout Reduces Underfitting - Liu et al.Submitted by radi-cho t3_11izjc1 in MachineLearning
jobeta t1_jb1otw2 wrote
Neat! What's early s.d. in the tables in the github repo?
alterframe t1_jb1txte wrote
Early stochastic depth. That's where you take a ResNet and randomly drop residual connections so that the effective depth of the network randomly changes.
WandererXZZ t1_jb3wyfc wrote
It's actually, for every layer in the ResNet, dropping everything else except residual connections with a probability p. See this paper Deep Network with Stochastic Depth
alterframe t1_jb4nwrt wrote
Yes, I worded it badly.
Viewing a single comment thread. View all comments