Submitted by MichelMED10 t3_ysah21 in MachineLearning
ThomasBudd93 t1_iw228pb wrote
Reply to comment by Meddhouib10 in [D] Timm's implementation of stochastic depth by MichelMED10
Yes there is. During training with dropout probability p you rescale you inputs with a factor 1/(1-p).
https://pytorch.org/docs/stable/generated/torch.nn.Dropout.html
Viewing a single comment thread. View all comments