Submitted by bjergerk1ng t3_11542tv in MachineLearning
Phoneaccount25732 t1_j90eyfv wrote
Reply to comment by currentscurrents in [D] Formalising information flow in NN by bjergerk1ng
This is my preferred interpretation of RESNETs too.
currentscurrents t1_j90hs2i wrote
Yeah, the skip connections allow higher layers to have access to information from lower layers. Same thing goes for U-Nets; they're basically an autoencoder with skip connections.
Viewing a single comment thread. View all comments