Questions about the Residual Networks

Michael1 · June 23, 2021, 8:03am

Could I know how a skip-connection helps the gradient to backpropagate and how to calculate the skip connections in total, please?

arosacastillo · June 23, 2021, 9:17am

Hi Michael,

it is related with the vanishing gradient problem. I recommend you to read this post that explains skip connections in a very intuitive way.

Nice reading

Rosa

Topic		Replies	Views
Quiz week 2, question Q5 Convolutional Neural Networks	2	528	November 7, 2021
Res nets for other tasks? Convolutional Neural Networks	1	541	April 21, 2021
Pls elobarate on how skip connection helps gradients backpropogate Convolutional Neural Networks	1	536	July 30, 2022
Residual Connection - Exploding Gradients Convolutional Neural Networks	1	588	June 4, 2021
Skipped connection in ResNet Convolutional Neural Networks	4	516	March 28, 2024