Are skip connections necessary in big networks because of regularization driving down the values of W which prevent them from learning the identity function. If this wasnt done skip connections wouldn’t be needed right?

Here there is one recent post about this subject: [image] Residual layers explained Convolutional Neural Networks Hi! I’m wondering what is the point of the residual layers. If a[l] is equal to a[l+2] then what is the purpose of those layers? Why not just connect the out…

Hey, Thanks for the reply. My question is about a more specific instance though and I didn’t find anything that discusses this. Introducing the regularization parameter to prevent overfitting drives down values of W. This means W[l] can only take values like epsilon*w[l]. So even if it learns iden…

Why skip connections are necessary?

Course Q&A Deep Learning Specialization Convolutional Neural Networks

gent.spah May 10, 2023, 4:12pm 2

Here there is one recent post about this subject:

And I am sure there are plenty that discuss this issue if you search about it.

Topic		Replies	Views
Sense of ResNet Convolutional Neural Networks coursera-platform	1	499	May 16, 2023
Question about residual blocks and skipped connections Convolutional Neural Networks coursera-platform	6	607	December 5, 2022
RESNET Explanation Convolutional Neural Networks coursera-platform	1	494	August 26, 2022
Quiz week 2, question Q5 Convolutional Neural Networks coursera-platform	2	538	November 7, 2021
Res nets for other tasks? Convolutional Neural Networks coursera-platform	1	545	April 21, 2021

Why skip connections are necessary?

Related topics