How do different neurons and layers specialize?

Hello @Sashka_Warner,

I disagree that initializing neurons with the same set of weights guarantees neurons to capture different features. Please refer to this post for why neurons can differentiate. In the post, there is another link to a post with some mathematical explanations.

Raymond

2 Likes