Hello @Savitha_Suresh,
This is the key to your question. Please check this post out for more explanations, in which you will find a link to another post that shows how you can make them “overlap” (more precisely, how to make the neurons to learn the same thing). If you get the idea of making them “overlap”, then you know how initialization avoid them from “overlapped”.
Cheers,
Raymond