Understanding RELU deeply

In addition to Paul’s excellent explanation: if you are searching for more info and additional sources: here some thread which could be interesting for you, @Ashwin_Yellore:

Happy learning and all the best
Christian