How To Visualize Batch Norm for Better Understanding

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun
1

Hello Gentlemen,

Is there a way to visualize the impact of batch normalization on a neural network?
A sort of simulation.

I understand from the course that it is about normalizing the input features using the mean and variance so that all input features to the subsequent layers are at the same scale as to minimize “drifting/shifting”.

Thanks for your help.
Nazih

2

Hi nfattal,

It depends on what you are looking for. Maybe this blog post can get you started, or this one. A more complex approach can be found here.
I hope this gives you some idea.

3

Thank you, @reinoudbosch.
The purpose is to have a sort of better/deeper understanding of it and its impact/benefit.

The material referenced are helpful.
Thanks again.

Regards
Nazih