Week 1 - Programming assignment - BatchNorm

Course Q&A Deep Learning Specialization Convolutional Neural Networks
1

Hi,

During the 2nd programming assignment of week 1, we get the following network:

image
image1152×690 39.4 KB

I don’t understand why we have 128 parameters for the batch norm layer. I know that a batch norm layer has only two trainable parameres.

Thank you!

2

Hi @Mihail-Iulian_Plesa,

Check out tensorflow’s doc page which said “for each channel”.

image
image892×284 34.3 KB

This should be a good hint for you to work out the number of parameters in a batch norm layer. Don’t forget that you can put aside the assignment, experiment the layer with different settings and input data shape.

Raymond

3

Oh, I see. Thank you!!