C1_W2_Lab1 Exercise 7. Why does normalization change the results so much?

[balaji.ambresh]

Please try the following :

1. Define a function get_sigmoid(pixel_value, weight) where you return the sigmoid for the pixel_value * weight value.
2. Create a bunch of weights using np.linspace between 0 and 1e-5.
3. See how sigmoid varies when pixel value is 255 and 1.

This should tell you which scale of values will help speed up learning keeping backpropagation in mind.

Have you seen this?