C3W2_Vanishing_Gradients_Vanishing and Exploding Gradient Conditions

Hi,
I have one doubt about statements from lab file.



seems ,they are wrong.

please confirm thank you

Hi!
The explanation in the lab is correct.
As you will see in the example that the derivative of \sigma is bounded at 0.25
image.
This makes the vanishing gradient issue occur when abs(largest eigenvalue) goes lower than 1/0.25 = 4
image

Thank you

1 Like