Debugging gradients after failed gradient check

In the gradient_checking assignment(W1A3), the gradient dW2 and db1 were shown as gradients having error. How to find the gradients that has error after knowing that the gradient check fails.

It’s a logical question, but unfortunately the failure of the gradient check doesn’t really give you any guidance on what the actual nature of the bug is. Maybe the most you get is a hint about whether it is a subtle error or a really fundamental error, based on whether you are just a bit above the \epsilon threshold or whether your “check” value is significantly larger than \epsilon. You just have to look carefully at the code.

1 Like

Thank you for the response.