Hi ,
Despite That The Formula For Updating the parameters are correct and have revised & rewrite it many times , i’ve also revised the whole code many times.
This Error keep Showing to me :
Welcome to the community.
First of all, can you check whether you use any hard-coded values in update_parameters_with_adam() ?
I’m afraid that you hard-coded epsilon to 1e-8, at least. A test case uses different value, of course.
1 Like
Hi Nobu ,
I appreciate your response , i haven’t actually hard coded any thing .
the problem was simply that i didn’t put round brackets around this part of the formula : "np.sqrt(s_corrected[“dW” + str(l)]) + epsilon ".
which leads to some mistakes in the ordering of the mathematical computations .
Thanks,