Hi ,

Despite That The Formula For Updating the parameters are correct and have revised & rewrite it many times , i’ve also revised the whole code many times.

This Error keep Showing to me :

Hi ,

Despite That The Formula For Updating the parameters are correct and have revised & rewrite it many times , i’ve also revised the whole code many times.

This Error keep Showing to me :

Welcome to the community.

First of all, can you check whether you use any hard-coded values in update_parameters_with_adam() ?

I’m afraid that you hard-coded epsilon to 1e-8, at least. A test case uses different value, of course.

1 Like

Hi Nobu ,

I appreciate your response , i haven’t actually hard coded any thing .

the problem was simply that i didn’t put round brackets around this part of the formula : "np.sqrt(s_corrected[“dW” + str(l)]) + epsilon ".

which leads to some mistakes in the ordering of the mathematical computations .

Thanks,