DLS Course 2 week 2 Programming Assignment Optimization methods Exercise 6 update parameters with adam

Hi I am Suleman,
in the DLS Course 2 Week 2 Assignment Exercise 6
I got this error : AssertionError: Wrong values. Check you formulas for parameters[‘W1’]
I double checked the formulas and my implementation
Even though I am getting this error and there is little difference between the my output and expected output.
Please help me find where my code went wrong.
Thank You

Error:

Expected Output:

Welcome to the community !

First of all, please do not post your code. We usually start with a Traceback and your description.
(Please remove them, thank you.)

Please look at an equation to update W closely. \epsilon is not part of square root. :slight_smile:

2 Likes

Thank You. :slightly_smiling_face:

I have removed the code.

As given in the formulas in the Jupyter Notebook, it seemed like the ϵ is part of the square root. So I included it.

Once again Thank You.

This is probably worth noting in the course: RMS Prop will include epsilon in the square root but Adam optimization won’t. Andrew’s comments are that epsilon is added similar to RMS prop but it is slightly different

Yes
RMS prop and Adam differ, whether to include epsilon in the square root or outside it