UNQ_C5 GRADED FUNCTION: gradient_descent

Course Q&A Natural Language Processing NLP with Probabilistic Models
1

I am kind of stuck here. All the previous assignment function for this week have passed. This assignment UNQ_C5 GRADED FUNCTION: gradient_descent, just involves calling the functions that have already been tested so I am not sure where to start debugging this function when the unit tests fail.:
I get the following results on running the unit tests:
9 Tests passed
7 Tests failed
The expected values of w1, w2, b1 and b2 are not as expected in cases of failures. The difference is values are very minutely different, similar to the difference in the basic test.

Also, my outputs for the basic test are slightly off, but the note says that slight difference in numbers is expected:

image
image271×642 8.1 KB

Another thing, I wanted to mention was that to pass the back_prob unit tests I had to remove ‘relu’ from the formula given in the lecture.

Can a mentor give me some directions as to where the problem could be?

2

You should recheck all the called functions again, also you need to clip l1 for negative values of z…

3

Clipping for L1 values has already been provided in the notebook.

I should have been more clear in my statement: I had to remove relu from grad_b1 calculations to pass the unit tests. Either the lecture slides have incorrect formula for grad_b1 or the unit tests are incorrect

Below is my back_prob function:

And here is my gradient descent function.

Do you see any issues?

4

First and most important is to not post code solutions on public!!

Second in the back_prop function remove the relu calculation, its not needed there.

5

  1. Sorry about posting the code. I thought posting incorrect code was not an issue. Posting correct solutions was prohibited. I’ll take care of it in future. Are we allowed to post incorrect code?

  2. Please check the lecture slides:

    image
    image952×482 52.2 KB

I thought the step() function implied relu. if not, what does it mean?

  1. With your suggestion, I was able to pass all tests.
6

Please do not. If a mentor needs to see your code, we’ll contact you with instructions.
You can post screen capture images of any error messages or asserts. That’s usually enough to diagnose the issue.

1 Like
7

In this context the step is the l1.

8

Can you clarify more about step() function. How to create it? is it just the z1 variable?
Thanks in advance!