Score for passing is right but grader wont let me pass

Hello there,

I’m having problems when I upload the model. In the colab notebook, I’ve achieved the score to pass the assignment (" Grade is 85.17609694976174. You passed! "), but when grading the model in the submission, it returns a score of 0/100 and I failed the submission. (And yeah I try submit multiple times and even train the model multiple times, still without passing the assignment)

How should I solve it?

Thank you.

@jaroslav, you should be able to click on the submission results to expand it to get more detail about what is causing the error. What is the more detailed error message?

The error message: There was a problem grading your submission. Check stderr for more details.

And also I use x = tf.keras.layers.LeakyReLU()(x) in the Exercise 1, instead of tf.keras.layers.Activation(tf.keras.layers.LeakyReLU()(x)), because I read that this might be the bug that’s causing the issue., since grader is currently not recognizing this line as valid. But it did not help me either.

Hmm. Well, that’s not a very helpful error message. If you want to DM me a copy of your ipynb, I can take a look and see if I notice anything.

In case anyone else runs into this issue - the problem turned out to be due to adding a pip import to import a loss function. Since the grader hadn’t imported this file, it didn’t have the loss function loaded and failed when trying to run the model.h5.

Moral of the story is - don’t import anything new in the code you add. Just use what is imported by the provided code.

1 Like

@Wendy I have now the same problem. The colab gives me


Grade is 82.09254743105818
You passed!

But the grader doesn’t let me pass.

Output:

iou score

There was a problem grading your submission. Check stderr for more details.

You mentioned:

In case anyone else runs into this issue - the problem turned out to be due to adding a pip import to import a loss function. Since the grader hadn’t imported this file, it didn’t have the loss function loaded and failed when trying to run the model.h5.

, maybe I do not catch your point, however, I have not imported anything via “pip” so far.

Please help.

In Jaroslav’s case, they’d pip-installed a special loss function, but it sounds like you’re running into a different problem.

The “Check stderr for more details.” typically means something happened that the grader hadn’t anticipated, which makes it very hard to guess what’s wrong. If you’re out of ideas, feel free to dm me a copy of your .ipynb and I’d be happy to take a look to see if I notice what looks off.

I think we had this issue before here in the forum, the issue was choosing the wrong loss and optimizer, also sometimes the output layer of the model especially if the activation function is not right.

2 Likes

YES, I passed under the hood of your comment :arrow_up:

Just my feedback here:

  1. The definitions of loss and optimizer. It is too rigid to allow us to choose other losses and optimizers, although the others work also very well to complete the assignment.

  2. There is a bug in the pre-defined codes, I am not sure whether this is humanly intentional to let us be confused (my feedback is not cool), or really a mistake.

Thank you!

cc @Wendy

1 Like

@gent.spah, thanks for catching this!

@Chris.X, we can pass on this info to help improve the grader. I’m not sure I understood your point #2, though. Can you explain further what the bug is with the pre-defined codes?

1 Like

@Wendy I will cc you via DM.

I have the same problem. Tried a lot of things but still amd stuck. Have no idea how to move forward. In the discussion forums I see that loads of people face the same issue. I also have not done additional installs. Maybe the notebook or guidance to should be carefully checked and updated in order to continue to prevent this from happening. I am still looking forward to get proper support on this issue (could not find it on Coursera)

Yeah, i think it has to do with choice of loss and optimizer, it is left a bit vague.

Maybe a good word is too vague :slight_smile:

Well, one is supposed to use his judgement too​:grin:

Hi everyone! In Sacha’s case, the problem was an incompatibility with the grader. If you’re going to use a loss, please use this syntax:

loss='<loss string name>'

instead of:

loss=tf.keras.losses.<StringCassName>

The latter approach has an axis parameter that the grader does not recognize. We will be updating the grader to accommodate both declarations but in the meantime, please use the first approach. Thank you!

1 Like

Hi Chris, I used the loss with the syntax you mentioned but I am still facing this same error: “There was a problem grading your submission. Check stderr for more details.” How do I know what I need to fix in my code?

Hi there,

Did you read the entire post maybe there is guidance somewhere in the post! Also what does the error say?

yes I read the entire post, I haven’t pip installed any libraries and I used the loss string name. This is the error message I get when submitting, there are no details:
Screen Shot 2021-12-01 at 9.21.28 AM

Do you get a passing grade in the assignment? Does everything pass on the colab assignment?