Learner Error: Grader timed out - Pls help

I finished coding of the assignment in the notebook. It ran and everything looked fine. It properly stopped training when accuracy reached 93%. But then I got the following error when submitting the assignment. in ’ Introduction to Generative AI for Software Development’.
@DeepLearning.AI @DeepLearning.AI-Team Can u help me with this issue? After days of hard work, it’s so frustrating to get such errors.

This is the error
" There was an error grading one or more parts of your submission. Please review the messages below for suggestions.

shortest_path function

Filename: shortest_path function

0/25Score: 0 of 25

Grading failed

  • Learner Error: Grader timed out

Please try optimizing the efficiency of your solution and submit again. You can also visit the discussion forum to see if your peers have experienced and found resolutions for similar errors, or if course staff have provided prior guidance for these errors.. If the error isn’t resolved in 24 hours, please reach out to Coursera through our Help Center."

@chris.favila Can you please tag the correct people to help me

Hi @rishyab123!

Does your solution pass the unittests? In any case, could you please share with me, privately, your solution, so I can have a look on what is going on?

Thanks
Lucas

Yes it passes & I can share with you as well.
Please share your email id.

@rishyab123, you can contact any forum member directly by clicking on their name, this will cause a pop-up to appear, then click on the “Message” button.

In my experience when you work with the LLM you need to feed it all the requirements for the exercises provided on the Labs, including the function descriptions, and ask it to abide by the time limits.

I had the exact same problem on the tsp_small_graph function. All of my unit tests passed but the grader timed out with the same error message. Initially the grader acknowledged there was a problem with its systems and that someone would look into the issue, and that I should resubmit later. Has this been resolved yet?

What error are you getting from the grader?

First it says “Grading Failed” and then gives the following explanation:

  • Learner Error: Grader timed out

Please try optimizing the efficiency of your solution and submit again. You can also visit the discussion forum to see if your peers have experienced and found resolutions for similar errors, or if course staff have provided prior guidance for these errors.. If the error isn’t resolved in 24 hours, please reach out to Coursera through our Help Center.

It also gives this info if you click on the “i”:
Please try again after some time while we look at resolving this issue!

It is highly probable that your LLM generated solution doesnt fulfil the reuirements, so I would suggest:

Try to feed more information to the LLM also feed in the feedback of where its failing and ask to provide a more efficient solution!

Hi
I am also facing the same error.
Unittests, submission_checker and shorttest_path passed without errors but other 3 small, medium and large are taking forever to grade. Finally, after around 15 minutes I see the below error:

  • Learner Error: Grader timed out

Please try optimizing the efficiency of your solution and submit again. You can also visit the discussion forum to see if your peers have experienced and found resolutions for similar errors, or if course staff have provided prior guidance for these errors.. If the error isn’t resolved in 24 hours, please reach out to Coursera through our Help Center.

Please suggest. Thanks

Hi,

The timeout suggests your code may need optimization for the small, medium, and large graph tests. Have you confirmed that all unit tests pass individually?

In my experience, these three tasks are time-intensive by design - they require iterative work with an LLM to debug and refine your code. Following the structured prompting guidelines from the course is important, but it does take significant time and patience. You might also want to review the prompting guidelines for different LLMs to understand usage limits and plan your conversations accordingly.

When you feel stuck because the LLM keeps giving similar suggestions, provide more context and make sure you understand each code modification it proposes. Ask questions about why it’s suggesting specific changes so you can better guide the conversation.

This part of the assignment is designed to be challenging, and learning to persist and pivot strategies when initial solutions fail is part of the process.

Regards,
Sharon

I am experiencing the same issue. Several of my colleagues have also reported encountering it and are considering withdrawing from the course, as the grader problem is consuming a significant amount of their valuable time. This situation is both confusing and frustrating.

@lucas.coutinho

@Community-Team

Can this issue be investigated?

Hello, yes this error is usually thrown when your solution is not as efficient as needed to solve that problem.

There are many learners here that have surpassed this error by trying a different solution(s).

According to my experience these things need to be kept in mind and I have mentioned these in similar posts:

  1. Feed the LLM all of the exercise’s script, functions and class definitions and efficiency and time requirements. The LLM at this point will provide an appropriate solution. If that solution is still timing out it means its not good enough. Go back to the LLM and tell it so, and this is also part of the LLM collaboration.
  2. Sometimes it happens that the class definitions and structure of the code produced by the LLM is not as exactly right as the one defined on the Labs, therefore you might need to adjust the code a little bit, use your understanding here.

If you still having issues after that, I can have a look at your solution in a private message. But many such time outs have been solved using this approach, you can check this page of the forum.

I second this. When I took the course, I also had several occasions where I felt I wouldn’t be able to pass the grader. However, with many attempts involving slight tweaks and improvements, I was able to successfully pass. If the intent was to get quick, throwaway answers suggested by LLMs to satisfy the grading criteria, I feel it wouldn’t have made students put their minds into it and truly understand the intricacies of the problem, solution scoping, and debugging. These assignments more often force you to consider those things. However, I wouldn’t completely disregard and blame all the problems students face from the grader on the above. But, I believe that almost always tends to be the case.

Hi!

Thanks for your feedback and I’m sorry you are facing such trouble with this assignment. Would you be able to provide your notebook solution via DM, so I can investigate it further and improve the autograder?

Thanks in advance,

Lucas

I am receiving the following error as well, on all exercises in Module 1 except for Exercise 9. I am taking the “Design, Develop, and Deploy Multi-Agent Systems with CrewAI” class through Coursera. The program runs fine, and I am not receiving any errors. I am not receiving any errors from the checker. The output meets the requirements. Please help. I am new to Python and CrewAi. It’s frustrating that I cannot get a passing grade from the grader, but the output seems to be exactly what’s required.

This is not the right place to post!

If this course is part of DLAI courses you should post on the relevant section for - Design, Develop, and Deploy Multi-Agent Systems with CrewAI, and mentors of that course might pick this up but not in this space.