I am able to run code with prompt successfully. I tried some random queries as well, end to end RAG pipeline is working well. But after submitting assignment for evaluation, its showing Score 20/50.
Part-1: 10/10
Part-2: 0/10 No feedback available for this exercise.
Part-3: 10/10
Part-4: 0/10 No feedback available for this exercise.
Part-5: 0/10
Failed test case: Output of <function generate_metadata_from_query at 0x7fe465bb9630> is not a string.
Expected:
It must be a string,
but got:
Check output type of <function generate_metadata_from_query at 0x7fe465bb9630>.
I have tried changing prompts also. I am totally clueless what’s going on at the evaluation side as I dont have any logs as well.
Course link: Retrieval Augmented Generation (RAG) - DeepLearning.AI
@Rajat_Aggarwal3
this looks like your autograder got corrupt. Technical team need to look into this, they will ask you to fill out a form, and then further they will guide you
@chris.favila please have a look at this learner issue.
Regards
Dr. Deepti
Tagging @lucas.coutinho here because based on the grader feedback posted above, this looks like a course-specific issue.
Hi @Rajat_Aggarwal3!
In part 2 it looks like your function is returning None, whereas it should return a string. This might be happening due to some if/else statements within the exercise to check for the specific labels the function must output. Since Exercise 4 and 5 use this function, if one fails, the others will fail too.
Since everything run but fails in the autograder, can you send me your solution privately so I can check what is going on?
Thanks,
Lucas
@lucas.coutinho I have sent implemented methods in inbox. Please check!
opps sorry I missed the second half of feedback, sorry @chris.favila