Sacrebleu = 0 (BLEU) score: Ungraded Lab

Both Part 1 step 5 and part 2. my sacrebleu scores are 0.0. I multiplied by 100 still 0.0 after rounding. I guess that it is not calculating anything. while the text of the lab states that our score is similar to sacrebleu score. I can’t figure out what is wrong with that

4 Likes

You need to modify the usage of sacreblue.corpus_bleu in the notebook.
The first parameter should be a list of strings, and the second parameter should be a list of list of strings, such as: sacrebleu.corpus_bleu([candidate_2], [[reference]])

4 Likes

got it run correctly now. Thank you Yang!