“L2_Filmed.ipynb” > Cell 46 > Lines 38 to 41
The following assistant chain is defined in the evaluate_refusal function:
assistant = assistant_chain(human_template,
system_message,
llm,
output_parser)
The human template and system messages parameters are swapped, and this wrongfully causes the “test_refusal_rome” test to fail in CircleCI, not matching what was being shown in the video.
Only managed to spot this because the prompts printed on the failed test log and exception were not making much sense.
Here is the correct definition that results in all 3 tests passing like shown in the video:
assistant = assistant_chain(system_message,
human_template,
llm,
output_parser)