PEFT Model Example

Course Q&A Generative AI with Large Language Models
1

In the 2nd command from bottom in notebook Lab_2_fine_tune_generative_ai_model.ipynb, it’s saying as ‘PEFT MODEL over HUMAN BASELINE’.Isn’t should be on original model?

print(“Absolute percentage improvement of PEFT MODEL over HUMAN BASELINE”)

improvement = (np.array(list(peft_model_results.values())) - np.array(list(original_model_results.values())))
for key, value in zip(peft_model_results.keys(), improvement):
print(f’{key}: {value*100:.2f}%')

2

Yes, I noticed this as well. The text label refers to the HUMAN BASELINE while in the code the variable used is original_model_results.

The line should be modified to give:

print(“Absolute percentage improvement of PEFT MODEL over ORIGINAL MODEL”)