Fine Tuning Bert Lecture Video is Confusing

Course Q&A Natural Language Processing NLP with Attention Models
1

Hi,

I found the C4W3 Fine Tuning Bert video to be confusing. The video quickly introduces several acronyms - MNLI, NER, and SQuAD - without explaining what they are. All three slides seem to effectively say the same thing, which is that fine-tuning is simply replacing the unlabeled pre-training data with some task-specific labeled data, and then the video abruptly ends saying that I now know how to fine-tune BERT. This felt… pretty light on the details? This video seems to communicate the same information about fine-turning as the earlier “Transfer Learning in NLP” video without really introducing new information.

2

Hi @esav

I understand your confusion, this video is far from perfect. From what I see, I think you understood that in the fine-tuning phase the model was fine-tuned on different tasks, using different datasets (for which acronyms were not explained fully).
The takeaway should have been that there are numerous tasks on which BERT was fine-tuned.

Cheers