Hugging Face Fine Tuning

After load a pre-trained model like DistilBERT, where do you specify requires_grad = False and base_model = False?

Hi April,

In case this is a PyTorch related question, you may find an answer here. If you want to learn more about how trax works, you can have a look here.

In case your question refers to week 3:

It appears there is no cell to uncomment in the notebook, so the statement about requires_grad has no relevance to the code that is in fact provided. I have made a note to people at the backend to remove the relevant passages.