How to update finetuned model (attention layer, KeyValue Cache)

AI Discussions
,
1

Hello,

Is there a course in DeepLearning.AI that mainly covers adding/ removing attention layers or replacing key value cache on finetuned model.

Thank you.

2

@Ghada personally I’d review Sharon’s short course first:

I am not an expert at this, but intuition (to me) suggests you don’t/aren’t stripping layers as you would with tuning a CNN.