the latex formula tried should be

A(q, K, V) =\sum_{i}\frac{exp(q.k^{< i >})}{\sum_{j}exp(q.k^{< j >})}v^{< i >}

Hi @jackchan.hk,

Thank you for pointing this out!

Can you tell me which week’s quiz this is ?

Best,

Mubsi

Course 5 week 4 transformer quiz