Hello,

In Exercise 3 of the Transformers Lab , I see that q has shape (3,4) and k has shape (4,4). So, their multiplication gives shape (3,4).

But shouldn’t q and k have the same dimension as there is one vector q* and one vector k for every word i? This is mentioned in the second video of week 5.*

Thank you!