Week 4: Followed the get_angles() formula but getting error

[eugeniad]

Help, I don’t understand why I’m getting this error. I tried printing out odd_cols and even_cols, but I don’t understand how to fix this issue.

[TMosh]

Your code for get_angles() isn’t correct.

Try this thread:

[Week 4] Exercise 1 - get_angles

Hi Maxime, The get_angles() function is to calculate angle, rather than PE (position encoding). Take a look at equations: [image] Each pair of (even, odd), i.e., (0,1), (2,3), (4,5)…, (2i, 2i+1) for i = 0, 1, 2, …, i, respectively, even and odd have the same angle (red box). Regarding the limit (the value at last position and last dimension), the test case generated positions from 0 ~ (position - 1), and dimensions from 0 ~ (d_model -1). So the last value is at (position - 1) and (d_model - …

Or search the forum for “get_angles”.

[Reymerz]

You know until I read that I had NO IDEA that it was 10,000 to the power of (2i/d). I kept multiplying it. I honestly though they just squeezed it in…