Programming Assignment: Transformers Architecture with TensorFlow

In def positional_encoding(positions, d) function, there’s a code “angle_rads[:, 0::2]”.
I would like to know what this one means. I googled that but I couldn’t find anything.
Please help me. Thank you in advance.

Hi @Koyo_Fujii,

From what I gather, you want to understand what the “colons” mean over here ? This is how you do “slicing” in python. For example, you can read this.

Hope this helps,

P.S angle_rads[:, 0::2] is a hint in of itself on how to implement that line of code