I do not understand positional_encoding. What is all about the iniatialization. Set the values to zeros?
I think this is covered in the lectures, but not in great depth.
I do not understand positional_encoding. What is all about the iniatialization. Set the values to zeros?
I think this is covered in the lectures, but not in great depth.