CBOW and sliding window

Does the order of the context words matter?

Hello @ajeancharles ,

Yes, the order of context words helps in determining the Context of a sentence. It helps to understand the meaning of sentence.

With regards,
Nilosree Sengupta

Thank you for your quick response. So far, I see an averaging of the context vector being done. How can the context vector remember the initial position of the original words? Wouldn’t you need some positional encoding and embedding?

Look at the context vectors; you cannot tell which words came first. Any permutation of the context words will give you the same context representation.