CBOW and faulty sliding window

Why don’t we process when the sliding window is less than the constant c (this happens at the beginning and end of the sentence)? It feels like we are throwing away a lot of information.
Is some type of interpolation possible?

Instead of a fixed sliding window, can we have “up to a sliding window or less”?

Hi @ajeancharles

What are you talking about exactly? Which part of the course?

I’m guessing you are talking about n-grams, in which case we prepend <sos> tokens for the start and <eos> at the end when needed (depending on the n-gram variation) with no “real” information loss.

I can’t remember the exact example anymore. It has to do with the length of a sentence and dropping any sentence that is too long.