Some questions about the formula for exponentially weighted average in the programming assigment

屏幕快照 2021-05-10 上午9.16.09

I was wondering if there was a mistake for the characters underscored. I think the [l] should be [l-1], otherwise the formula won’t consider anything about the past.

Hi @lixiasun , welcome to the DLS !

Consider that here “l” refers to the layer of the NN, and not to any previous values.

If you look at the Section 6 of the assignment, how the model() is implemented, it can give you a hint of how the v previous values are used.

Thank you, I see. Because the VdW[l] is updated in place and it is calculated with respect to the same layer. I had some misunderstanding for it before.

1 Like