I was wondering if there was a mistake for the characters underscored. I think the [l] should be [l-1], otherwise the formula won’t consider anything about the past.
Hi @lixiasun , welcome to the DLS !
Consider that here “l” refers to the layer of the NN, and not to any previous values.
If you look at the Section 6 of the assignment, how the model() is implemented, it can give you a hint of how the v previous values are used.
Thank you, I see. Because the VdW[l] is updated in place and it is calculated with respect to the same layer. I had some misunderstanding for it before.
1 Like