Why I don’t understand that there is not Sum symbol of regularization term. Pls Do someone explain to me?
Because for each w_j in the partial derivative, only the ‘j’ term is non-zero. So there is nothing to sum.
So thanks my friend
Still didnt get it my friend. can you please explain in more detail or using some other example? please @TMosh
Let’s say you are trying to find the gradient for w_3.
First expand the summation as \sum{w_j^2} = w_1^2+w_2^2+w_3^2+.....+w_n^2.
Now when you take partial derivative wrt w_3 all terms except the term with w_3 will be zero. So, for every gradient term only one of the terms from summation will be left rest all will vanish.
thanks brdr