Difference between Lasso and Ridge regression

Ganeshkumar_Naik · January 9, 2022, 4:41pm

Hi,

I understand that in Lasso regression, sum of weights are added to the cost function. And in Ridge regression, sum of squares of weights are added to the cost function.

Mathematically, how do these two differ? How do they affect the update of weights after every iteration? How do they affect the final performance of the model?

Thank you

gent.spah · January 10, 2022, 10:06am

Hi there,

Interesting question but I think its a broad question, you can search in the web about these there is plenty of information on both and more. One such link I found is this Linear, ridge, lasso…

Topic		Replies	Views
How to apply regularization in Linear Regression Advanced Learning Algorithms week-3	1	420	June 5, 2023
Which is better ? Linear Regression with Regularisation or Ridge Regression Supervised ML: Regression and Classification week-1 , week-2	3	25	October 28, 2024
Difference between Cost function and Loss function Supervised ML: Regression and Classification week-3	2	505	March 18, 2023
Why is the regularization term in the cost function w_j^2 instead of just w_j? Supervised ML: Regression and Classification week-3	3	244	February 9, 2024
Logistic Regression: Difference between cost function & gradient descent Supervised ML: Regression and Classification week-3	5	560	August 8, 2022

Difference between Lasso and Ridge regression

Related topics