Vanishing gradient

hi @bahadir
can regularization help in solving vanishing/exploding gradient problem??

Hi @kunal,

Regularization is mainly used to avoid overfitting in the cost function and for vanishing/exploding gradient problem, this link explains the techniques that can be used. The last method can be considered a regularization method, since you are clipping (regularize) the error to become so big.