My question is very basic. I don’t understand what dtanh is and how is it being computed?
It is the derivative of the tanh activation function.
How is it being computed? Also how is partial derivative of tanh(x) equal to 1-(tanh(x))^2?
Thank you! You are a blessing upon us.