what is dtanh in week1 assignment?
1 Like
The formula for dtanh
is shown on the third line of equations, the one with to the left of (0)
. It’s the formula for derivative of the tanh
activation function.
You can compute its value by following the equation.
Well, it’s that plus multiplying by da_{next}. Note they could have written it more simply as:
dtanh = da_{next} * \left( 1 - (a^{<t>}){^2} \right)