Check this thread for tanh
.
For ReLU
, I cannot find any mathematical explanation on this forum but its simply 1 if x>0, otherwise 0.
Check this thread for tanh
.
For ReLU
, I cannot find any mathematical explanation on this forum but its simply 1 if x>0, otherwise 0.