It seems that there is a typo in the ht equation:
Both the diagram and Wikipedia state that the ht value should be obtained from the elementwise product of ot and tanh(ct ), not their sum.
It seems that there is a typo in the ht equation:
Both the diagram and Wikipedia state that the ht value should be obtained from the elementwise product of ot and tanh(ct ), not their sum.
Hello @cameron_grams! Thank you for notice it!
You are correct, the formula should be h_t=o_t \cdot tanh(c_t).
We will do our best to fix it asap!
Best,
Wesley P.
Thanks cameron. I got confused here as well.