Hi
Why we should initialize c_next = np.zeros(a_next.shape) to reach correct value?
But we initialize a_next = a0.
Why we shouldn’t initialize c_next =a_next = a0?
a
refers to hidden state. The initial hidden state is provided to us as a0
.
c
refers to memory state. Since we haven’t done anything to update the state, it’s safe to use zeros.