Where we can get H0?

I understand the logic of RNN. But I am not sure where we get the H0 when we input the first word in the first cell? Can anybody help? thanks!

Hi @Amazing_Patrick

Your question is under C4 W2 section, in which case we do not use an RNN in this week (it was used previous week).

But in general, usually in RNNs H_0 is initialized with all zeroes. A simple example with concrete numbers might help or maybe you’re interested concrete code implementation.