LSTM initialization

An LSTM unit takes c and a from the previous unit. Does that mean we need to initialize both?

Yeah in the first block it needs to be initialized or it could be initialized if you use a framework like tensorflow.

1 Like

Thanks. Just to be specific: Both activation (a) and memory (c)?

Yes, both. You can check out Week 1, Assignment 3 for reference.

Cheers,
Elemento

2 Likes