and element wise multiplication

Nobu has done a great job of illuminating the specifics of the LSTM logic. Here’s a thread about the general question “When do I use versus elementwise multiply”. One important “take away” from that thread is you need to carefully observe the notational convention that Prof Ng uses when he writes mathematical formulas: he always uses * to indicate elementwise multiply.

1 Like