Nobu has done a great job of illuminating the specifics of the LSTM logic. Here’s a thread about the general question “When do I use np.dot versus elementwise multiply”. One important “take away” from that thread is you need to carefully observe the notational convention that Prof Ng uses when he writes mathematical formulas: he always uses * to indicate elementwise multiply.
1 Like