W3: LSTM equations (Optional)

Hi @avazeh

Yes, it is referred as “candidate state gate” in the previous video. It is also called a “cell gate”, a “cell input activation” and other names. I’m not a big fan of terminology in NLP so I annotated the image bellow with function names / equations so it to be (maybe) clearer:

Image is from Wikipedia since the course image is a bit crowded.

I find actual calculations with numbers more informative, so maybe it won’t confuse you.

Good luck!