Hi,
I’m a bit confused about ‘gate gate’ mentioned on “LSTM equations (Optional)”. Is it refering to candidate gate in line with the video and lecture notes? Does it refer to “input gate” which is what I infer from the cell state formula?
Any clarification would be helpful,
Thank you,
Ava
Hi @avazeh
Yes, it is referred as “candidate state gate” in the previous video. It is also called a “cell gate”, a “cell input activation” and other names. I’m not a big fan of terminology in NLP so I annotated the image bellow with function names / equations so it to be (maybe) clearer:
Image is from Wikipedia since the course image is a bit crowded.
I find actual calculations with numbers more informative, so maybe it won’t confuse you.
Good luck!
