Apologies if this is redundant (didn’t find in search), but was wondering if there’s an online textbook or reading material to better understand how RNNs work? I know there are white papers out there and Chris Colah wrote about RNNs & LSTMs a while back: Understanding LSTM Networks -- colah's blog
The Chris Colah blog post is very good at explaining how RNNs work and I don’t there are significantly better posts out there.
I would suggest to implement the RNN for yourself in excel or similar. At least for me, that made a lot of things clear. Here is some screenshots of it (RNN and LSTM). There is some magic when your Excel spreadsheet can translate sentences from English to German .