Optimization Methods update parameters with adam

I have been stuck on the optimization_methods exercise 5. I am really confused on what v[‘db’ + str(l)] or s[“db” + str(l)], or their corrected, would be since it isn’t explained with the rest of Adam. How can I figure this out? thank you!

The math formulas for those quantities are all given in the notebook. Or are you saying you specifically don’t understand the way the keys to those dictionaries are being constructed?

1 Like