RMS prop in a favorable setting

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun
11

The following article on Medium compares different methods and contains visualizations:

TLDR: The pros with RMSprop is greater than the cons and it works better for the majority of scenarios.

1 Like