About RMSProp


Hi everyone,

I am having trouble understanding this slide. The professor said that db is large so Sdb large, then db divided by a large number will be small, so that helps remove the oscillation.

My question is how come a lagre number divided by a large number guarantee a small number?

Try it yourself with two large numbers, what is the answer? If they are both large the same magnitude then always the division is a small number…

1 Like