Learning rate decay lecture slide

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun
1

Hi,

As per the equation learning rate need to decrease for every epoch but on the slide,
It increased to 0.67 from 0.1 and then decrease again.
But, as per my calculations epoch, 2_leaning rate is 0.066 and the epoch 3_learning rate is 0.05 etc, which follows that the learning rate decreases for every epoch

is this error on the slide or am I doing something incorrect calculations here?

image
image893Ă—489 66 KB

Regards,
Siddhesh

1 Like
2

Hi, @siddhesh_mane.

Your calculations are correct. It looks like a transcription error.

Thank you for taking the time to report this :slight_smile:

3

I just went to find the actual lecture so that I could file a git issue about this. But it turns out that he fixes it in “realtime”. It’s wrong when he first writes it at about 3:14, but then by 3:33 it’s been rewritten to be correct. I don’t know if that is really worth filing a git issue about, but I can do that.

1 Like