check whether it is the correct formula or not for computing learning rate scheduling?
learning_rate = learning_rate0/1 + decay_rate * np.floor(epoch_num/time_interval)
No, that is not correct. You need more parentheses in order to get that code to correctly implement the mathematical formula as shown in the notebook.
Run the following python code and watch what happens:
x = 2/3 + 5
y = 2/(3 + 5)
If you expect x and y to have the same value, you’re in for a surprise.
1 Like