How do we decide the number of iterations and learning rate

If we change the number of iteration, the value of parameters as well as the cost changes as well. So why have we taken 1000. Also how did we decide the value of learning rate (alpha) as 5.0e-7

1 Like

Hi! The number of iterations and learning rate values (hyper-parameters) are chosen based on experimentations and testing different combinations of values.

The number of iterations determines how many times we update the parameters during the training process and the learning rate (alpha) controls the size of the steps we take during parameter updates. So a change in these values can impact the training process and the performance of the model.

5 Likes