When we have overfitting or variance what should we start with to improve the model? add more data or regularization ?
Hello @Med-akraou,
If we already have more data, I believe we will add them sooner or later, and the rest of the hyperparameters can change because of the additional data, so I would suggest to add them first if they are already available, however, if we will need time to collect more data, then we probably should go for regularization first.
Raymond
Makes sense. Thank you very much @rmwkwok