Generating Ideal Plot in C1_W3_Lab08_Overfitting_Soln

Hi @Ghulam_Mustafa,

here some view from a regression perspective:

Basically you can also describe this quite similarity for classification problems, see also this paper:

https://www.researchgate.net/publication/331452094/figure/fig2/AS:731693849784321@1551460816294/The-concept-of-overfitting-and-model-regularization.png
(Source).

If you see the tendency of overfitting in your training process resp. evaluation of the model performance, you can think about to tackle this with:

  • increasing regularization (and punishing complexity of your model more)
  • Train a smaller model (less parameters)
  • apply or increase your dropout rate to bring some randomness into your training process which should increase the robustness of your model

Please let me know if this helps!

Best regards
Christian