Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and

Hi Folks!, I’m just stating the 2nd course (see the above link). Are there any speccific articles you would recommend reading to improve my understanding of the 1st week topics? Please share so that I can dive in!

Hey @Niranj_Kumar, here’s a really solid article that should help:

https://karpathy.github.io/2019/04/25/recipe/

It’s by Andrej Karpathy and it’s great because it walks through some of the most practical aspects of training neural networks, including:

  • Common mistakes neural networks make

  • How to deal with overfitting

  • Setting up end-to-end training and evaluation pipelines

  • Regularization and tuning techniques

It’s very easy to follow.

Hope this helps!

1 Like