Number of nodes in layers (DNN)

Course Q&A Deep Learning Specialization Structuring Machine Learning Projects
1

I’m interested in choosing the number of nodes of each layer in a deep neural network. Is there any rule or article dealing with the problematics?
I can imagine that it may be different for each topic. But anyway, if I have an input layer, e.g., 100 members, how many nodes should I choose in the first, the second, the third, the fourth, etc., layer?

Thank you!
Jiri

2

There is no rule of thumb to find out how many hidden layers or units you need. You treat them as hyper parameters. To find out the best combination for your validation dataset, you can perform a grid search:

753×599 53.8 KB

In this case, your network design should have 4 hidden layers, each with 90 neurons for an MSE of 11.5 (which I think is the lowest when I look at the grid). You can do another grid search around that spot to find an even better architecture (or widen your search).

4 Likes