Dense layer

Course Q&A Machine Learning Specialization Advanced Learning Algorithms
1

I’m in Week 1 of Advanced Learning Algorithms course. I might have missed the definition of dense layer so want to ask whether my understanding is correct.

Dense layer is a layer which connects to every neuron of its preceding layer, in other words, it uses all the output from preceding layer?

Thanks in advance!

2

Hey @gnart,

Yes your understanding of dense layers is correct!. A dense layer, also known as a fully connected layer, connects every neuron in its preceding layer to every neuron in the dense layer. This means that each neuron in a dense layer receives input from all the neurons in the previous layer.

Regards,
Jamal

2 Likes
3

Thanks for the details explaination!

4

Denser layers cause overfitting in a model that is why we used the drop-out method.

5

Hey @waqarkhan,

Well dense layers themselves do not always cause overfitting. Whether dense layers contribute to overfitting depends on various factors, including the specific problem, the dataset, the size of the neural network and so on and that’s why we use dropout layers ( Regularization technique) to prevent the overfitting