How does a deep learning algorithm figure out the features by itself as Andrew said in the lecture/
Andrew’s lecture is aimed to give an intuition about how the internals of a neural network operate.
In practice the activations of the hidden layer don’t have any real physical meaning - they’re not really “affordability”, “awareness” and “quality”. They’re simply whatever activations will lead to minimizing the total cost.
So the NN’s hidden layer learns new features (by using the non-linear combinations of the input features), but we don’t really know what they mean. They’re just mathematical entities that summarize the characteristics of the input, and lead to minimizing the cost on the output.
1 Like
Does it mean it finds out the best combination by hit and trial?
No, not at all.
Training is via a mathematical process called backpropagation.
It’s discussed later in the course.
Ok, I’ve heard about it somewhere. I meant to say that does the network layer try all the possible combination to choose the best feature?
No. The weight values are learned from a training set. That’s no different than linear or logistic regression.