DLS - C5W4 - Quiz answer related confusion
(Had pass quiz, but as I think this answer would be right answer)
Please find SS
Softmax is never followed by a linear layer. That would defeat the purpose of the softmax layer (which gives the probabilities for a multi-class output).
@TMosh Softmax is not following, the linear layer following.
Softmax is last layer (followed by) linear layer.
Please find SS
Or correct me if my english understanding wrong, here “Softmax layer followed by a linear layer” , I understand as softmax is last layer and linear layer is following that last layer (2nd last)
@TMosh , Had checked this link for followed meaning,
I guess that’s a matter of direction. 
An arrow goes from bottom to up.
To be clear, Linear Layer → Softmax. This means,. “Linear layer is followed by Softmax” or “Softmax following Linear layer”.
Said another way:
If you’re doing classification, the output of a NN should not be a linear layer.
@anon57530071 ,
Linear Layer → Softmax
Your comment: “Softmax following Linear layer”
Sorry, but not agree with that.
Its linear layer following softmax
And ultimately softmax layer followed by linear layer
@TMosh
That’s incorrect. I think we’re just differing on what “followed by” means.
The image you posted earlier is correct. The linear layer’s output is applied to the softmax input. The output of softmax is the probabilities for each class.
1 Like
@TMosh , Yes, Its just different perspective to treat meaning of “followed by”,
(I used as specified in below link), so had considered as answer was right and posted as topic.