When exploring the optional lab “Softmax function”, I found a statement like this: In the preferred organization the final layer has a linear activation, and for historical reasons, the outputs in this form are referred to as logits . Then I googled the word “logit” to understand it further, and th…

Hello @Yulin_Li , I think logits can be defined as the inverse of sigmoid: logit(p) = \log{(\frac{p}{1-p})} \implies \exp{(logit(p))} =\frac{p}{1-p} \implies p = \frac{1}{1+\exp{(-logit(p))}} \implies p = \frac{1}{1+\exp{(-z)}} \implies p = sigmoid(z) where z = logit(p) = linear(a) and linear …

Why "logit" stands for the output of linear activation function

Course Q&A Machine Learning Specialization Advanced Learning Algorithms

rmwkwok September 5, 2022, 5:37am 3

If you would like to read some maths, you might check out this discussion.

Topic		Replies	Views
Question about is_logit Advanced Learning Algorithms week-module-2	30	940	February 17, 2024
Improved implementation of softmax - Neural network training \| Coursera Advanced Learning Algorithms week-module-2	1	68	June 25, 2024
Week 2 - Improved implementation with SoftMax Advanced Learning Algorithms week-module-2	10	715	December 1, 2023
Practice quiz: Multiclass Classification Advanced Learning Algorithms week-module-2	1	537	June 18, 2022
Numerical correct implementation of softmax Advanced Learning Algorithms week-module-2	6	614	December 24, 2022

Why "logit" stands for the output of linear activation function

Related topics