Just completed the Calculus for Machine learning course and I wrote an article on sigmoid functions in my quarto blog. Please kindly provide feedback for improvement.
Here’s the link:
https://lukmanaj.github.io/ailearningloop/posts/sigmoid/
Hello @lukmanaj,
Thanks for sharing!
the sigmoid derivative helps prevent the vanishing gradient problem
but the derivative tends to zero when sigmoid tends to 0 or 1, so the gradient can vanish?
Thank you so much @rmwkwok for the hint. I think I got it mixed up with ReLU. This is why I shared here, so that people with experience like yourself can see if I am on the right track. I will fix it. Really appreciate.