Hi, I have a (not so) basic question: why do we need activation functions? And in a multilayer NN, how to choose the “good” activate function for each layer? In a video Andrew said: sigmoid only for the output of a 2-classification tanh is superior if the data are “normalized” (don’t remember o…

About activation functions

Course Q&A Deep Learning Specialization Neural Networks and Deep Learning

paulinpaloalto August 9, 2022, 5:15pm 3

Rashmi has covered your question, but it might also be worth having a look at this thread which talks a bit more about how you approach choosing the activation functions for the hidden layers.

Topic		Replies	Views
Week3 - Choice of Activation function Neural Networks and Deep Learning	2	753	February 5, 2022
Activation functions as hyperparameters Improving Deep Neural Networks: Hyperparameter tun	1	553	September 14, 2021
Better Activation functions: (tanh > sigmoid) MLS Resources	18	1042	November 10, 2022
Using different activation function for hidden layers Neural Networks and Deep Learning	4	1674	February 7, 2022
Neural Network functions Advanced Learning Algorithms week-2	3	476	April 22, 2023

About activation functions

Related topics