Activation function

Course Q&A Deep Learning Specialization Neural Networks and Deep Learning
1

can i use any non linear function in hidden layers nodes other than the standard activation functions (relu,tanh,sigmoid), like exp,log,cosine,square,cubic orders …

2

You can use custom activations.

Here are a few popular ones:

1 Like