Dear all, I am confused a bit. In course 1 of the specialization, in week 3, the professor says that it does not make sense to use linear functions as activation functions. I completely could understand the justifications of that. But it seems that aslo RELU is a linear function, then why is it sui…

RELU vs linear activation

Christian_Simonis January 16, 2023, 6:06pm 3

In addition to @Kic‘s great answer, I believe your question is answered in this thread: Differences between ReLU and linear for positive values - #3 by Christian_Simonis

Please let us know if anything is unclear, @Sina_Kian.

Best regards
Christian

1 Like

Topic		Replies	Views
Differences between ReLU and linear for positive values Advanced Learning Algorithms week-2	4	721	January 16, 2023
Choice of activation function Advanced Learning Algorithms week-2	7	683	November 21, 2022
C1_W3-Non-Linear_Activation_Function Neural Networks and Deep Learning	1	550	May 18, 2021
Why do we need Activation function Neural Networks and Deep Learning	4	544	February 16, 2023
Why do you need Non-Linear Activation Functions? -> ReLU is still linear Neural Networks and Deep Learning	1	491	July 18, 2023