Dear mentors, I remembered Prof. Ng mentioned he almost always use Relu as the activation function. Therefore, when I worked on the assignment Planar_data_classification_with_one_hidden_layer, I tried replacing sigmoid function with Relu. But when I run the nn_model function, the values in the A1 m…

Relu/LRelu does not work for forward propagation in Planar_data_classification_with_one_hidden_layer

Course Q&A Deep Learning Specialization Neural Networks and Deep Learning

Caleb July 27, 2021, 8:39pm 7

I tried various combinations and was able to get the the accuracy upto 85% by using n_h=277, α=0.073 and 50000 iterations.
It took a couple of hours to train.

1 Like

W3 A1 Relu Activation doesn't work

Topic		Replies	Views
W3_A1_ReLu as Activation function Neural Networks and Deep Learning	3	622	March 30, 2023
How to apply relu function in Exercise of week 3(optional).) Neural Networks and Deep Learning	5	538	July 12, 2023
Course1 - Week3 Assignment - ReLU gave worse performance than tanh Neural Networks and Deep Learning	3	547	September 9, 2021
Doubt about Relu activation in hidden layer Advanced Learning Algorithms week-2	3	779	January 29, 2023
W3_A1_Implementing ReLu in NN Neural Networks and Deep Learning week-3	5	470	January 4, 2024

Relu/LRelu does not work for forward propagation in Planar_data_classification_with_one_hidden_layer

Related topics