Hi everyone, In, for example, a simple linear regression model, we can simply define the equation of the derivative of the cost function with 2 parameters (w, b) and then, each time we need to calculate it, it is O(1) calculation. However, in a neural network, we need backprop to calculate the der…

Reason for using BackProp for calculating derivative

rmwkwok December 2, 2023, 12:23pm 4

You said O(N+P). Why can backprop save time? ( a reference here )

1 Like

Topic		Replies	Views
So, why do we need back propogation? Improving Deep Neural Networks: Hyperparameter tun	4	491	May 11, 2023
Backpropgation Advanced Learning Algorithms week-2	5	385	August 8, 2023
Computing derivatives: why not analyticaly? Advanced Learning Algorithms week-2	4	439	May 26, 2023
Calculating Gradient descent of Softmax regression Advanced Learning Algorithms week-2	4	404	September 14, 2023
Backprop derivatives Advanced Learning Algorithms week-2	1	473	May 13, 2023