Hi everyone, In, for example, a simple linear regression model, we can simply define the equation of the derivative of the cost function with 2 parameters (w, b) and then, each time we need to calculate it, it is O(1) calculation. However, in a neural network, we need backprop to calculate the der…

Reason for using BackProp for calculating derivative

rmwkwok December 2, 2023, 12:23pm 4

You said O(N+P). Why can backprop save time? ( a reference here )

1 Like

Topic		Replies	Views
So, why do we need back propogation? Improving Deep Neural Networks: Hyperparameter tun coursera-platform	4	492	May 11, 2023
Backpropgation Advanced Learning Algorithms week-module-2	5	386	August 8, 2023
Computing derivatives: why not analyticaly? Advanced Learning Algorithms week-module-2	4	440	May 26, 2023
Calculating Gradient descent of Softmax regression Advanced Learning Algorithms week-module-2	4	408	September 14, 2023
Backprop derivatives Advanced Learning Algorithms week-module-2	1	476	May 13, 2023