Clarfication on Gradient descent for neural networks

Course Q&A Deep Learning Specialization Neural Networks and Deep Learning
2

There are a lot of threads discussing this. Please check this one, two, three, and four.