If you want to see how back propagation works, check this out
https://community.deeplearning.ai/t/backpropagation-with-simple-math-no-fancy-calculus-no-linear-algebra/143575