Need help on my own deep learning implementation from scratch

I implement my own Deep Learning from scratch. But when i run GD trying to find best parameter, the cost, prediction not only final but also different layer work ambiguously. I think I miss some wrong calculation but couldn’t figure it out by myself.
Can anyone please check my Foward_propagation, Back_propagation and Gradient_Descent?
Deep Learning (3).ipynb (73.1 KB)