Back Prop question

Here’s a thread with links to lots of websites that cover these issues, including the Stanford courses that Pavel mentioned.

One of the sites linked from that thread is this one, which is worth a look. It was created by Jonas Slalin, who was a mentor for DLS for several years. It starts with a thorough treatment of Forward Propagation and then links to his other pages that cover back prop.