Here’s a thread that shows how to calculate many of the relevant derivatives for the loss functions and activation functions.
One thing to note here is that the notation in the ML world is different than in the “pure math” world. When they say log here, they mean the natural log, not the log base 10. So there should be no constants of ln(10) required anywhere here.