What Prof Ng is calling the “gradient” here is the elementwise derivatives of the vector loss.
It sounds like you actually have the math background to deal with the derivations of all this. The course is specifically designed not to require even univariate calculus, so Prof Ng does not show the derivations of anything. Here’s a thread with some links that show the derivations or at least point in the direction of that material.