How did Andrew derive the classification cost function with respect to w_j?

Course Q&A Machine Learning Specialization Supervised ML: Regression and Classification
2

Check out this post: How to get the derivatives of the logistic cost/loss function [TEACHING STAFF]