Hi @ashwinkashyap,
Read the instructions of the exercise 6 about the shape of the arguments passed to the categorical_crossentropy function, and how they differ from the arguments received by the compute_cost function as stated in the docstring.
Also you need to include an argument in the categorical_crossentropy function to indicate that you are sending the logits, check the documentation for how to do that.
Check this: DLS 2 week 3 exercise 6 compute_cost