Should gradient descent create a path that is always perpendicular to contour lines?

Hello @neirar,

Very interesting observation!

For your first question, I encourage you to try and see what is causing what you see. (Edit: I have added a GIF here to show what’s causing it) After you are sure that the function is giving the correct gradient path, then you can test if the path is always on the same plane for your second question :wink:

Cheers,
Raymond

3 Likes