Trajectory

Hi, will batch gradient descent always follow a smooth trajectory? Will non-batch methods result in a zigzag trajectory if the subsets at each step are different?

Probably not.

Non-batch methods don’t have subsets.