Hi, will batch gradient descent always follow a smooth trajectory? Will non-batch methods result in a zigzag trajectory if the subsets at each step are different?
Probably not.
Non-batch methods don’t have subsets.
Hi, will batch gradient descent always follow a smooth trajectory? Will non-batch methods result in a zigzag trajectory if the subsets at each step are different?
Probably not.
Non-batch methods don’t have subsets.