Changing NN architecture/hyperparameters and orthogonalization

Hey Sara,
another good question :slight_smile:

The rule of thumb to deal with high bias first and only then work on high variance. I’ve described the decision-making process in detail here.

I assume that that switching the learning algorithm will have quite a dramatic effect, so you start the tuning process over again.

2 Likes