Hey Sara,
another good question
The rule of thumb to deal with high bias first and only then work on high variance. I’ve described the decision-making process in detail here.
I assume that that switching the learning algorithm will have quite a dramatic effect, so you start the tuning process over again.