Definitely would recommend that you also focus on the infrastructure to support your model as well.
In other words, take versions of your models as you develop it and make sure it deploys well into whatever pipeline you choose. Make sure that you know how much compute it will require and that your model can be updated in testing and production with as little effort as possible.