Model deployment - Cloud or In-house

AI Discussions
,
1

What are the parameters based on which one can decide to keep model Deployed on internal servers or move it to cloud services like Azure or AWS?

2

Deployment decisions usually boil down to cost.

Here’s my recommendation:

  1. Cloud based approach offers high availability, security patches and scaling. If these are your primary concern, go with cloud.
  2. If the cost of deploying and using a model surpasses that of using a cloud based approach, host it in-house.

Small companies often start with cloud based approach before switching to an in-house style since setting up and maintaining private infrastructure is not cheap.

1 Like