C1w1: ungraded lab: is it also good for batch inference case?

Course Q&A Machine Learning Engineering for Production(MLOps) Introduction to Machine Learning in Production
1

Hello all,

After runing the notebook, I’m curious to know the serving model that I can use in cas of batch inference.
I’ve a use case of ML with prediction (classification) that should be executed for batch csv file (with 1Million recodrs).
it’s a structered data case.
Thanks to share any notebooks or frameworks adapted for such situations.

Regards

2

In general, machine learning models can predict over batches of data. The limiting factor for batch size is your computer hardware in terms of memory and processing capability.

Find a way to give the model access to the features in csv file and you’re good to go.

1 Like