How to serve models which are not TF/Pytorch ? Creating a Python web service is not recommended as it has Global Interpreter Lock (GIL).
Python GIL limits performance on cpu intensive concurrent tasks. Web frameworks are I/O intensive. So, unless you have a strong reason to go for C++, python frameworks offer a good start.