Running Local LLM with Ollama

[balaji.ambresh]

This discussion about timeout happens on this thread:

Change Timeout parameter in aisuite with ollama?

I am trying to run the notebook locally using ollama, to test how small model may work with agentic workflows. I set the model to ollama:local-model and it runs and connects well to ollama, my problem is that because inference is slow, (specially with reasoning models) i reach a timeout error, and the workflow dies. I tried to pass as a parameter a timeout value, but it does not seem to work. Basically I do something similar to this: import aisuite as ai client = ai.Client() response = clie…