Making RAG work with locally running LLM

[balaji.ambresh]

I’m not a mentor for this course. Does this help?

Running Local LLM with Ollama

These are the steps on linux (jq is for pretty printing json): # Install ollama # this also runs ollama service once install is complete # run `ollama serve` on a seperate terminal if you stop the service. curl -fsSL https://ollama.com/install.sh | sh # output skipped # check version $ ollama --version # output: ollama version is 0.12.5 # download model $ ollama pull gemma3:270m # output skipped # check before loading model $ curl http://localhost:11434/api/ps # output: {"models":[]} # loa…