How hard is it to use Bedrock LLMs or Azure LLMs vs. OpenAI for creating workflows like this ?
I haven’t tried it personally but the llama_index.llms module offers a lots of LLMs integration.
Check the following link of LlamaIndex documentation. This link is for Bedrock but on the left hand panel, you can see a full list of supported LLMs that include Azure, anthropic and even Ollama (if you want to try local LLMs)
https://docs.llamaindex.ai/en/stable/api_reference/llms/bedrock/