Agentic RAG Router LLM

Course Q&A Retrieval Augmented Generation
,
1

About the Router LLM: How can it decide when information retrieval from the RAG system is necessary, when the final response is generatet from a separate LLM. Does the Router LLM have the same knowledge as the generator LLM?

1 Like
2

Dear @MDF1,

Welcome back to the Community!

In a RAG system, the Router LLM decides if a query needs retrieval before the Generator LLM answers.

  • It doesn’t have to have the same knowledge as the Generator — often it’s smaller/faster.

  • Decision is based on prompted rules, confidence checks, and domain keywords.

–
Keep Learning AI with DeepLearning.AI - Girijesh