🔮 Visualising RAGs with RAGxplorer (Inspired by Advanced Retrieval course)

AI Discussions
, , , ,
1

Inspired by the Advanced Retrieval course, I built RAGxplorer.

It is an open-source tool to visualise RAG documents in the reduced embedding space.

It comes with a very simple and familiar API.

from ragxplorer import RAGxplorer
client = RAGxplorer(embedding_model="thenlper/gte-large")
client.load_pdf("presentation.pdf", verbose=True)
client.visualize_query("What are the top revenue drivers for Microsoft?")

image
image1372×796 135 KB

I extended the code from the lab to include an interactive chart and to support any OpenAI and HuggingFace Inference Endpoint embedding models.

Any feedback would be most appreciated.

2 Likes
2

You posted in the “AI Questions” area. Is there a question associated with your message?

If not, I think maybe it would be more at home in the “AI Projects” area.

You can move it there using the “pencil” icon in the thread title.

1 Like
3

This is super cool; congratulations on your great work. Why does it appear that the retrieved chunks are not close to the original query or to the sub questions? Shouldn’t they be? Please help me understand

Maybe it is because the projection we are viewing is not the ideal projection (i.e. the two dimensions that are plotted here)? Maybe there is another projection that shows they are infact closer?

1 Like
4

Hello! Great question :slight_smile:

To clarify, the actual retrieval (i.e. calculating the cosine similarity) is done in the full dimensional space.

The dimensionality reduction algorithms like umap may result in some information loss, so a point that is nearest in the full dimensional space may not be the nearest point in the 2D space.

There are also hyperparameters to the dimensionality reduction algorithm that can be explored

Lastly, there was an related bug in the code, but that was spotted in a PR and fixed :slight_smile:

2 Likes
5

Gotcha. Thanks for the explanation. By the way what are your thoughts on Langchain? Are there similar libraries you would recommend for developing on top of LLMs? curious for your perspective on this

1 Like