Hi everyone! I’m taking the “Building and Evaluating Advanced RAG” course and running into an issue with TruLens.
I ran the course code exactly as provided, and while the TruLens dashboard leaderboard shows evaluation scores correctly, the Records/Evaluations tab on the dashboard is completely empty — no traces at all.
Has anyone else experienced this? Could it be a version compatibility issue with TruLens or LlamaIndex? Or is there something that needs to be done to flush the records to the database before launching the dashboard?
Any help would be appreciated!
1 Like
hi @Khaliun_Delgerjav
that is a very good question and this issue can happen sometimes with trulens
the problem might be that the records are still in the memory and did not save fully to the local database file before the dashboard opened
you can try to wait a little bit or run the evaluation code again to make sure everything is saved before launching the dashboard
another common reason could be a version mismatch between trulens and llamaindex because sometimes new updates change how the dashboard shows the detailed tabs
please check if you are using the exact same library versions provided in the course and let us know if that helps
2 Likes
Thanks for the question and thanks @omarWael for a quick reply!
Great catching that! Just to add a bit more technical background to what was mentioned above, while TruLens does sometimes take a moment to flush its memory cache to the local database, the main culprit behind the blank Records tab here is schema drift. This course was built in late 2023 using (today’s legacy) LlamaIndex (v0.9.x) and trulens_eval packages. Because the underlying library object structures have changed so much since then, the dashboard UI can still safely calculate and show the leaderboard metrics, but it crashes when trying to map out the detailed visual traces.
We are actively working on refreshing our course notebooks. Since you already spotted the root cause, a great next step would be to experiment with the latest versions of both packages in a local sandbox environment! Running a quick modern RAG pipeline locally will give you a great head start on how these tools operate today.
-- Lesly, DLAI
2 Likes
thank you @lesly.zerna for the detailed explanation and for confirming the version issue
it makes total sense now why the leaderboard works but the detailed traces tab breaks due to the schema changes since 2023
great to hear that the team is working on updating the notebooks and thanks again for adding the extra context
2 Likes
Thanks so much @omarWael for the quick reply — really appreciate you taking the time to respond!
Thanks @lesly.zerna for the detailed explanation — that makes a lot of sense. I’ve been enjoying digging deeper into the ecosystem, so I’ll try to experiment with the latest LlamaIndex and TruLens versions locally as well. Thanks again!
2 Likes
you are very welcome khaliun
really glad the explanation helped and that makes perfect sense
have fun experimenting with the modern RAG pipeline
happy learning
1 Like