In Retrieval Augmented Generation (RAG) Course, I’m stuck in Module 4 - Developing a RAG-Based Chatbot graded assignment.
I get the error when I run the code.
InvalidRequestError: Error code: 400 - {“message”: “Unable to access non-serverless model meta-llama/Llama-3.2-3B-Instruct-Turbo. Please visit Together AI | The AI Native Cloud to create and start a new dedicated endpoint for the model.”, “type_”: “invalid_request_error”, “code”: “model_not_available”}
together.ai has deprecated a lot of models in the past days resulting in concurrent issues with labs of RAG courses.
Lab assignment 3 to 5 and all ungraded labs are updated now.
You need to Restore original version, to get the updated notebook.
I also would recommend to first delete the old file, and restore original version, so any cache issue is not encountered when running codes again.
Courses, labs are created with multiple channels, so labs gets affected when any changes.made at one end and can take multiple attempts to resolve issue.
I’ve been able to do part of the graded assignment, but now I get a similar error in Module 5.
I’ve capturated the error.
ERROR REAL: InvalidRequestError Error code: 400 - {"message": "Unable to access non-serverless model meta-llama/Llama-3.2-3B-Instruct-Turbo. Please visit https://api.together.ai/models/meta-llama/Llama-3.2-3B-Instruct-Turbo to create and start a new dedicated endpoint for the model.", "type_": "invalid_request_error", "code": "model_not_available"}
did you by any chance try to re-run a cell after running down codes, I noticed even I experienced this once when I ran down a cell till exercise and went back running the import cell, caused me the same error you got.
One another learner encounter an oserror, which mentioned information, that import cell should be only run down once and running down twice will kill the kernel. So I had clear out the kernel output first, and run the cells from beginning individually to resolve this issue.
Also please post screenshot of the codes which caused this error, of you get again this error.
I checked myself doing the assignment, and didn’t encounter any error for lab assignment after i restored the original version again.
So kindly either try again Restore original version, or post screenshot of which part of assignment you encountered error with error also in the screenshot.
I was informed by other learners and staff, that labs are running successfully now.
5.
