In Retrieval Augmented Generation (RAG) Course, I’m stuck in Module 4 - Developing a RAG-Based Chatbot graded assignment.
I get the error when I run the code.
InvalidRequestError: Error code: 400 - {“message”: “Unable to access non-serverless model meta-llama/Llama-3.2-3B-Instruct-Turbo. Please visit Together AI | The AI Native Cloud to create and start a new dedicated endpoint for the model.”, “type_”: “invalid_request_error”, “code”: “model_not_available”}
Do you know how to fix it?
Regards,
Kim
staff has been reported about this issue, please wait for update from staff or for my response when staff updates me after resolving the issue.
hi @kimmartinezb
staff updated information
together.ai has deprecated a lot of models in the past days resulting in concurrent issues with labs of RAG courses.
Lab assignment 3 to 5 and all ungraded labs are updated now.
You need to Restore original version, to get the updated notebook.
I also would recommend to first delete the old file, and restore original version, so any cache issue is not encountered when running codes again.
Courses, labs are created with multiple channels, so labs gets affected when any changes.made at one end and can take multiple attempts to resolve issue.
Let us know if you still continue to have issue
Regards
Dr. Deepti
Hi @Deepti_Prasad
I’ve been able to do part of the graded assignment, but now I get a similar error in Module 5.
I’ve capturated the error.
ERROR REAL: InvalidRequestError Error code: 400 - {"message": "Unable to access non-serverless model meta-llama/Llama-3.2-3B-Instruct-Turbo. Please visit https://api.together.ai/models/meta-llama/Llama-3.2-3B-Instruct-Turbo to create and start a new dedicated endpoint for the model.", "type_": "invalid_request_error", "code": "model_not_available"}
did you by any chance try to re-run a cell after running down codes, I noticed even I experienced this once when I ran down a cell till exercise and went back running the import cell, caused me the same error you got.
One another learner encounter an oserror, which mentioned information, that import cell should be only run down once and running down twice will kill the kernel. So I had clear out the kernel output first, and run the cells from beginning individually to resolve this issue.
Also please post screenshot of the codes which caused this error, of you get again this error.
Please try this and let me know.
Regards
Dr. Deepti
Hi @Deepti_Prasad
I’ve only run the import cell once.
I’ve killed the kernel and run the cells from the beginning, and it still fails.
okay i will inform staff.
did the same import codes threw this error ?
I checked myself doing the assignment, and didn’t encounter any error for lab assignment after i restored the original version again.
So kindly either try again Restore original version, or post screenshot of which part of assignment you encountered error with error also in the screenshot.
I was informed by other learners and staff, that labs are running successfully now.
Hi @Deepti_Prasad ,
I’ve done again the lab assignment and it fails in the same place:
I’ve added a print of the error:
My change is simple:
Thanks for your support,
Kim
@kimmartinezb
thank you for the images.
