Llama 3.1 8B is now deprecated on together.ai

Course Q&A Retrieval Augmented Generation
,
1

The Llama 3.1 8B model, available via the together.ai API via the name “meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo” is deprecated as of March 6th, 2026 (source: Deprecations - Together AI Docs).

This model seems to be used throughout the course, and is certainly used in the coding assignments (such as C1M2_Assignment, which is where I first ran into this issue).

Two questions:

  • What alternative model from together.ai should we use instead?
  • Will the built-in scripts supporting the assignments be changed to use a model that is not deprecated?

Thank you for your help!

Antoine

2

Hey Antoine, the utils.py has been recently updated to use Qwen model (Qwen/Qwen3.5-9B) instead of the depreciated Llama-3.1-8B model. Can you please check if all works fine for you or something has been missed during that update?
Thanks!