Hello team,
I’m looking into utils.py to understand the code. I noticed that llama-3.2-8b is referenced, but I wasn’t able to find a matching model in the meta-llama repo.
The model was called here within the lab notebook:
Load error analysis model from utils
ERROR_CATEGORIES = [
“calculation_error”, # Math computation mistakes
“reasoning_error”, # Logical reasoning issues
“incomplete_solution”, # Partial or unfinished answers
“format_error”, # Wrong answer format
“other” # Other errors
]tokenizer, model, hf_model_available = load_error_analysis_model()
I then looked into load_error_analysis_model() in utils.py:
def load_error_analysis_model():
“”"
Load the error analysis model from local disk.
Returns:
tuple: (tokenizer, model, hf_model_available) where hf_model_available is bool
“”"
print(“Loading local model for error analysis…”)
try:local_model_path = ‘/app/models/llama-3.2-8b’
# Verify the model directory exists if not os.path.exists(local_model_path): raise FileNotFoundError(f"Model directory not found at: {local_model_path}") if not os.path.isdir(local_model_path): raise NotADirectoryError(f"Path exists but is not a directory: {local_model_path}") print(f"📦 Loading model from: {local_model_path}") # Load tokenizer from local path only print("Loading tokenizer...") tokenizer = AutoTokenizer.from_pretrained( local_model_path, local_files_only=True, trust_remote_code=True )
It appears llama-3.2-8b is the model being loaded. However, after checking Meta-llama repo on huggingface ( meta-llama (Meta Llama) ), I wasn’t able to locate a matching model – I may be looking in the wrong place. There is a mradermacher/Llama-3.2-8B-Instruct-GGUF · Hugging Face , but it looks different from the model used in this course and lab.
Questions for the instructor / community
-
Could
llama-3.2-8bbe a typo, or am I missing something about where this model is hosted? Or, should it bellama-3.1-8borllama-3-8b? -
What checkpoint was the course originally validated against? (Could you share the exact HuggingFace model ID or expected directory contents — e.g., does it contain
tokenizer.json,tokenizer.model, or both?)
Thanks in advances!
C.L.