ModuleNotFoundError: No module named 'torch.distributed'

Course Q&A Generative AI with Large Language Models
1

I’m getting this error when running the import cell

> ModuleNotFoundError: No module named 'torch.distributed'
> 
> The above exception was the direct cause of the following exception:
> 
> RuntimeError                              Traceback (most recent call last)
> <ipython-input-7-31647e9def8f> in <module>
>       1 from datasets import load_dataset
> ----> 2 from transformers import AutoModelForSeq2SeqLM, AutoTokenizer, GenerationConfig, TrainingArguments, Trainer
>       3 import torch
>       4 import time
>       5 import evaluate

it comes from here

RuntimeError: Failed to import transformers.training_args because of the following error (look up to see its traceback):
No module named 'torch.distributed'
2

Hi David. You might have figured this out already. For other learners, it’s most likely that the package installations before that cell didn’t complete successfully. Kindly re-run that and see if the error persists. Thanks!

3

This problem is reoccurring,
RuntimeError: Failed to import transformers.training_args because of the following error (look up to see its traceback):
No module named ‘torch.distributed’

I have installed the previous packages correctly.