In Pretraining LLM Course

Short Course Q&A Pretraining LLMs
1

The following code, import datasets
pretraining_dataset = datasets.load_dataset(
“upstage/Pretraining_Dataset”,
split=“train”
) – Gives the following error : DatasetNotFoundError Traceback (most recent call last)
Cell In[3], line 2
1 import datasets
----> 2 pretraining_dataset = datasets.load_dataset(
3 “upstage/Pretraining_Dataset”,
4 split=“train”
5 ) – Any suggestions

2

Hi, are you running this code locally on your device?