Unable to load Data Set in the terminal to continue with the task of Summarize Dialogue
Generative AI with Large Language Models
Lab1 Generative AI Use Case Summarize Dialogue
No error after execute the code pip install -U
datasets==2.17.0
transformers==4.38.2
evaluate==0.4.0
rouge_score==0.1.2
peft==0.3.0 --quiet
The next step related to load data sets is blocked or I did not find the way to importthe Data sets neither in the terminal nor the instructions:
Load the datasets, Large Language Model (LLM), tokenizer, and configurator. Do not worry if you do not understand yet all of those components - they will be described and discussed later in the notebook.
from datasets import load_dataset
from transformers import AutoModelForSeq2SeqLM
from transformers import AutoTokenizer
from transformers import GenerationConfig
Please guide me how to import it to continue with the task
