Lab 1 - Generative AI Use Case: Summarize Dialogue - Error in downloading required libraries

nazneen3447 · April 17, 2025, 7:18am

Hi Team,

Getting below error after running cell for downloading libraries. Please assist on this issue.

First upgrade pip

%pip install --upgrade pip

Install tensorflow and keras first

%pip install tensorflow==2.12.0 keras==2.12.0

Install torch and torchdata

%pip install --no-deps torch==1.13.1 torchdata==0.6.0 --quiet

Then install other packages except TRL

%pip install -U
datasets==2.17.0
transformers==4.27.2
evaluate==0.4.0
rouge_score==0.1.2
peft==0.3.0 --quiet

Requirement already satisfied: pip in /opt/conda/lib/python3.12/site-packages (25.0.1)
Note: you may need to restart the kernel to use updated packages.
ERROR: Could not find a version that satisfies the requirement tensorflow==2.12.0 (from versions: 2.16.0rc0, 2.16.1, 2.16.2, 2.17.0rc0, 2.17.0rc1, 2.17.0, 2.17.1, 2.18.0rc0, 2.18.0rc1, 2.18.0rc2, 2.18.0, 2.18.1, 2.19.0rc0, 2.19.0)
ERROR: No matching distribution found for tensorflow==2.12.0
Note: you may need to restart the kernel to use updated packages.
ERROR: Could not find a version that satisfies the requirement torch==1.13.1 (from versions: 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0)
ERROR: No matching distribution found for torch==1.13.1
Note: you may need to restart the kernel to use updated packages.
error: subprocess-exited-with-error

× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [62 lines of output]
/tmp/pip-build-env-uohl0krl/overlay/lib/python3.12/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!

          ********************************************************************************
          Please consider removing the following classifiers in favor of a SPDX license expression:
  
          License :: OSI Approved :: Apache Software License
  
          See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
          ********************************************************************************
  
  !!
    self._finalize_license_expression()
  running bdist_wheel
  running build
  running build_py
  creating build/lib.linux-x86_64-cpython-312/tokenizers
  copying py_src/tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers
  creating build/lib.linux-x86_64-cpython-312/tokenizers/models
  copying py_src/tokenizers/models/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/models
  creating build/lib.linux-x86_64-cpython-312/tokenizers/decoders
  copying py_src/tokenizers/decoders/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/decoders
  creating build/lib.linux-x86_64-cpython-312/tokenizers/normalizers
  copying py_src/tokenizers/normalizers/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/normalizers
  creating build/lib.linux-x86_64-cpython-312/tokenizers/pre_tokenizers
  copying py_src/tokenizers/pre_tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/pre_tokenizers
  creating build/lib.linux-x86_64-cpython-312/tokenizers/processors
  copying py_src/tokenizers/processors/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/processors
  creating build/lib.linux-x86_64-cpython-312/tokenizers/trainers
  copying py_src/tokenizers/trainers/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/trainers
  creating build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/base_tokenizer.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/bert_wordpiece.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/byte_level_bpe.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/char_level_bpe.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/sentencepiece_bpe.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  copying py_src/tokenizers/implementations/sentencepiece_unigram.py -> build/lib.linux-x86_64-cpython-312/tokenizers/implementations
  creating build/lib.linux-x86_64-cpython-312/tokenizers/tools
  copying py_src/tokenizers/tools/__init__.py -> build/lib.linux-x86_64-cpython-312/tokenizers/tools
  copying py_src/tokenizers/tools/visualizer.py -> build/lib.linux-x86_64-cpython-312/tokenizers/tools
  copying py_src/tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers
  copying py_src/tokenizers/models/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/models
  copying py_src/tokenizers/decoders/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/decoders
  copying py_src/tokenizers/normalizers/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/normalizers
  copying py_src/tokenizers/pre_tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/pre_tokenizers
  copying py_src/tokenizers/processors/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/processors
  copying py_src/tokenizers/trainers/__init__.pyi -> build/lib.linux-x86_64-cpython-312/tokenizers/trainers
  copying py_src/tokenizers/tools/visualizer-styles.css -> build/lib.linux-x86_64-cpython-312/tokenizers/tools
  running build_ext
  running build_rust
  error: can't find Rust compiler
  
  If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.
  
  To update pip, run:
  
      pip install --upgrade pip
  
  and then retry package installation.
  
  If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (tokenizers)
Note: you may need to restart the kernel to use updated packages.

gent.spah · April 17, 2025, 8:11am

Hi, I have notified the QA team about this issue!

bhaond007 · April 17, 2025, 8:49am

Same issue for me , I have made some changes to work on the script
how can I reset?

hieudang · April 17, 2025, 5:48pm

Experiencing the same issue, please assist in unblocking the session.
Thanks a lot!

chris.favila · April 17, 2025, 8:18pm

Hi everyone. I’ve escalated this issue to our partners. In the meantime, please manually edit the pip install block and use 4.38.2 for the transformers package instead of 4.27.2. That worked for the labs I tested. Remember to restart the kernel before importing. Still waiting for updates. Thank you, and sorry for the inconvenience.

Blade_of_Poros · April 17, 2025, 9:27pm

Hi Chris,

Thank you for working on this. However, there are still other version issues after:

Requirement already satisfied: pip in /opt/conda/lib/python3.12/site-packages (25.0.1)
Note: you may need to restart the kernel to use updated packages.
ERROR: Could not find a version that satisfies the requirement tensorflow==2.12.0 (from versions: 2.16.0rc0, 2.16.1, 2.16.2, 2.17.0rc0, 2.17.0rc1, 2.17.0, 2.17.1, 2.18.0rc0, 2.18.0rc1, 2.18.0rc2, 2.18.0, 2.18.1, 2.19.0rc0, 2.19.0)
ERROR: No matching distribution found for tensorflow==2.12.0
Note: you may need to restart the kernel to use updated packages.
ERROR: Could not find a version that satisfies the requirement torch==1.13.1 (from versions: 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0)
ERROR: No matching distribution found for torch==1.13.1
Note: you may need to restart the kernel to use updated packages.
Note: you may need to restart the kernel to use updated packages.

chris.favila · April 17, 2025, 11:02pm

Hi. You can safely ignore those. Those are the expected errors referred to in the videos and markdown. Thanks.

Girijesh · April 18, 2025, 4:53am

Dear @nazneen3447,
I hope you’re doing well. I wanted to follow up and ask if the issue you were facing has been resolved. If not, please feel free to share your notebook with me via private message. I’ll be happy to review it and assist you in identifying and resolving the problem.

chris.favila · April 18, 2025, 5:45am

Hi everyone. While waiting for the proper notebook updates. Please replace the pip install cell for each lab with the following. Marking this as the solution for visibility.

Lab 1:

# First upgrade pip
%pip install --upgrade pip

# Install tensorflow and keras first
%pip install tensorflow==2.18.0 keras==3.9.0

# Install torch and torchdata
%pip install --no-deps torch==2.5.1 torchdata==0.6.0 --quiet

# Then install other packages except TRL
%pip install -U \
    datasets==2.17.0 \
    transformers==4.38.2 \
    evaluate==0.4.0 \
    rouge_score==0.1.2 \
    peft==0.3.0 --quiet

Lab 2: (no need for trl here so that line was also deleted)

# First upgrade pip
%pip install --upgrade pip

# Install tensorflow and keras first
%pip install tensorflow==2.18.0 keras==3.9.0

# Install torch and torchdata
%pip install --no-deps torch==2.5.1 torchdata==0.6.0 --quiet

# Then install other packages except TRL
%pip install -U \
    datasets==2.17.0 \
    transformers==4.38.2 \
    evaluate==0.4.0 \
    rouge_score==0.1.2 \
    peft==0.3.0 --quiet

Lab 3:

# First upgrade pip
%pip install --upgrade pip

# Install tensorflow and keras first
%pip install tensorflow==2.18.0 keras==3.9.0

# Install torch and torchdata
%pip install --no-deps torch==2.5.1 torchdata==0.6.0 --quiet

# Then install other packages except TRL
%pip install -U \
    datasets==2.17.0 \
    transformers==4.38.2 \
    evaluate==0.4.0 \
    rouge_score==0.1.2 \
    peft==0.3.0 --quiet

# TRL installation
%pip install --no-deps git+https://github.com/lvwerra/trl.git@25fa1bd

nazneen3447 · April 18, 2025, 11:27am

Thank you Chris, able to download libraries now.

nazneen3447 · April 18, 2025, 11:28am

Hi Girijesh,

Issue is resolved now. Thanks.

Girijesh · April 18, 2025, 1:53pm

Sounds good.

Feel free to contact me.

hieudang · April 18, 2025, 5:28pm

Saving the world, thanks Girijesh and Chris

chris.favila · April 19, 2025, 2:39pm

Hi everyone! The notebooks have been updated so new learners should have the pip installs already and don’t need to manually edit. Thanks!

Topic		Replies	Views
April 18, 2025: Lab 3, Python 3.12 not compatible with the given libraries Generative AI with Large Language Models project	1	13	April 19, 2025
Lab 1 of Week 1 Summarize Dialogue Generative AI with Large Language Models project	1	40	March 29, 2025
Lab 2 error on the pip install step Generative AI with Large Language Models project	8	65	April 18, 2025
[Troubleshooting] Week #2 Lab -- Failed Import Generative AI with Large Language Models lab-help	2	35	March 8, 2025
Error while importing the necessary requirements for Week 2 lab Generative AI with Large Language Models week-2	3	515	August 3, 2023

Lab 1 - Generative AI Use Case: Summarize Dialogue - Error in downloading required libraries

First upgrade pip

Install tensorflow and keras first

Install torch and torchdata

Then install other packages except TRL

Related topics