Lab 3: ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts

  • Week 3

  • Link to the classroom item you are referring to:
    I’m not allowed to put links in a post. This is related to Lab 3 - Fine-tune FLAN-T5 with reinforcement learning to generate more-positive summaries

  • Description:

Getting new errors in Lab 3 each time I’ve tried to complete it.

Last week it was the HTTP Timeout error which is described in other threads.
This week it’s related to Pip’s dependency in Step 2 (Now install the required packages to use PyTorch and Hugging Face transformers and datasets) of the notebook.

ERROR: pip’s dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
autogluon-multimodal 1.2 requires nvidia-ml-py3==7.352.0, which is not installed.
autogluon-common 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
autogluon-core 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
autogluon-features 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
autogluon-multimodal 1.2 requires jsonschema<4.22,>=4.18, but you have jsonschema 4.23.0 which is incompatible.
autogluon-multimodal 1.2 requires nltk<3.9,>=3.4.5, but you have nltk 3.9.1 which is incompatible.
autogluon-multimodal 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
autogluon-multimodal 1.2 requires omegaconf<2.3.0,>=2.1.1, but you have omegaconf 2.3.0 which is incompatible.
autogluon-tabular 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
autogluon-timeseries 1.2 requires numpy<2.1.4,>=1.25.0, but you have numpy 1.23.5 which is incompatible.
blis 1.0.1 requires numpy<3.0.0,>=2.0.0, but you have numpy 1.23.5 which is incompatible.
numba 0.61.0 requires numpy<2.2,>=1.24, but you have numpy 1.23.5 which is incompatible.
sparkmagic 0.21.0 requires pandas<2.0.0,>=0.17.1, but you have pandas 2.2.3 which is incompatible.
tf-keras 2.17.0 requires tensorflow<2.18,>=2.17, but you have tensorflow 2.12.0 which is incompatible.

It also causes the following error in Step 3 (Import the necessary components. Some of them are new for this week, they will be discussed later in the notebook.)

2025-03-01 12:03:14.536690: I tensorflow[/core/platform/cpu_feature_guard.cc:182]] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2025-03-01 12:03:15.412583: W tensorflow[/compiler/tf2tensorrt/utils/py_utils.cc:38]] TF-TRT Warning: Could not find TensorRT

Are you trying to run these labs locally?

Hi @gent.spah
No, I’m running these in the lab environment provided in the course ( Amazon Sagemaker AI Studio > Jupyter notebooks)

Is it just a warning or it stops the lab running any further?

I am running the Lab now and seems that all runs through, make sure that when you install dependecencies on the second cell to restart the Kerner on Kernel-> Restart Kernel.

Thanks @gent.spah

  • I tried running the lab again
  • Step 2 still contained the same error. ERROR: pip’s dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
  • I restarted the kernel after step 2.
  • Step 3 does not run.
    2025-03-08 16:52:49.772395: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2025-03-08 16:52:50.543257: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT

Can any course moderator able to help please?

@chris.favila Perhaps you can help?
Thanks in advance,
K

Hi K. As mentioned in Chris Fregly’s walkthrough in the classroom, those errors and warnings during installation can be ignored. The lab instructions in Vocareum or the notebook itself also mention ignoring the note about restarting the kernel. You can simply run them in sequence and not restart. Please upload a screenshot of the entire window so we’ll know what you mean by a step not running. If it just shows a warning but the cell is still active, then it should be fine. We’ll see after you upload a full window screenshot. Thanks!

Perhaps, but when I ran the Lab all the cells were running. Try one more thing: delete the current notebook, reopen the Lab, and do Run->Run All, or one by one the cells!

Hi, Last week, the subsequent steps weren’t executing at all after the errors in Step 2 and 3. This week they did. I was able to finish the lab. Thanks for looking into it!

I’m uploading the screenshots in case others come across the same issue:

  1. Restart the lab. Specifically, redo the SWS S3 copy step again.
  2. Keep going despite the pip’s dependency errors that you see in Step 2. Keep going despite the errors in Step 3.





1 Like

Glad to hear that, and thank you for the update!