Need help with Install tfx in Docker & Run C3_W1_Lab_2_TFX_Tuner_and_Trainer

Hello friends,

I have finished the MLOps specialization recently. I want to do experiments and review the tfx pipeline with custom dataset. I want to run the python environment in docker.
I figured out Docker is very handy. Here is the argument blog for it: Supercharging AI/ML Development with JupyterLab and Docker | Docker.
I modified the image with python 3.7.12 version and printout the requirements from coursera jupyter notebook for C3_W1_Lab_2_TFX_Tuner_and_Trainer
I tried to install tensorflow dependencies (such as tfx, tensorflow, tensorflow-metadata and etc.)

What I am receiving:

ERROR: Could not find a version that satisfies the requirement tfx-bsl<1.13.0,>=1.12.0 (from tensorflow-transform) (from versions: none)
ERROR: No matching distribution found for tfx-bsl<1.13.0,>=1.12.0

I believe here the issue is with versions of libraries does not match.

Later on

I have tried to install the latest version of the libraries.
Result:

                             ..........
  e[31m   e[0m     raise OSError("%r was not found" % name)
  e[31m   e[0m OSError: 'git' was not found
  e[31m   e[0m e[31m[end of output]e[0m

Here is the requirements of the python environment from C3_W1_Lab_2_TFX_Tuner_and_Trainer notebook

absl-py==1.4.0
alembic==1.4.2
apache-beam==2.46.0
argcomplete==3.0.8
astunparse==1.6.3
async-generator==1.10
attrs==21.4.0
backcall==0.1.0
beautifulsoup4==4.9.0
bleach==3.1.4
blinker==1.4
bokeh==2.0.1
boto==2.49.0
Bottleneck==1.3.2
brotlipy==0.7.0
cachetools==4.2.4
certifi==2020.4.5.1
certipy==0.1.3
cffi==1.14.0
chardet==3.0.4
charset-normalizer==3.1.0
click==7.1.2
cloudpickle==2.2.1
conda==4.8.2
conda-package-handling==1.6.0
crcmod==1.7
cryptography==2.9.2
cycler==0.10.0
Cython==0.29.17
cytoolz==0.10.1
dask==2.15.0
decorator==4.4.2
defusedxml==0.6.0
dill==0.3.1.1
distributed @ file:///home/conda/feedstock_root/build_artifacts/distributed_1588346785822/work
dm-tree==0.1.8
docker==4.4.4
docopt==0.6.2
entrypoints==0.3
etils==0.9.0
fairness-indicators==0.43.0
fastavro==1.7.4
fastcache==1.1.0
fasteners==0.18
flatbuffers==23.3.3
fonttools==4.38.0
fsspec==0.7.3
gast==0.4.0
gcs-oauth2-boto-plugin==3.0
gmpy2==2.1.0b1
google-api-core==1.32.0
google-api-python-client==1.12.11
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-aiplatform==1.17.1
google-cloud-bigquery==2.34.4
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-language==1.3.2
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-resource-manager==1.6.3
google-cloud-spanner==3.26.0
google-cloud-storage==2.9.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-reauth==0.1.1
google-resumable-media==2.5.0
googleapis-common-protos==1.59.0
grpc-google-iam-v1==0.12.6
grpcio==1.54.0
grpcio-status==1.48.2
gsutil==4.61
h5py==2.10.0
hdfs==2.7.0
HeapDict==1.0.1
httplib2==0.21.0
idna==2.9
imageio==2.8.0
importlib-metadata==6.6.0
importlib-resources==5.12.0
ipykernel==5.2.1
ipympl==0.5.6
ipython @ file:///home/conda/feedstock_root/build_artifacts/ipython_1588362967322/work
ipython-genutils==0.2.0
ipywidgets==7.5.1
jedi==0.17.0
Jinja2==2.11.2
joblib==1.2.0
json5==0.9.0
jsonschema==3.2.0
jupyter-client==6.1.3
jupyter-core==4.6.3
jupyter-telemetry==0.0.5
jupyterhub==1.1.0
jupyterlab==2.1.1
jupyterlab-server==1.1.1
keras==2.11.0
keras-tuner==1.2.0
kiwisolver==1.2.0
kt-legacy==1.0.5
kubernetes==12.0.1
libclang==16.0.0
llvmlite==0.31.0
locket==0.2.0
Mako==1.1.0
Markdown==3.4.3
MarkupSafe==2.0.1
matplotlib==3.5.3
mistune==0.8.4
ml-metadata==1.12.0
ml-pipelines-sdk==1.12.0
mock==2.0.0
monotonic==1.6
mpmath==1.1.0
msgpack==1.0.0
nbconvert==5.6.1
nbformat==5.0.6
networkx==2.4
notebook==6.0.3
numba==0.48.0
numexpr==2.7.1
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.0.1
objsize==0.6.1
olefile==0.46
opt-einsum==3.3.0
orjson==3.8.11
overrides==6.5.0
packaging==20.1
pamela==1.0.0
pandas==1.3.5
pandocfilters==1.4.2
parso==0.7.0
partd==1.1.0
patsy==0.5.1
pbr==5.11.1
pexpect==4.8.0
pickleshare==0.7.5
Pillow==7.1.2
portpicker==1.5.2
prometheus-client==0.7.1
promise==2.3
prompt-toolkit==3.0.5
proto-plus==1.22.2
protobuf==3.19.6
psutil==5.7.0
ptyprocess==0.6.0
pyarrow==6.0.1
pyasn1==0.5.0
pyasn1-modules==0.3.0
pycosat==0.6.3
pycparser==2.20
pycurl==7.43.0.5
pydot==1.4.2
pyfarmhash==0.3.2
Pygments==2.6.1
PyJWT==1.7.1
pymongo==3.13.0
pyOpenSSL==19.1.0
pyparsing==2.4.7
pyrsistent==0.16.0
PySocks==1.7.1
python-dateutil==2.8.1
python-editor==1.0.4
python-json-logger==0.1.11
python-snappy==0.6.1
pytz==2020.1
pyu2f==0.1.5
PyWavelets==1.1.1
PyYAML==5.3.1
pyzmq==19.0.0
regex==2023.5.5
requests==2.30.0
requests-oauthlib==1.3.1
retry-decorator==1.1.1
rsa==4.7.2
ruamel-yaml==0.15.80
ruamel.yaml.clib==0.2.0
scikit-image==0.16.2
scikit-learn==0.22.2.post1
scipy==1.4.1
seaborn==0.11.0
Send2Trash==1.5.0
six==1.14.0
sortedcontainers==2.1.0
soupsieve==1.9.4
SQLAlchemy==1.3.16
sqlparse==0.4.4
statsmodels==0.11.1
sympy==1.5.1
tables==3.6.1
tblib==1.6.0
tensorboard==2.11.2
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-data-validation==1.12.0
tensorflow-datasets==4.8.2
tensorflow-estimator==2.11.0
tensorflow-hub==0.12.0
tensorflow-io-gcs-filesystem==0.32.0
tensorflow-metadata==1.12.0
tensorflow-model-analysis==0.43.0
tensorflow-serving-api==2.11.0
tensorflow-transform==1.12.0
termcolor==2.3.0
terminado==0.8.3
testpath==0.4.4
tfx==1.12.0
tfx-bsl==1.12.0
toml==0.10.2
toolz==0.10.0
tornado==6.0.4
tqdm==4.45.0
traitlets==4.3.3
typing_extensions==4.5.0
uritemplate==3.0.1
urllib3==1.25.9
vincent==0.4.4
wcwidth==0.1.9
webencodings==0.5.1
websocket-client==1.5.1
Werkzeug==2.2.3
widgetsnbextension==3.5.1
witwidget==1.8.1
wrapt==1.15.0
xlrd==1.2.0
zict==2.0.0
zipp==3.1.0
zstandard==0.21.0

Sincerely,
Sardor

Have you seen this?

1 Like