C4_W1_Lab_2_TFS_Docker.md

Course Q&A Machine Learning Engineering for Production(MLOps) Deploying Machine Learning Models in Production
1

Hi there,

After running the command:docker run --rm -p 8501:8501
–mount type=bind,
source=/tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu,
target=/models/half_plus_two
-e MODEL_NAME=half_plus_two -t tensorflow/serving

I got the following error:
Error in Docker logs:
2024-04-05 11:57:51 2024-04-05 08:57:51.006042: W tensorflow_serving/sources/storage_path/file_system_storage_path_source.cc:252] No versions of servable half_plus_two found under base path /models/half_plus_two. Did you forget to name your leaf directory as a number (eg. ‘/1/’)?

Please advise on this.

1 Like
2

Please share the following details:

  1. Output of ls -lR /tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu
  2. Your OS / docker version.
  3. Does removing tensorflow/serving and pulling it again solve the issue?
3

Hi balaji,
Thank you for your reply. Here is the info requested:

  1. output:
    /tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu:
    total 0

  2. Docker and OS version:
    Client:
    Cloud integration: v1.0.35+desktop.11
    Version: 25.0.3
    API version: 1.44
    Go version: go1.21.6
    Git commit: 4debf41
    Built: Tue Feb 6 21:13:00 2024
    OS/Arch: linux/amd64
    Context: default

Server: Docker Desktop
Engine:
Version: 25.0.3
API version: 1.44 (minimum version 1.24)
Go version: go1.21.6
Git commit: f417435
Built: Tue Feb 6 21:14:25 2024
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: 1.6.28
GitCommit: ae07eda36dd25f8a1b98dfbf587313b99c0190bb
runc:
Version: 1.1.12
GitCommit: v1.1.12-0-g51d5e94
docker-init:
Version: 0.19.0
GitCommit: de40ad0
OS:
Edition Windows 10 Pro
Version 22H2
Installed on ‎1/‎23/‎2021
OS build 19045.4170
Experience Windows Feature Experience Pack 1000.19054.1000.0
3. Removing and pulling doesn’t solve the issues. The error message remains the same.
Regards,
Lachezar

4

There’s a problem with the way the respository is managed on your machine.
Either undo your changes via git reset --hard HEAD or remove the repository and clone it again.

This is the expected directory structure:

$ tree -sh /tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu
[  60]  /tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu
└── [ 100]  00000123
    ├── [  60]  assets
    │   └── [  19]  foo.txt
    ├── [ 12K]  saved_model.pb
    └── [  80]  variables
        ├── [  20]  variables.data-00000-of-00001
        └── [ 172]  variables.index

Here’s the git repo path for the same directory.

1 Like