Allocation of 376320000 exceeds 10% of system memory. Tests failed on 1 cell(

Course Q&A TensorFlow: Advanced Techniques Specialization Custom Models, Layers and Loss Functions with TF
1

In the Week 3 Assignment of Custom Models, Layers, and Loss Functions with TensorFlow course - get the following error:- low

Allocation of 376320000 exceeds 10% of system memory. Tests failed on 1 cell(

Pasting full error below; while running assignment in Colab it runs fine; get the error on ‘submit’ assignment; and grader throws following error:-

ValidateApp | INFO] Validating ‘/home/jovyan/work/submitted/courseraLearner/W3_Assignment/C1W3_Assignment.ipynb’ [ValidateApp | INFO] Executing notebook with kernel: python3 2021-08-23 03:51:22.973540: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libnvinfer.so.6’; dlerror: libnvinfer.so.6: cannot open shared object file: No such file or directory 2021-08-23 03:51:22.973622: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libnvinfer_plugin.so.6’; dlerror: libnvinfer_plugin.so.6: cannot open shared object file: No such file or directory 2021-08-23 03:51:22.973633: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2021-08-23 03:51:23.618880: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libcuda.so.1’; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory 2021-08-23 03:51:23.618915: E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303) 2021-08-23 03:51:23.618940: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (somehost): /proc/driver/nvidia/version does not exist 2021-08-23 03:51:23.619210: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA 2021-08-23 03:51:23.624868: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2999995000 Hz 2021-08-23 03:51:23.625595: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f01ab2ec910 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2021-08-23 03:51:23.625626: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2021-08-23 03:51:24.586326: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 376320000 exceeds 10% of system memory. Tests failed on 1 cell(s)! These tests could be hidden. Please check your submission.

2021-08-23 04:05:41.603950: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libnvinfer.so.6’; dlerror: libnvinfer.so.6: cannot open shared object file: No such file or directory 2021-08-23 04:05:41.604034: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libnvinfer_plugin.so.6’; dlerror: libnvinfer_plugin.so.6: cannot open shared object file: No such file or directory 2021-08-23 04:05:41.604045: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2021-08-23 04:05:42.387451: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library ‘libcuda.so.1’; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory 2021-08-23 04:05:42.387487: E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303) 2021-08-23 04:05:42.387511: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (somehost): /proc/driver/nvidia/version does not exist

2

the submission failed because, few of the files of TensorFlow couldnt be installed in your directory library. Make sure GPU setting is allocated properly and/or your system or account has memory space if you are using google collaborate.

if there is still an issue then a technical person would be ideal person to address the issue

3

imo, the issue is with the evaluation, not during the model training

4

I think we tackled this issue back then somehow…Could not load dynamic library 'libnvinfer.so. Allocation of 376320000 exceeds 10% of system memory. Tests failed on 1 cell(s)! These tests could be hidden6'

5

Before submitting, please make sure to follow these steps to avoid getting timeout issues with the grader:

  1. Make sure to pass all public tests and get an accuracy greater than 97%.
  2. Click inside the training code cell above.
    3.3. Select all lines in this code cell with Ctrl+A (Windows/Linux) or Cmd+A (Mac), then press Ctrl+/ (Windows/Linux) or Cmd+/ (Mac) to comment the entire block. All lines should turn green as before.*
  3. From the menu bar, click File > Save and Checkpoint. This is important.
  4. Once saved, click the Submit Assignment button.

As given in instructions at the last of assignment Comment the code in training cell it is causing problem for grader.