W4 mirrored strategy code walkthrough lecture

Dennis_Sinitsky · February 15, 2024, 1:16am

This is screen capture from 2:38 of the lecture:

The teacher says that the training replica is being broadcast onto GPU. But the pic shows CPU:0 broadcast to CPU:0. Can you elaborate what I am getting wrong.

gent.spah · February 15, 2024, 4:57am

Maybe there are no other CPU’s available to broadcast to…

Topic		Replies	Views
Weights update on multi GPU mirrored strategy Custom and Distributed Training with TF week-4	3	581	October 18, 2022
C2W4 Lab 2 Multi GPU Mirrored Strategy Loss Object Reduction is NONE rational Custom and Distributed Training with TF week-4	1	544	June 10, 2022
Running Notebooks on Local Windows Machine w/ Multiple GPUs Custom and Distributed Training with TF week-4	5	492	June 26, 2023
W2 Lecture Notes file seems to be for another course Data Pipelines with TensorFlow Data Services week-2	3	684	February 23, 2023
Failed to train on my desktop Custom Models, Layers and Loss Functions with TF week-4	1	520	October 6, 2022

W4 mirrored strategy code walkthrough lecture

Related topics