In the week 1 lab while calculating the loss of discriminator we call detach on the output from the generator because if we run update we don’t want the generator model weights to be updated, in a similar fashion when we are calculating the loss for the generator we don’t want the discriminator mode…

Reason for detach not being called in generator loss function

paulinpaloalto June 12, 2023, 2:02am 2

It turns out the situation is fundamentally asymmetric. This question comes up pretty frequently and here’s a thread which discusses it in some detail.

2 Likes

Reason for detach not being called in generator loss function