Decoder padding Mask Transformer Architecture

Course Q&A Deep Learning Specialization Sequence Models
1

Hi Mentor,

In the Transformer Architecture, why padding mask performed in at the decoder layer ?

dec_padding_mask – Boolean mask for the second multihead attention layer

2

Hi Anbu,

The padding mask needs to be applied to the K and V coming from the encoder.