C5_W4_A1_Transformer_Subclass_v1: Why is look_ahead mask used before the padding_mask

Oleksandra_Sopova · October 31, 2023, 11:53pm

what markdown notes in sections 2.1 and 2.2 are you referring to? I am seeing only the pdfs (DLS Course 5: Lecture Notes). Could you please share the link to these markdown notes in sections 2.1 and 2.2?

Topic		Replies	Views
C4W2 Question about Decoder self-attention layer masks NLP with Sequence Models week-2	4	186	April 29, 2024
C4W2-Assignment Block 1 of DecoderLayer NLP with Attention Models week-2	1	20	April 9, 2025
Clarification on dec_padding_mask Sequence Models	1	546	April 6, 2022
Masked Attention Transformers Sequence Models	6	793	September 27, 2024
Intuition about the application of padding masks and look-ahead masks in Transformer's encoder/decoder Sequence Models	3	825	September 3, 2021

C5_W4_A1_Transformer_Subclass_v1: Why is look_ahead mask used before the padding_mask

Related topics