In UNQ_C5, CausalAttention is defined as:
def CausalAttention(d_feature,
n_heads,
compute_attention_heads_closure=compute_attention_heads_closure,
dot_product_self_attention=dot_product_self_attention,
compute_attention_output_closure=compute_attention_output_closure,
mode=‘train’):
I cannot see where the “mode” parameter is used. But all tests still pass.
Hello @larryleguo!
You are totally sure. Actually, this parameter is not obligatory and can be not used. It exists only to make the function generic if anyone want to use it.
Thank you for the advice!
Best regards,
Wesley P.