Scaled_dot_product_attention(q, k, v, mask) function:

[jonaslalin]

Maybe you use the tensorflow tutorial:

Course 5 Week 4 assignment scaled_dot_product_attention_test error

Nevermind I used the code from TensorFlow it’s (mask * -1e9) but in assignment it’s (1-mask) * - 1e9