Course 5 Week 4 assignment scaled_dot_product_attention_test error

I used the same implementation of Athena-Engine.
But got AssertionError: Wrong masked weights

I did some quite trick and found that the unit test has wrong mask and output.

I’m be able to by pass the unit test :smiley: but someone should really fix it.

What exactly do you mean by “Athena-Engine”?

There is no need to bypass the unit test.

If you have proof that the unit test is incorrect, please post it in detail, so we can notify the course staff.

Nevermind
I used the code from TensorFlow

it’s (mask * -1e9) but in assignment it’s (1-mask) * - 1e9

The course does not exactly follow the TensorFlow tutorials.