Deep Learning Specialization- Course 5- Week 4

Course Q&A Deep Learning Specialization Sequence Models
1

I am continuously getting below error while execution of fucntion
‘scaled_dot_product_attention’

Please confirm how I can solve the problem and if someone else is also facing same error

Error-

AssertionError Traceback (most recent call last)
in
1 # UNIT TEST
----> 2 scaled_dot_product_attention_test(scaled_dot_product_attention)

~/work/W4A1/public_tests.py in scaled_dot_product_attention_test(target)
73 assert np.allclose(weights, [[0.30719590187072754, 0.5064803957939148, 0.0, 0.18632373213768005],
74 [0.3836517333984375, 0.3836517333984375, 0.0, 0.2326965481042862],
—> 75 [0.3836517333984375, 0.3836517333984375, 0.0, 0.2326965481042862]]), “Wrong masked weights”
76 assert np.allclose(attention, [[0.6928040981292725, 0.18632373213768005],
77 [0.6163482666015625, 0.2326965481042862],

AssertionError: Wrong masked weights

2

Hi @arush185 ,

There is a reminder in the implementation notes:
Reminder : The boolean mask parameter can be passed in as none or as either padding or look-ahead. Multiply (1. - mask) by -1e9 before applying the softmax.

How did you implement this step?