Week 4 A1 problem with scaled_dot_product_attention

[Deepti_Prasad]

(3,4) is expected at the shape where codes are asserting it incorrectly.

So you need to check when the weights asserted to the q.shape[0] and k.shape[1], the shapes are not matching here, perhaps check codes on how you scaled the matmul_qk or where you add mask to the scaled tensor (missed an extra tuple??)

Help needed for C5W4A1 EX-3

Your error is stating to check codes for masked weight i.e. add the mask to the scaled tensor. The boolean mask parameter can be passed in as none or as either padding or look-ahead. Multiply ((1. - mask) * -1e9) before applying the softmax. Perhaps check if you missed that extra tuple as you add to the scaled attention logits, not placing the tuple can cause error. Regards DP