C5_W4_A1_Transformer_Subclass_v1 tuple has no rank

[Priyank_Khanna]

How do I solve this error. tried converting into numpy array as well

[TMosh]

Do not use np.array(), that’s not useful.
There appears to be a problem with your code for the scaled_attention_logits.

Also in “output = …”, you should use tf.matmul(), as the instructions suggest.

[TMosh]

Also, this thread is recommend reading:

C5 W4 A1 scaled_dot_product_attention - Tip

If you get an error from the tf.keras.activations.softmax() function about “tuple object has no attribute rank”, then be sure you used tf.matmul() when computing Q*K’. and not np.matmul(). The functions do the same thing, but tf.matmul() returns a tensor, which is what the Keras softmax() function requires.

[Priyank_Khanna]

Thanks a lot @TMosh sir. Yes this is what I was doing wrong.