HI!

I’m getting this error:

InvalidArgumentError: Value for attr ‘T’ of int32 is not in the list of allowed values: bfloat16, half, float, double, complex64, complex128

; NodeDef: {{node Sqrt}}; Op<name=Sqrt; signature=x:T → y:T; attr=T:type,allowed=[DT_BFLOAT16, DT_HALF, DT_FLOAT, DT_DOUBLE, DT_COMPLEX64, DT_COMPLEX128]> [Op:Sqrt]

and the traceback signals the line

scaled_attention_logits = matmul_qk / tf.math.sqrt(dk)

I have calculated dk with the first element of k’s shape and matmul with tf.matmul, transposing the b element (k in this case), so I don’t really know what’s wrong with this line.

May someone please throw some light on this issue? Thanks in advance!