C5W4A1 Attention(Q,K,V) why we use matmul not dot product

Course Q&A Deep Learning Specialization Sequence Models
1

C5W4A1 Why attention formula in a transformer assignment formula (4) in the assignment means to use matmul instead of dot product? Isn’t matmul usually indicated by * and without it means dot product?

2

No, both tf.matmul and np.matmul are dot product style multiply.

2 Likes
3

Np.multiply is element-wise, and equivalent to *.

4

Oh, I got it. I thought matmul is element-wise multiplication. Thanks!