{moderator edit - solution code removed} I made the code above,and get the following results. [image] It seems to me that something is wrong with my code,and as a result,the attention weights is different from the right result,but I can’t tell where is the wrong point in my code. Please help.

For the attention_weights, I recommend you use the tf.keras.activations.softmax(…) function. For output, you should compute the matrix product of attention_weights and v.

I have stuck with Course 5 Week 4 Assignments1 Ex3

Course Q&A Deep Learning Specialization Sequence Models

sushantnair August 17, 2024, 4:24pm 11

Hi Paul,

Thank you so much for helping, but my problem got solved:

So glad it got solved…

1 Like

Topic		Replies	Views
C5_W4_A1 assignment Exercise 3 Sequence Models	5	424	February 8, 2024
W4 A1 \| Ex-3 \| Scaled Dot Product Attention Sequence Models	27	3208	March 24, 2025
Week 4 A1 problem with scaled_dot_product_attention Sequence Models week-4	6	63	September 6, 2024
C4W2_Assignment in Natural Language Processing with Attention NLP with Attention Models week-3	2	62	September 2, 2024
Wrong masked weights error Sequence Models	2	812	September 22, 2021

I have stuck with Course 5 Week 4 Assignments1 Ex3

Related topics