{moderator edit - solution code removed} I made the code above,and get the following results. [image] It seems to me that something is wrong with my code,and as a result,the attention weights is different from the right result,but I can’t tell where is the wrong point in my code. Please help.

For the attention_weights, I recommend you use the tf.keras.activations.softmax(…) function. For output, you should compute the matrix product of attention_weights and v.

I recommend you read the instructions for Exercise 3 carefully for how to apply the mask.

Hello, I apologize for reviving a solved topic, but I feel I need clarification on something and in my opinion the best way would be to ask right here so that the context is clear. My doubt is about the matmul_qk and dk code. I had absolutely no clue how to do it until by God’s grace I stumbled up…

For matmul_qk, they literally write out the formula for you: QK^T. You just have to remember Prof Ng’s notational conventions which have been absolutely consistent from the very beginning of DLS Course 1: when he writes two array, vector or tensor arguments adjacent with no explicit operator, that m…

[image] sushantnair: Hi, I have some implementation doubts and have sent an invite to you for a DM. Please help me by looking at my code. Hi, I have some implementation doubts and have sent an invite to you for a DM. Please help me by looking at my code.

Sure, I will respond in about an hour. Am away from my computer now. But if you copied all the code from that other thread, there are a number of problems with it. E.g. there should be no calls to the normalize function.

Also note that I can’t directly see your code. Please download your notebook and attach it to a reply on your DM thread.

Hi Paul, Thank you so much for helping, but my problem got solved: [image] Help needed for C5W4A1 EX-3 Sequence Models [image] Please help me. The code I have written is along the lines as discussed in these posts: So glad it got solved…

I have stuck with Course 5 Week 4 Assignments1 Ex3

Course Q&A Deep Learning Specialization Sequence Models

sushantnair August 17, 2024, 4:24pm 11

Hi Paul,

Thank you so much for helping, but my problem got solved:

So glad it got solved…

Topic		Replies	Views
C5 W4 A1 Ex-3 Bad attention_weights values Sequence Models coursera-platform	5	679	October 18, 2022
C5_W4_A1 scaled_dot_product_attention "wrong unmasked weights" Sequence Models week-module-4 , coursera-platform	3	101	July 10, 2024
W4 A1 UNQ_C3 assignment for Sequence models class Sequence Models week-module-4 , coursera-platform	18	414	July 9, 2024
C5 W4 A1 E3AssertionError: Wrong unmasked weights Sequence Models week-module-4 , coursera-platform	7	452	October 30, 2025
C5_W4_A1 assignment Exercise 3 Sequence Models coursera-platform	5	477	February 8, 2024

I have stuck with Course 5 Week 4 Assignments1 Ex3

Related topics