[Week4] Transformer Network Decoder_test/Transformer_test

Course Q&A Deep Learning Specialization Sequence Models
1

image
image1138×25 7.88 KB

and

image
image824×188 21.9 KB

How to solve this?

2 Likes
3

Same question here. I was following the TF transformer guideline.

4

{mentor edit: hacks removed - no longer necessary}

5

image
{mentor edit: hacks removed - no longer necessary}

2 Likes
6

I have the same issue. Problem is something else in my opinion. I got the same output as you.

7

My DecoderLayer part works fine, but the decoder fails. This is my decoder call function coding part:

{mentor edit: code removed}

8

Mine is same as yours, Decoder call still fails. Here is my Decoder Layer, I have commented out two assertions and it passed the tests:

{mentor edit: code removed}

1 Like
9

{mentor edit: hacks removed - no longer necessary}

3 Likes
10

assert np.allclose(outd[1, 1], [-0.34560338, -0.8762897, -0.4767484, 1.6986415]), “Wrong values in outd”

Still the same error.

1 Like
11

{mentor edit: hacks removed - no longer necessary}

3 Likes
12

When I have done it Decoder_test fails as follows:

assert np.allclose(outd[1, 1], [-0.34560338, -0.8762897, -0.4767484, 1.6986415]), “Wrong values in outd”

13

see my previous shared Decoder codes

scale embeddings by multiplying by the square root of their dimension

{mentor edit: code removed}

14

{mentor edit: hacks removed - no longer necessary}

5 Likes
15

Thanks for the tip. Doing it like this passes the subsequent tests and then proceeds to pass the autograder when submitted too. A shame this last lab has these inconsistencies, as noted in another thread here: Pedagogy of C5-W4-A1 (-Ex4: Encoder Layer) This makes it very confusing to finish the lab properly. Thankfully we have our helpful classmates here on Discourse to lend a hand! :grin:

16

{mentor edit: hacks removed - no longer necessary}

3 Likes
17

{mentor edit: hacks removed - no longer necessary}

1 Like
18

thanks man it worked!!!

19

Thx man! You really saved me, after whole day trying to debug my code…

20

{mentor edit: hacks removed - no longer necessary}

21

{mentor edit: hacks removed - no longer necessary}

5 Likes