<a name="p-955577-hi-i-have-and-issue-with-the-implementation-of-the-the-next_word-function-just-for-context-ive-passed-all-the-test-before-so-hopefully-the-issue-is-with-my-implementation-itself-anyway-im-getting-the-following-error-2024-08-30-212744787955-w-tensorflowcoreframeworkop_kernelcc1828-op_requires-failed-at-einsum_op_implh506-invalid_argument-expected-input-0-to-have-rank-4-but-got-3-1" class="anchor" href="#p-955577-hi-i-have-and-issue-with-the-implementation-of-the-the-next_word-function-just-for-context-ive-passed-all-the-test-before-so-hopefully-the-issue-is-with-my-implementation-itself-anyway-im-getting-the-following-error-2024-08-30-212744787955-w-tensorflowcoreframeworkop_kernelcc1828-op_requires-failed-at-einsum_op_implh506-invalid_argument-expected-input-0-to-have-rank-4-but-got-3-1" aria-label="Heading link"> Hi, I have and issue with the implementation of the the next_word function. Just for context, I’ve passed all the test before, so hopefully the issue is with my implementation itself. Anyway I’m getting the following error: 2024-08-30 21:27:44.787955: W tensorflow/core/framework/op_kernel.cc:1828]…

your first error lies with Block 1 codes for self attention, there is a missing x. Also no training is suppose to be used. you also don’t require use casual mask=True for block 1 of block 2 codes. Also please make sure that you are working on an updated copy of assignment. regards DP

Hi, Thank you for your reply. How do I know if I’m working with the updated copy of the assignment?

Also, I used what you told me to change my code. And know it works. However, there were no issues with the 2 x, as I was just letting tf take the same tensor for the key and value arguments. The issue was that I was always using casual mask = True. Thank you.

yes you are right but I have got dm from you that you still failed on grade submission. I hope you have cleared?

Hi! Yes, I finally was able to clear it. The problem was on the ‘next_word’ function. I hadn’t realized I need it to add padding on the output. (silly mistake). However, training the model doesn’t work. There is a problem with the train step function, but this doesn’t affect the grading.

model doesn’t work? can you please share a screenshot about what this issue is

Sure! Epoch 1, Batch 1/231 ValueError Traceback (most recent call last) Cell In[50], line 18 16 for (batch, (inp, tar)) in enumerate(dataset): 17 print(f’Epoch {epoch+1}, Batch {batch+1}/{number_of_batches}‘, end=’\r’) —> 18 train_step(transformer, inp, ta…

I think it is somehow the same kind of issue I was having. In the process there is a point were padding is not being added. I trying to fixing it by adding a extra cell, and correcting the code I cant modify. The problem seem to be simple. I think I can fix it once I find where to make the correctio…

hi @Maur_cd can I know for which grade cell this error was thrown for next_word? and yet you passed the grader? can you share image of your submission grader output by clicking on show grader output. Also it is a request, always better share a screenshot rather than copy paste, this is because som…

Also as per your error it still tells your codes are incorrect for block1, clearing a particular grade cell and then not clearing other one, still can encounter issue. because the model works based on how you recalled encoder or decoder, whatever codes you mention will reflect in further model. li…

C4W2_next_word

Course Q&A Natural Language Processing NLP with Attention Models

Deepti_Prasad September 2, 2024, 5:16pm 14

to get fresh copy, please follow the below link comment

Topic		Replies	Views
C4W2 Assignment Exercise 5 - next_word NLP with Attention Models week-module-2	15	493	January 6, 2025
C4W3_Assignment in Natural Language Processing with Attention Models NLP with Attention Models week-module-3	22	475	September 2, 2024
C4W2 cannot graded NLP with Attention Models week-module-2	14	944	October 29, 2024
Problem with Natural Language Processing with Attention Models NLP with Attention Models week-module-2 , coursera-platform	13	65	January 1, 2026
NLP with Attention Models C4W2 - Exercise 5 - next_word “softmax_404” error NLP with Attention Models week-module-2	12	397	May 6, 2024

C4W2_next_word

Related topics