All the previous tests passed but I am not sure why I cannot split the data according to (n_batch, seqlen, n_heads, d_head). I tried refreshing the workspace since I thought it was the problem with the dataset but to no avail. The error callback trace are as follows: ------------------------------…

C4W2 UNQ_C8 training_loop error

Course Q&A Natural Language Processing NLP with Attention Models

Xiang_Yao_Ng October 22, 2022, 11:44am 2

Nevermind, I have solved this problem. It originates from UNQ_C5, where I mistaken set the d_head as d_feature for both the compute_attention_heads_closure and compute_attention_output_closure functions. It has been resolved.

6 Likes

W2 UNQ_C8 Error in Training loop

Topic		Replies	Views
UNQ_C8 error (training_loop) NLP with Attention Models week-2	1	568	June 23, 2022
W2 UNQ_C8 Error in Training loop NLP with Attention Models week-2	4	537	June 10, 2023
# UNQ_C8 Error ---> 42 output_dir=output_dir) NLP with Attention Models week-2	5	590	June 3, 2022
C4_w2 UNQ_C8 Train Loop NLP with Attention Models week-2	1	542	December 9, 2022
UNQ_C8, training_loop error NLP with Attention Models week-2	5	604	August 20, 2022

C4W2 UNQ_C8 training_loop error

Related topics