Programming Assigement A2 NER : model does not deliver expected prediction output

Hi, I need some help here. Model training seems to be fine. But prediction is a mess.

Epoch 1/10
55/55 [==============================] - 11s 92ms/step - loss: 0.3113 - accuracy: 0.7719
Epoch 2/10
55/55 [==============================] - 5s 93ms/step - loss: 0.2998 - accuracy: 0.7761
Epoch 3/10
55/55 [==============================] - 5s 92ms/step - loss: 0.3009 - accuracy: 0.7777
Epoch 4/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2837 - accuracy: 0.7805
Epoch 5/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2711 - accuracy: 0.7816
Epoch 6/10
55/55 [==============================] - 5s 93ms/step - loss: 0.2579 - accuracy: 0.7840
Epoch 7/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2515 - accuracy: 0.7849
Epoch 8/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2437 - accuracy: 0.7861
Epoch 9/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2367 - accuracy: 0.7864
Epoch 10/10
55/55 [==============================] - 5s 92ms/step - loss: 0.2541 - accuracy: 0.7816

Even using a snippet from training set as input (“Abhishek Jha Application Development Associate - Accenture Bengaluru, Karnataka”), following is the
prediction outputs. I am not sure if it is me changed things in the code cause
I remember the prediction worked before.
So generally , I think I need some guidance in such situation cause I feel like
there is not much I can do to debug the issue.

[[0 3 3 3 3 3 3 0 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3

  • 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 3 3 3 3 3 3 0 0 0 0 0 0 0 0 0 0 0*
  • 0 0 0 0 0 0 0 0 0 0 0 0 3 0 0 3 3 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0*
  • 0 0 0 3 3 3 3 3 3 0 0 0 0 0 0 0 0 0 0 0 3 0 0 3 3 3 3 0 0 0 0 0 3 0 0 0*
  • 0 0 0 0 0 3 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 3 3*
  • 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 3 3 3*
  • 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0*
  • 3 0 3 3 3 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0*
  • 0 0 0 0 0 0 3 3 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0*
  • 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0 0 3 3 3 3 0 0 0 0 0 0 0 0 0 0 0*
  • 0 0 0 0 0 0 0 0 0 3 3 3 3 3 3 3 0 0 0 0 0 0 0 3 3 3 3 3 0 3 3 3 3 3 3 3*
  • 3 3 3 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 3 3 3 3 3 3 3 3 3 3 0 0 0 0*
  • 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0 0 0 3 0 3 3 3 3 0 3 3 0 0 0*
  • 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0*
  • 0 0 0 0 0 0 0 0]]*

Sorry, I don’t recognize which assignment you’re working on.

Can you verify the name of the specialization, which course, and which week and assignment, and give the notebook name?

HI TMosh, it is the Deep learning sepcialization course 5 week 4 assigment 2 (Name Entity Recognition).

“and give the notebook name?”
I am not sure where it is.

DLS Course 5 Week 4 has only one assignment, and it’s for Transformers.
There is no C5 W4 A2 assignment.

There are some ungraded labs in Week 4 though. Are you asking about one of those?

yes, it is the second of the 3 ungraded labs.

Here is what I got when I ran the unmodified lab:

thanks for posting your result. Your result looks similar to mine. Guess the model needs to be improved to be able to deliver more accurate predictions.