C4_W1next_symbol padding

Course Q&A Natural Language Processing NLP with Attention Models
1

Hi,

In the next_symbol function, what should be the padding element? Should it be EOS, where EOS=1 or should it be 0? I have tried 0 and it seems to be working. But it should have been mentioned in the assignment.

Thanks.

2

Hi @vrathi

I understand that it was not mentioned in next_symbol function hints, but to be fair, 0 is the usual value (and logical value compared to EOS), also it was mentioned at least a couple of times prior:

# Add masking for the padding (0s).
…
# hint: inputs is positive for real tokens and 0 where they are padding

All in all I could agree that it could have been mentioned and a thing to consider for future revisions.

Cheers