Greedy_decode output explodes

Why is this happening? I have passed all the tests from above code? This goes in an infinite loop. How can I avoid this? Please help


It’s hard to tell only this output but it looks like your summarizer fails on couple of aspects (not only failing to generate <EOS> token, but also using words as “rosroses”…).

I would suggest to save your work, refresh the environment (maybe you damaged the model weights) and see if the problem still exists.


In my case, my next_symbol had a mistake in the padding step which caused greedy_decode to go into an infinite while loop. I found this the hard way but I thought I should share.