Hello, I’m curious about the FlanT5 model consistently producing identical text for a given input prompt. Shouldn’t it be generating slightly varied output each time? Or is the element of randomness eliminated in the default generate method? (e.g. do_sample is set to False by default)
Have you tried setting do_sample to True and compare results?
Check out this SO: