Lab 1 - FlanT5 model output

Hello, I’m curious about the FlanT5 model consistently producing identical text for a given input prompt. Shouldn’t it be generating slightly varied output each time? Or is the element of randomness eliminated in the default generate method? (e.g. do_sample is set to False by default)

Have you tried setting do_sample to True and compare results?

Check out this SO: