When I use a high temperature with do_sample = True, I see more creative outputs that vary on every run. When I set do_sample = False, I would have thought the same output would be shown on every run given the greedy decoding. Yet I still see variations in the output from run to run. Why is that?
1 Like