Hi I was just watching the videos for this new course. Thanks a lot for this great resource
In the video on ‘Expanding’ it is said: “with temperature 0, every time you execute the same prompt,
you should expect the same completion.”. Is this correct? It is my understanding that this is not the case.
OpenAI’s own documentation state: ‘The actual completion you see may differ because the API is non-deterministic by default. This means that you might get a slightly different completion every time you call it, even if your prompt stays the same. Setting temperature to 0 will make the outputs mostly deterministic, but a small amount of variability may remain.’