In Depth

At temperature 0, the model always picks the most likely next word, producing consistent but potentially repetitive output. At higher temperatures, it considers less likely words, producing more varied and creative output. For factual tasks, use low temperature. For creative tasks, use higher.