A language model has written The weather today is and scores the next word: sunny 2, cloudy 1, snowy −1. Write chances(scores, temperature): turn the scores into chances, where temperature sets how bold the model is. Cold: confident, it almost always picks its top word. Hot: cautious, it hedges and spreads its chances out. Temperature 1 is the model as it is.
| sunny | cloudy | snowy |
|---|---|---|
| 2 | 1 | −1 |