A language model read a text one word at a time and gave each actual next word a chance. Write perplexity(chances): one number for how confused the model was, said as “it was like choosing among k words”.
chances = [0.5, 0.1, 0.25]: the chance the model gave each word that actually came next