You’re learning what each square of a board game is worth: all the rewards still to come from it, counted as in “A reward now or later”. You just stepped off a square: you got reward, and you guess the square you landed on is worth guess_next. Write update(guess_here, reward, guess_next, patience, rate): your new guess for the square you just left, without waiting for the game to end. rate (0 to 1) is how far one step may move a guess.