Deep in a network, a layer’s outputs can drift: some examples come out huge, some tiny, and the next layer struggles. Write normalize(batch): batch is a list of examples, each a list of one layer’s outputs. Rescale them so the next layer always sees numbers of a standard size, whatever came in. The starter uses the standard score from “Who did better?” with the whole batch’s average and spread.
| out 1 | out 2 | out 3 | out 4 | |
|---|---|---|---|---|
| example 1 | 1 | 2 | 3 | 6 |
| example 2 | 0.5 | 1 | 0 | 2.5 |