You run tests separate tests on things that are really pure luck, and flag any test whose surprise (from “Is it luck?”) comes out below your threshold. On pure luck, a test gets flagged with chance equal to the threshold. Write threshold(tests, overall): the threshold for each test, so that the chance of any false alarm across all of them stays at overall, like 0.05.