Manuscript Psy04-A@1 · Psy04-A-v1.tex · section · d5800e2a
Optional stopping and multiple settings
Finite-sample exclusion certificates › Optional stopping and multiple settings · lines 1394–1407
For multiple delays or intervention settings, allocate confidence across the predeclared tests or assess the selected setting on a fresh block. Choosing a favorable delay after examining its score does not preserve an unadjusted single-test certificate.
If a prior calibration event has failure probability at most , and the statistical assumptions hold on that pre-assessment event, a union bound gives total false-certificate probability at most .