Manuscript Psy04-A@1 · Psy04-A-v1.tex · section · d5800e2a

Optional stopping and multiple settings

Finite-sample exclusion certificates › Optional stopping and multiple settings · lines 1394–1407

Back to manuscript

For multiple delays or intervention settings, allocate confidence across the predeclared tests or assess the selected setting on a fresh block. Choosing a favorable delay after examining its score does not preserve an unadjusted single-test certificate.

If a prior calibration event has failure probability at most , and the statistical assumptions hold on that pre-assessment event, a union bound gives total false-certificate probability at most .

Nearby in this section