Manuscript Oai265-B@2 · Oai265-B-v2.tex · section · 94b6f42f
Threshold and sample planning
Finite-sample certificate from bounded complete records › Threshold and sample planning · lines 742–765
Oai265-B@2#eq:threshold, Oai265-B@2#eq:samples
For , acceptance is equivalent to
For , this requires .
For equal sample counts , an all-ideal-score dataset is certified by the Hoeffding procedure whenever
Indeed under this allowance. If , the announced calibration budget prevents this particular certificate from succeeding even on ideal scores.
These are sufficient allowances, not optimal sample lower bounds. Failure to certify does not show that the actual device error is large.
Displayed formulas in this passage
Oai265-B@2#eq:threshold · line 745
Oai265-B@2#eq:samples · line 753