Manuscript Oai265-B@2 · Oai265-B-v2.tex · section · 94b6f42f

Why the arithmetic is outward

Exact-rational implementation and diagnostic reporter › Why the arithmetic is outward · lines 2096–2129

Back to manuscript

The lower binomial tail in (eq:cpL) is increasing in its probability argument. The lower side of its root bracket can only decrease the lower confidence endpoint. The CDF in (eq:cpU) is decreasing; the upper side can only increase the upper endpoint. The square-root routine returns an upper bracket.

After bisections, each root bracket has width . For the three-setting lower fidelity, outward endpoint loss is at most before clipping. After square-root bisections, the untruncated doubled square-root upper expression has an extra numerical allowance of at most . These are deterministic arithmetic bounds, distinct from statistical confidence.

The binomial recurrence's intermediate terms are integers

when . The asserted exact division advances this term to the next one. The optional direct-sum test checks this identity over a finite set; the identity itself holds algebraically.

The exact function tests the mathematical expression using the conservative returned . It need not coincide at an extremely close boundary with testing the separately rounded-up display . Both conventions are conservative if their numerical meaning is declared. For a laboratory implementation, archive which rule is used.

Displayed formulas in this passage

  • unlabeled · line 2115