Manuscript Psy03-C@1 · Psy03-C-v1.tex · proposition · d3380b90

Proposition: Positive bias need not grow without bound over time

Hidden-state invariants and their limits · lines 483–499 · proof included or linked

Psy03-C@1#prop:bias

Back to manuscript

There is a source-compatible cell for which, at , external ReLU, zero hidden noise, and constant ,

Thus positive bias can accumulate to a finite limit rather than cause unbounded temporal growth.

Proof. Set all cell weights and biases to zero. Then , , and . The biased recurrence is . Solve it from zero.

Displayed formulas in this passage

  • unlabeled · line 487

Nearby in this section