Manuscript Psy03-C@1 · Psy03-C-v1.tex · proposition · d3380b90
Proposition: Positive bias need not grow without bound over time
Hidden-state invariants and their limits · lines 483–499 · proof included or linked
Psy03-C@1#prop:bias
There is a source-compatible cell for which, at , external ReLU, zero hidden noise, and constant ,
Thus positive bias can accumulate to a finite limit rather than cause unbounded temporal growth.
Proof. Set all cell weights and biases to zero. Then , , and . The biased recurrence is . Solve it from zero.
Displayed formulas in this passage
unlabeled · line 487
Nearby in this section
- lemma: Lemma: Coordinate envelope of the cell
- theorem: Theorem: Ordinary-ReLU invariant cube
- section: Hidden-state invariants and their limits
- theorem: Theorem: External-tanh bound and biased-ReLU envelope
- section: Hidden-state invariants and their limits
- section: Hidden-state invariants and their limits