Manuscript Psy03-C@1 · Psy03-C-v1.tex · section · d3380b90
Hidden-state invariants and their limits
Hidden-state invariants and their limits · lines 429–434
This is stronger than a high-probability boundedness assertion. Input noise can be arbitrarily large without invalidating the cube.
Nearby in this section
- lemma: Lemma: Coordinate envelope of the cell
- theorem: Theorem: Ordinary-ReLU invariant cube
- theorem: Theorem: External-tanh bound and biased-ReLU envelope
- section: Hidden-state invariants and their limits
- proposition: Proposition: Positive bias need not grow without bound over time
- section: Hidden-state invariants and their limits