Manuscript Psy03-C@1 · Psy03-C-v1.tex · section · d3380b90
Hidden-state invariants and their limits
Hidden-state invariants and their limits · lines 477–482
The external activation is after noise here. This differs from the post-tanh noise ordering analyzed in Psy03-A CheungPsy03A.
Nearby in this section
- lemma: Lemma: Coordinate envelope of the cell
- theorem: Theorem: Ordinary-ReLU invariant cube
- section: Hidden-state invariants and their limits
- theorem: Theorem: External-tanh bound and biased-ReLU envelope
- proposition: Proposition: Positive bias need not grow without bound over time
- section: Hidden-state invariants and their limits