Manuscript Psy03-C@1 · Psy03-C-v1.tex · lemma · d3380b90
Lemma: Coordinate envelope of the cell
Hidden-state invariants and their limits · lines 391–407 · proof included or linked
Psy03-C@1#lem:convex
For every finite ,
In particular, whenever , independently of input magnitude.
Proof. Each update-gate coordinate lies in , and each candidate coordinate lies in . Equation (eq:cell) is a coordinatewise convex combination of and .
Displayed formulas in this passage
unlabeled · line 394
Nearby in this section
- theorem: Theorem: Ordinary-ReLU invariant cube
- section: Hidden-state invariants and their limits
- theorem: Theorem: External-tanh bound and biased-ReLU envelope
- section: Hidden-state invariants and their limits
- proposition: Proposition: Positive bias need not grow without bound over time
- section: Hidden-state invariants and their limits