Manuscript Psy03-D@1 · Psy03-D-v1.tex · remark · 3e18951d
Remark: No transfer of Psy03-C's external-activation invariant
What the modular computation does and does not expose · lines 887–895
Psy03-C's ordinary-ReLU invariant concerns an external activation applied to the state that is fed into the next cell CheungPsy03C. In a template such as (eq:modular), scaling and activation after the sequence GRU modify its readout, not automatically its internal recurrent state. The two implementations must not be identified.