Manuscript Psy03-C@1 · Psy03-C-v1.tex · section · d3380b90
Two different noise interfaces
The actual recurrent model › Two different noise interfaces · lines 316–363
Psy03-C@1#eq:ordinary, Psy03-C@1#eq:biased
Let and be independent standard Gaussian vectors, independent of the latent example. The index denotes a step within one forward invocation.
The ordinary computation is
Here is the evaluator's additional input noise and
is the source's ordinary stress_level.
The biased computation is
The readout in both cases is
The smallest maximizing index resolves ties.
The paths coincide when all their noise and bias intensities vanish. They otherwise perturb different spaces at different positions: ordinary stress enters the two-dimensional cell input, whereas biased stress enters the hidden update before the external activation.
The post-activation feed-forward bounds in Psy01-A and Psy03-A are therefore interface precedents, not formulas for (eq:ordinary) or (eq:biased) CheungPsy01A,CheungPsy03A.
Displayed formulas in this passage
Psy03-C@1#eq:ordinary · line 324
Psy03-C@1#eq:biased · line 335
unlabeled · line 347