Manuscript Psy03-C@1 · Psy03-C-v1.tex · section · d3380b90

Two different noise interfaces

The actual recurrent model › Two different noise interfaces · lines 316–363

Psy03-C@1#eq:ordinary, Psy03-C@1#eq:biased

Back to manuscript

Let and be independent standard Gaussian vectors, independent of the latent example. The index denotes a step within one forward invocation.

The ordinary computation is

Here is the evaluator's additional input noise and is the source's ordinary stress_level.

The biased computation is

The readout in both cases is

The smallest maximizing index resolves ties.

The paths coincide when all their noise and bias intensities vanish. They otherwise perturb different spaces at different positions: ordinary stress enters the two-dimensional cell input, whereas biased stress enters the hidden update before the external activation.

The post-activation feed-forward bounds in Psy01-A and Psy03-A are therefore interface precedents, not formulas for (eq:ordinary) or (eq:biased) CheungPsy01A,CheungPsy03A.

Displayed formulas in this passage

  • Psy03-C@1#eq:ordinary · line 324

  • Psy03-C@1#eq:biased · line 335

  • unlabeled · line 347