Manuscript Psy03-D@1 · Psy03-D-v1.tex · section · 3e18951d

What the modular computation does and does not expose

What the modular computation does and does not expose · lines 827–870

Psy03-D@1#eq:modular

Back to manuscript

A declared modular template is

Here is identity or external tanh. The gate is scalar at each trial. For a nonmodular variant set .

This template records the distinction between recurrent state and a pointwise readout branch. The symbols “cortical,” “striatal,” and “thalamic” can name computational motifs without constituting an anatomical identification.

The PyTorch candidate convention is

followed by

Dropout in a multilayer nn.GRU is placed between recurrent layers, not after the final recurrent layer PyTorchGRU.

The GRU can retain information about past inputs. It cannot turn past rule-independent points into evidence about the hidden rule in Theorem thm:observability. Post-RNN readout noise and a pointwise branch also do not provide missing feedback.

Displayed formulas in this passage

  • Psy03-D@1#eq:modular · line 830

  • unlabeled · line 851

  • unlabeled · line 858

Nearby in this section