Manuscript Psy03-D@1 · Psy03-D-v1.tex · proposition · 3e18951d

Proposition: A pruned clone is not a healthy reference

Masked gradients and reference-preserving repair › Reference preservation · lines 1400–1422 · proof included or linked

Psy03-D@1#prop:reference

Back to manuscript

If the reference is captured after deleted coordinates have been zeroed, then

at those coordinates. Reopening their masks and applying the scaled-restoration rule initializes them to zero for every finite .

If all other effective parameters and controls are unchanged, this operation leaves the immediate forward function unchanged, even though the active mask changes. Subsequent learning can differ because eligibility changes.

Proof. Multiply zero by . The effective coordinate before and immediately after reopening is zero. The mask change can allow a later stored derivative or update.

Displayed formulas in this passage

  • unlabeled · line 1404

Nearby in this section