Manuscript Psy03-D@1 · Psy03-D-v1.tex · section · 3e18951d

Stored and effective parameters

Masked gradients and reference-preserving repair › Stored and effective parameters · lines 1372–1390

Back to manuscript

Gradient-based topology updates have established precedents, including RigL EvciRigL. The present score distinction is not an identification of the reported repair algorithm with RigL.

Recurrent tensors that are zeroed only after optimizer steps, but used without an in-forward mask, have a different derivative interface. The same scoring code can therefore have different eligibility consequences for linear and recurrent modules.

Psy03-A's signed sparse-gradient descent result has an explicit signed update and local smoothness hypothesis CheungPsy03A. It is not imported as a guarantee for unsigned scoring, positive-score filtering, or random initialization.

Nearby in this section