Manuscript Psy03-D@1 · Psy03-D-v1.tex · section · 3e18951d
Stored and effective parameters
Masked gradients and reference-preserving repair › Stored and effective parameters · lines 1335–1346
The hypothesis excludes a direct regularizer on , a surrogate derivative, stale gradients, or an independent score. Those are different scoring interfaces.
PyTorch's pruning reparameterization distinguishes an original parameter, a mask buffer, and the effective masked tensor PyTorchPruning. That bookkeeping does not make their derivatives interchangeable.