Manuscript Psy03-D@1 · Psy03-D-v1.tex · section · 3e18951d
Reference preservation
Masked gradients and reference-preserving repair › Reference preservation · lines 1422–1428
A restoration reference must therefore be saved independently
of current weights and copied into each branch.
A training parameter called weight_orig is not
automatically an immutable healthy-checkpoint reference.