Reference Model
The projection ball is intended to keep destructive gradient ascent near a plausible retained model. The reference model serves as the center of an L2-norm projection ball with radius delta. The reference model is computed by subtracting t…
1 sources - 4 claims
The projection ball is intended to keep destructive gradient ascent near a plausible retained model. The reference model serves as the center of an L2-norm projection ball with radius delta. The reference model is computed by subtracting the target client's cached previous contribution from the current global model. The reference model anchors the unlearning trajectory to reduce drift and avoid catastrophic forgetting of retained knowledge.