Models Designed to Forget: Machine Unlearning via Key Deletion
The paper proposes MUNKEY, a method for machine unlearning by design that integrates forgetting directly into model training. It decouples instance data into an external memory bank using learnable exemplar tokens. This allows for zero-shot forgetting—removing specific data influence without retraining—while maintaining model performance through pathway sensitivity checks.