Sleeping Secrets: How Fine-Tuning Reawakens Privacy Risks in Language Models
Researchers developed ReGap, a data-free attack to recover previously learned private associations from fine-tuned language models without access to original private data. By generating model-created candidates and selecting them based on likelihood under the frozen model, ReGap achieved significant recovery gains of 6–21 percentage points over the base model.