On the Privacy of LLMs: An Ablation Study
This study introduces a unified threat model to systematically evaluate four major privacy attacks against LLMs: Membership Inference, Attribute Inference, Data Extraction, and Backdoor Attacks. Findings show that attack success depends on specific system factors like model architecture and training data characteristics. Recommendations include prioritizing defenses based on the specific risk profile of the deployment.