Do Defenses Against LLM Extraction Work Across Attacks? A Lifecycle Benchmark of Black-Box Model Extraction
This research created a unified benchmark to test how well different defenses against LLM extraction work across various attacks. It systematically compares six different extraction methods, ten distinct defensive strategies, and two adaptive attacks under a single text-only threat model. The goal is to provide a reproducible way to evaluate these methods for building safer large language models.