Backdoor Purification for LoRA-Tuned LLMs via Null-Space Projection
The research introduces a method to remove hidden backdoor vulnerabilities from LLMs fine-tuned with LoRA adapters without knowing the trigger or having clean data. By projecting the adapter's weight updates onto specific null spaces derived from multiple backdoor variants, it purifies the weights. This allows for security enhancement while maintaining the adapter's original performance.