EfficientXpert: Efficient Domain Adaptation for Large Language Models via Propagation-Aware Pruning
EfficientXpert proposes a lightweight framework combining propagation-aware pruning with an efficient adapter update algorithm for LLMs. It creates sparse, domain-adapted models that maintain near-dense performance at low sparsity levels by reducing memory and computation during inference.