Compression Through a Context Lens: Evaluating Adaptation, Quantization, and Distillation in Arabic Legal LLMs
cs.CL
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- IslamicMMLU: A Benchmark for Evaluating LLMs on Islamic Knowledge
- Towards Inclusive NLP: Assessing Compressed Multilingual Transformers across Diverse Language Benchmarks
- QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning
- MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- Distilling the Knowledge in a Neural Network
- LoRA: Low-Rank Adaptation of Large Language Models
- Natural Language Processing in the Legal Domain
- UniComp: A Unified Evaluation of Large Language Model Compression via Pruning, Quantization, and Distillation
- A Survey on Knowledge Distillation of Large Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data