Large Language Model Deployment on Resource-Constrained Edge Devices: A Practitioners Survey
cs.LG, cs.AI, cs.CL
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/AlignmentResearch/sglang
Project page: https://arm-software.github.io/ComputeLibrary/latest/index.html
Terminology
Sources
- GPT-4 Technical Report
- Gemini: A Family of Highly Capable Multimodal Models
- CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models
- AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
- Does mBERT understand Romansh? Evaluating word embeddings using word alignment
- The State of Sparsity in Deep Neural Networks
- Distilling the Knowledge in a Neural Network
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
- PEARL: Parallel Speculative Decoding with Adaptive Draft Length
- ClusT3: Information Invariant Test-Time Training
- Efficient Memory Management for Large Language Model Serving with PagedAttention
- LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
- Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis