Efficient Collaborative LLM Fine-Tuning over Heterogeneous Mobile Devices via Many Backbones to One Side-Network Tuning
cs.LG
Submitted: 2025-08-09
Updated: 2026-11-02
Terminology
Sources
- SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation
- Memory-Efficient Split Federated Learning for LLM Fine-Tuning on Heterogeneous Mobile Devices
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- MobiLLM: Enabling LLM Fine-Tuning on the Mobile Device via Server Assisted Side Tuning
- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- Improving LoRA in Privacy-preserving Federated Learning
- LLaMA: Open and Efficient Foundation Language Models
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- Neural Network Acceptability Judgments
- A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- Eco-MobiLLM: Efficient LLM Fine-Tuning on the Mobile Device via Server Assisted Side-Tuning
- BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
- OPT: Open Pre-trained Transformer Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis