RankLane: Efficient MoE Prefill on Accelerators with Ranked Expert Capacities
cs.LG
Submitted: 2026-10-30
Updated: 2026-10-30
Code: https://github.com/qualcomm/efficient-transformers
Project page: https://qualcomm.github.io/cloud-ai-sdk-pages/latest/Getting-Started/Architecture
Terminology
Sources
- Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- Gemma 4 Technical Report
- Optimizing Mixture of Experts using Dynamic Recompilations
- Microscaling Data Formats for Deep Learning
- Qwen3 Technical Report
- Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
- Patterns behind Chaos: Forecasting Data Movement for Efficient Large-Scale MoE LLM Inference
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis