HELIX: HEterogeneous LLM Inference with FleXible and Fine-Grained Partitioning
cs.SE
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/ai-dynamo/aiconfigurator
Terminology
Sources
- OpWeave: Flexible Operator Disaggregation for Heterogeneous LLM Serving
- Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache
- Analytical Provisioning for Attention-FFN Disaggregated LLM Serving under Stochastic Workloads
- Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective Decoding
- AIConfigurator: Lightning-Fast Configuration Optimization for Multi-Framework LLM Serving
- Beyond Prefill-Decode Disaggregation: Dissecting LLM Inference for Heterogeneous Platforms via Dynamic Operator Scheduling
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters