CHARM+: Cross-Hardware Attention with Re-Merge Multistream Mechanism
cs.AI, cs.AR, cs.DC
Submitted: 2026-11-04
Updated: 2026-11-04
Terminology
Sources
- Striped Attention: Faster Ring Attention for Causal Transformers
- Mesh-Attention: A New Communication-Efficient Distributed Attention with Improved Data Locality
- LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
- ATTENTION2D: Communication Efficient Distributed Self-Attention Mechanism
- Long-context LLMs Struggle with Long In-context Learning
- Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models
- Ring Attention with Blockwise Transformers for Near-Infinite Context
- CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
- BurstAttention: An Efficient Distributed Attention Framework for Extremely Long Sequences
- TASP: Topology-aware Sequence Parallelism
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
- A Survey of Large Language Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents