Precision - Preserving Subtensor Inference for a 22B Joint Audio - Video Generator under a Fixed GPU Working Set
cs.DC
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/Jit-Roy/WeeLLM
Terminology
Sources
- LTX-2: Efficient Joint Audio-Visual Foundation Model
- Xema: Efficient Diffusion Serving through Fine-Grained Memory Management and Auto-Configuration
- ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference
Related papers
- BatchGen: An Architecture for Scalable and Efficient Batch Inference
- Seamless Reconfiguration for DAG-BFT (Technical Report)
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- TIRx: A Unified Tile Primitive ML Compiler Across Heterogeneous Backends
- AgentWeave: Efficient Distributed Agent Serving via Flow Decomposition