LM-SimBench: A Unified Framework, Dataset, and Benchmark for Large Language Model Training Simulation
cs.AI
Submitted: 2026-11-10
Updated: 2026-11-10
Terminology
Sources
- Echo: Simulating Distributed Training At Scale
- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
- Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces
- A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO
- ScaleDL: Towards Scalable and Efficient Runtime Prediction for Distributed Deep Learning Workloads
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents