Plumbline: When the Loss Lies, Validating LLM Training Correctly
cs.DC, cs.LG
Submitted: 2026-11-10
Updated: 2026-11-10
Comments: 16 pages, 6 figures, 3 tables
Code: https://github.com/huggingface/trans
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- Training Verifiers to Solve Math Word Problems
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- DeepSeek-V3 Technical Report
- GLM-5: from Vibe Coding to Agentic Engineering
- TTrace: Lightweight Error Checking and Diagnosis for Distributed Training
- TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
- gpt-oss-120b & gpt-oss-20b Model Card
- On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability
- Miles v0.1: Production-Level Post-Training
- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
- Olmo 3
Related papers
- Programmable Probabilistic Computer with 1,000,000 p-bits
- BatchGen: An Architecture for Scalable and Efficient Batch Inference
- Seamless Reconfiguration for DAG-BFT (Technical Report)
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- TIRx: A Unified Tile Primitive ML Compiler Across Heterogeneous Backends