Axion 1.0: Open Agent Foundation Models, Simplified
cs.AI
Submitted: 2026-11-02
Updated: 2026-11-11
Code: https://github.com/bytedance/axion1_0
Project page: https://axion1-0.github.io
Terminology
Sources
- Apodex 1.1: Scaling Agentic Intelligence for Complex Work
- Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent
- Humanity's Last Exam
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models
- OpenThoughts: Data Recipes for Reasoning Models
- DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- Kimi K2: Open Agentic Intelligence
- Trust Region Masking for Long-Horizon LLM Reinforcement Learning
- MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core
- Ring Attention with Blockwise Transformers for Near-Infinite Context
- Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers
- MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verification
- Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
- SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models
- Zero Bubble Pipeline Parallelism
- Defeating the Training-Inference Mismatch via FP16
- ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents