Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training
cs.AI
Submitted: 2026-07-30
Updated: 2026-09-30
Terminology
Sources
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- TinyStories: How Small Can Language Models Be and Still Speak Coherent English?
- Textbooks Are All You Need
- LiteLong: Resource-Efficient Long-Context Data Synthesis for LLMs
- Textbooks Are All You Need II: phi-1.5 technical report
- Source2Synth: Synthetic Data Generation and Curation Grounded in Real Data Sources
- Mid-Training of Large Language Models: A Survey
- From Amateur to Master: Infusing Knowledge into LLMs via Automated Curriculum Learning
- Galactica: A Large Language Model for Science
- Measuring short-form factuality in large language models
- CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?
- RAFT: Adapting Language Model to Domain Specific RAG
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems