Fast and Accurate Probing of In-Training LLMs' Downstream Performances
cs.LG, cs.AI
Submitted: 2026-04-01
Updated: 2026-11-06
Terminology
Sources
- Program Synthesis with Large Language Models
- Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
- Evaluating Large Language Models Trained on Code
- PaLM: Scaling Language Modeling with Pathways
- Training Verifiers to Solve Math Word Problems
- Understanding Emergent Abilities of Language Models from the Loss Perspective
- Estimating Knowledge in Large Language Models Without Generating a Single Token
- OLMo: Accelerating the Science of Language Models
- When Attention Sink Emerges in Language Models: An Empirical View
- Measuring Massive Multitask Language Understanding
- Measuring Mathematical Problem Solving With the MATH Dataset
- Training Compute-Optimal Large Language Models
- Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding
- Predicting LLM Reasoning Performance with Small Proxy Model
- HD-NDEs: Neural Differential Equations for Hallucination Detection in LLMs
- Let's Verify Step by Step
- Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arena
- Olmo 3
- 100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis