LineupRL: Verifiable Reinforcement Learning for Time Series Captioning via Caption-to-Series Identification
cs.AI
Submitted: 2026-10-01
Updated: 2026-10-01
Comments: 28 pages, 4 figures
Code: https://github.com/HaochenZhang717/LineupRL-official-repo
License: http://creativecommons.org/licenses/by/4.0/
The gist: Time series captioning is a fundamental step in time series understanding and can also serve as the bridge between signal and natural language.
Terminology
Abstract
Time series captioning is a fundamental step in time series understanding and can also serve as the bridge between signal and natural language. Supervised fine-tuning (SFT) relies on a larger model's captions and cannot exceed their quality. Reinforcement learning (RL) can, but its rewards were designed for other modalities and other tasks, and they transfer poorly to open-ended generation in the time series domain. We address this by proposing LineupRL, a reinforcement learning with verifiable rewards (RLVR) pipeline whose reward is caption-to-series identification. The reward model is a frozen large language model (LLM) verifier that reads the generated caption and the candidate time series as raw values, never the chart, and must pick the described time series from multiple distractors. Matching is a far lighter demand on the verifier than writing questions or judging a caption, so an off-the-shelf LLM can supply the reward. Across two captioning benchmarks, and on forecasting and reconstruction where the predictor sees only the caption, LineupRL outperforms SFT and RL baselines on every metric. The 3B vision language model (VLM) trained by LineupRL also outperforms, at 1/24 of the parameters, the 72B VLM whose captions the SFT baseline is distilled from. Our case study shows that LineupRL resists reward hacking, and that the captioner it trains both traces the trend and names the values at key points.
Sources
- XForecast: Evaluating Natural Language Explanations for Time Series Forecasting
- Language Bottleneck Models for Qualitative Knowledge State Modeling
- SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
- VLRM: Vision-Language Models act as Reward Models for Image Captioning
- TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health
- Decoupling Perception from Description: Computation-Grounded Representation Alignment between Multivariate Time Series and Language
- T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models
- LoRA: Low-Rank Adaptation of Large Language Models
- RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioning
- Reinforcement Learning with Rubric Anchors
- Human-like Time Series Summaries via Trend Utility Estimation
- Can we generate portable representations for clinical time series data using LLMs?
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
- ClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparison
- Rethinking Post-Training Recipes for Multimodal Time-Series Forecasting
- SafeCap: Improving LVLM Safety with Image Captioning Reinforcement Learning
- BEDTime: A Unified Benchmark for Automatically Describing Time Series
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioning
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems