Is the Future Predictable? Modeling Future Predictability for Reliable Temporal Reasoning
cs.CL, cs.AI
Submitted: 2026-10-08
Updated: 2026-10-08
Comments: Accepted to EMNLP 2026 (Main Conference)
Code: https://github.com/freshllms/freshqa
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Large language models (LLMs) remain unreliable when reasoning about the future.
Terminology
Abstract
Large language models (LLMs) remain unreliable when reasoning about the future. Existing models often overlook the difference among future states, committing to specific answers even when the queried facts are inherently volatile. To capture this challenge, we introduce ChronoRegime, a future-oriented temporal reasoning task that requires models to determine whether historical temporal evidence justifies commitment to a future answer. Furthermore, we propose Confidence-Aware Temporal Reasoning (CTR), a framework that estimates future predictability from temporal dynamics and regulates answer commitment accordingly. Rather than performing unconditional forecasting, CTR commits only when the reconstructed evidence supports the target future state. Across multiple LLMs, CTR improves strict overall accuracy by 6.7 percentage points and reduces hallucination rates by 18.4 percentage points on average over the plain QA baseline. These results demonstrate that explicit predictability assessment is an effective mechanism for safer and more reliable temporal reasoning under future uncertainty.
Sources
- Learning to Reason Over Time: Timeline Self-Reflection for Improved Temporal Reasoning in Language Models
- Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning
- The Llama 3 Herd of Models
- Language Models Represent Space and Time
- Do Large Language Models Know about Facts?
- Mistral 7B
- Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks
- Qwen3 Technical Report
- FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction
- When Silence Is Golden: Can LLMs Learn to Abstain in Temporal QA and Beyond?
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering