TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval
cs.CL, cs.AI
Submitted: 2026-09-23
Updated: 2026-09-23
Code: https://github.com/aldebaran-care/TEMPS
License: http://creativecommons.org/licenses/by/4.0/
The gist: Modern information retrieval (IR) systems rarely represent time, yet many information needs depend on it: in clinical, journalistic, and legal search, when an event occurred can decide whether a
Terminology
Abstract
Modern information retrieval (IR) systems rarely represent time, yet many information needs depend on it: in clinical, journalistic, and legal search, when an event occurred can decide whether a document is relevant. Dense retrievers and Retrieval-Augmented Generation (RAG) pipelines match queries to documents well on topic but poorly on time, so they surface content that is on-topic yet temporally wrong. We introduce Temporal Textual Similarity (TTS), a task that measures how well two anchored texts align in time, independent of their topical similarity. We then present TEMPS (Temporal Embedding Model for Precise Search), a modular temporal branch that attaches to a frozen semantic retriever and trains on that signal. It resolves anchored temporal expressions to intervals and moment-matches each one to a Gaussian; the resulting ordering supervises an anchor-date-conditioned encoder, whose score we fuse with the semantic score at inference. Grounding supplies the supervision, so training uses no hand-labeled temporal data. The temporal score itself is the Gaussian-KL inclusion measure from distributional embeddings; what TEMPS adds is the grounding and the moment-matched supervision. On three temporal benchmarks, TEMPS improves MRR for every semantic backbone tested and, on TS- Retriever, lifts R@1 from 19.92 to 25.39 over the prior temporal state of the art.
Sources
- A Dataset for Answering Time-Sensitive Questions
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
- Massively Increasing TIMEX3 Resources: A Transduction Approach
- SimCSE: Simple Contrastive Learning of Sentence Embeddings
- Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents
- Unsupervised Dense Information Retrieval with Contrastive Learning
- Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Models
- Word Representations via Gaussian Embedding
- Text Embeddings by Weakly-Supervised Contrastive Pre-training
- Qwen2.5 Technical Report
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering