The Shrinking Lifespan of LLMs in Science
cs.DL, cs.AI, cs.CY, cs.SI
Submitted: 2026-04-08
Updated: 2026-09-25
Journal ref: Conference on Language Modeling (COLM) 2026
Code: https://github.com/py-econometrics/pyfixest
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released.
Terminology
Abstract
Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released. We introduce time-to-peak and lifespan as measures of model obsolescence and use them to characterize the scientific adoption trajectories of 62 LLMs across more than 108k citing papers (2019-2025), separating active adoption from background citation to recover per-model trajectories that citation counts cannot resolve. We find that a model's longevity is shaped more by when it was released than by its characteristics: release year predicts time-to-peak and lifespan more strongly than architecture, openness, or scale. LLM adoption follows an inverted-U curve (rising after release, peaking, and then declining), but this pattern is rapidly compressing. Each successive release year is associated with a 27% shorter time-to-peak and a 23% shorter lifespan (p < 0.001), robust to minimum-age thresholds and controls for model size. These adoption-side dynamics are invisible to scaling laws and suggest that specialization on any single model may be a depreciating investment, with costs falling on reproducibility and migration.
Sources
- Nougat: Neural Optical Understanding for Academic Documents
- On the Opportunities and Risks of Foundation Models
- The Llama 3 Herd of Models
- Training Compute-Optimal Large Language Models
- Scaling Laws for Neural Language Models
- The Semantic Scholar Open Data Platform
- S2ORC: The Semantic Scholar Open Research Corpus
- ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learning
- Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Papers
- Emergent Abilities of Large Language Models