The Shrinking Lifespan of LLMs in Science

arXiv:2604.07530 · cs.DL, cs.AI, cs.CY, cs.SI · Submitted 2026-04-08 · Read on arXiv

cs.DL, cs.AI, cs.CY, cs.SI

Submitted: 2026-04-08

Updated: 2026-09-25

Journal ref: Conference on Language Modeling (COLM) 2026

Code: https://github.com/py-econometrics/pyfixest

License: http://creativecommons.org/licenses/by-sa/4.0/

The gist: Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released.

Terminology

Abstract

Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released. We introduce time-to-peak and lifespan as measures of model obsolescence and use them to characterize the scientific adoption trajectories of 62 LLMs across more than 108k citing papers (2019-2025), separating active adoption from background citation to recover per-model trajectories that citation counts cannot resolve. We find that a model's longevity is shaped more by when it was released than by its characteristics: release year predicts time-to-peak and lifespan more strongly than architecture, openness, or scale. LLM adoption follows an inverted-U curve (rising after release, peaking, and then declining), but this pattern is rapidly compressing. Each successive release year is associated with a 27% shorter time-to-peak and a 23% shorter lifespan (p < 0.001), robust to minimum-age thresholds and controls for model size. These adoption-side dynamics are invisible to scaling laws and suggest that specialization on any single model may be a depreciating investment, with costs falling on reproducibility and migration.

Sources

Related papers