Telescopic Language Models

arXiv:2609.35769 · cs.CL, cs.AI · Submitted 2026-09-28 · Read on arXiv

cs.CL, cs.AI

Submitted: 2026-09-28

Updated: 2026-09-28

Comments: 12 pages, 4 figures, 2 tables. Code: https://github.com/ZhilinGuo/telescopic-language-models

Code: https://github.com/EleutherAI/lm-evaluation-harness

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Perplexity — 25× in this paper · explained in 3 episodes
Distillation — 17× in this paper · explained in 2 episodes
Transformer — 15× in this paper · explained in 2 episodes
Accuracy — 10× in this paper · explained in 1 episode
Benchmark — 7× in this paper · explained in 2 episodes
Ablation — 5× in this paper · explained in 1 episode
Adam — 4× in this paper · explained in 2 episodes
Telescopic Language Model — 4× in this paper
Gaussian Splatting — 3× in this paper · explained in 4 episodes
Generative AI — 3× in this paper · explained in 2 episodes
Matryoshka Language Model Suites — 3× in this paper
Robustness — 3× in this paper · explained in 5 episodes
Speculative Decoding — 3× in this paper · explained in 2 episodes
3D Gaussian Splatting — 2× in this paper · explained in 2 episodes
Calibration — 2× in this paper · explained in 7 episodes
Downstream Tasks — 2× in this paper · explained in 2 episodes
Pruning — 2× in this paper · explained in 4 episodes
Representation Learning — 2× in this paper · explained in 2 episodes
Embeddings — 1× in this paper · explained in 2 episodes
Fine-Tuning — 1× in this paper · explained in 5 episodes
KV cache — 1× in this paper · explained in 3 episodes
Regularization — 1× in this paper · explained in 3 episodes

Related papers