Arithmetic and its remedies select the evidence on learned geometry

arXiv:2607.17513 · cs.LG, cs.AI, cs.CL · Submitted 2026-07-20 · Read on arXiv

cs.LG, cs.AI, cs.CL

Submitted: 2026-07-20

Updated: 2026-10-19

Comments: Substantially revised and expanded; relation to v1 and corrections in Supplementary Note M10 and Extended Data Table 8. 40 pages, 5 figures, 2 Extended Data figures, 8 Extended Data tables; Supplementary Information (86 pages) as ancillary file. Data and code: doi:10.5281/zenodo.21438499

License: http://creativecommons.org/licenses/by/4.0/

The gist: Intelligence that must act before outside correction arrives must carry the structure of its expert knowledge, and hyperbolic geometry represents hierarchy with a fidelity no Euclidean space of

Terminology

Abstract

Intelligence that must act before outside correction arrives must carry the structure of its expert knowledge, and hyperbolic geometry represents hierarchy with a fidelity no Euclidean space of comparable dimension matches. Yet hyperbolic language models confine that geometry to adapters or rebuild the transformer, and an independent audit of released hyperbolic vision language checkpoints finds their hierarchy mechanisms inactive, which has been read as evidence about the geometry or its objective. Here we show that it is also evidence about arithmetic. The constraint defining the manifold is a difference of two terms that grow together; for the unclamped map at unit curvature and temperature it fails in every format we measured, double precision included, at the norms standard language models produce in their deepest layers, beyond the limit previously derived. A common remedy, a norm bound, leaves the executed map no radial sensitivity where it acts. In a prespecified test, a tighter bound cost a Lorentz system more of the held out structure it started with than a flat one. Structural supervision has run in six expert systems over 20,951,552 training exposures. In paired runs with a published recipe's objective held fixed, removing its starting scale remedy prevented every update and removing its single precision regions raised the radius reached early in training. Arithmetic bounds the computable region, and within it, alongside the objective, arithmetic and its remedies select which runs leave a record and the states they reach on the way, so a flat surviving checkpoint cannot by itself establish that the geometry is inert.

Related papers