A survey detection channel overrides the pixels in an astronomical foundation model, and biases tomographic mean redshifts
cs.AI, astro-ph.IM
Submitted: 2026-08-23
Updated: 2026-08-23
License: http://creativecommons.org/licenses/by/4.0/
The gist: Foundation models for astronomy are trained on survey pixels together with the catalogue products derived from those pixels.
Terminology
Abstract
Foundation models for astronomy are trained on survey pixels together with the catalogue products derived from those pixels. Those catalogues are incomplete at a measurable rate, and a model trained on both inherits that incompleteness as a systematic. We audit AION-1, a 39-modality transformer trained on more than 200 million objects, using causal interventions on its inputs. Holding the image tokens byte-identical and editing only the survey segmentation map changes every quantity the model reports -- flux, size, ellipticity, redshift -- by 110-4400 times a matched placebo. The mechanism is detection gating, presence at the field centre (r = 0.47), not the light the mask encloses (r = 0.30); across 322 real blends the model ignores how the pipeline partitioned the light (R = -0.006). Nor is the preference specific to that channel: contradicted catalogue photometry leaves the model nine times worse than supplying no metadata at all. The Legacy Survey pipeline leaves 3.68% of targets with no segment covering their position. Propagating that rate, with a miss represented by the fields the pipeline actually returns, shifts tomographic mean redshifts by a median 0.71 times the LSST DESC requirement over 40 assignments and exceeds it in 12; observed positional errors take the worst bin to 8.3 times. Drawing the misses by their measured magnitude dependence rather than uniformly does not change it. Spectroscopy removes the effect, withholding the detection channel removes it at no measurable cost, and the effect grows with model scale. Two further limits lie in the tokeniser: its image codec resolves 28 effective states on source patches against 934 for the spectrum codec, and the redshift readout is quantisation-limited. Sparse dictionaries are unreliable causal handles: across 15, recovery spans 26-75% and moves up to 18 points on the seed alone.
Sources
- Discovering Symbolic Models from Deep Learning with Inductive Biases
- The DESI Survey Validation: Results from Visual Inspection of Bright Galaxies, Luminous Red Galaxies, and Emission Line Galaxies
- A ConvNet for the 2020s
- Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models
- Walrus: A Cross-Domain Foundation Model for Continuum Dynamics
- Locating and Editing Factual Associations in GPT
- The Linear Representation Hypothesis and the Geometry of Large Language Models
- AION-1: Omnimodal Foundation Model for Astronomical Sciences
- Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
- Vector-quantized Image Modeling with Improved VQGAN
- Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation
- Interpreting CLIP with Hierarchical Sparse Autoencoders
- Towards Best Practices of Activation Patching in Language Models: Metrics and Methods
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems