Apparent Compression, Real Stability: The Intrinsic Dimension of Learning a Quantum Wavefunction
cs.LG, quant-ph
Submitted: 2026-09-27
Updated: 2026-09-27
Comments: 18 pages, 9 figures, 6 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: How many directions in weight space does training need? The intrinsic dimension answers this with the smallest number of random directions in which training still reaches a target accuracy, and small
Terminology
Abstract
How many directions in weight space does training need? The intrinsic dimension answers this with the smallest number of random directions in which training still reaches a target accuracy, and small values have motivated parameter-efficient methods such as LoRA. We measure it for variational Monte Carlo (VMC), which trains a neural network to represent the ground state of a quantum many-body system. VMC is a demanding test, because the network generates its own training samples and every gradient is noisy, and a revealing one, because the exact answer is known and every run can be scored. We train only a small latent vector that a frozen random map turns into the network's weights, with no change to the standard natural-gradient optimizer. We find that a small dimension can be misleading, while the stability it brings is real. On a magnet with a hard sign pattern, a network that cannot represent signs reaches its best energy in 8 of 28,642 directions, but only because no such network can go lower; once signs are learnable, neither the signs nor the magnitudes are cheap. The dimension rises across a quantum phase transition, so it tracks how difficult a state is at far less compute than fitting a scaling law, yet it never falls below a floor set by the random subspace itself, even where the ground state is nearly trivial. Training in the subspace, in contrast, never diverged in our experiments, whereas full-parameter training with the same settings did, and a control with matched solvers attributes the difference to the reduced dimension.
Sources
- Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
- Connectivity determines the capability of sparse neural network quantum states
- Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape
- Solving the Quantum Many-Body Problem with Artificial Neural Networks
- NetKet: A Machine Learning Toolkit for Many-Body Quantum Systems
- Empowering deep neural quantum states through efficient optimization
- Study of the Two-Dimensional Frustrated J1-J2 Model with Neural Network Quantum States
- Efficiency of neural quantum states in light of the quantum geometric tensor
- Towards Interpretability of Neural Quantum States
- The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
- Adiabatic Fine-Tuning of Neural Quantum States Enables Detection of Phase Transitions in Weight Space
- LoRA: Low-Rank Adaptation of Large Language Models
- How many degrees of freedom do we need to train deep networks: a loss landscape perspective
- Measuring the Intrinsic Dimension of Objective Landscapes
- Unsupervised learning universal critical behavior via the intrinsic dimension
- Improving neural network performance for solving quantum sign structure
- Geometry of learning neural quantum states
- Fine-tuning Neural Network Quantum States
- A simple linear algebra identity to optimize Large-Scale Neural Network Quantum States
- Scaling Laws for Neural-Network Quantum States
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks