Geometric inflation of deviations challenges neural quantum states in dynamics of quantum Ising models

Neural quantum states (NQS) have emerged as a powerful framework for simulating non-equilibrium dynamics in strongly correlated quantum systems, offering scalable variational representations of highly entangled states. Yet, accurate NQS simulations have been found to be surprisingly challenging in some physical regimes of limited complexity. Here, we address paradigmatic quench dynamics of a one-dimensional quantum Ising model as a controlled benchmark. Through supervised state reconstruction we establish substantially tighter empirical upper bounds on the required parameter count than previous estimates, ruling out representational limitations as the key obstruction. Instead, we uncover a geometric inflation of small deviations as a hitherto overlooked challenge for accurate solutions of the infinitesimal time-dependent variational principle (TDVP): the dynamical rotation of the kernel of the quantum geometric tensor (QGT) can suddenly lend physical significance to previously irrelevant parameter deviations. The stability of matrix product state solutions of the same TDVP suggests that the non-linearity of the neural network ansatz is the origin of the sensitivity. These results identify QGT-null-space rotation as a geometric diagnostic of sensitive NQS dynamics and as a concrete target for improving TDVP algorithms.