Adaptive Nystr"om for Gaussian Process Regression
Lulu Kang
stat.ME, stat.ML
Submitted: 2026-07-29
Comments: 13 pages, 1 figure. Accepted by 2026 Winter Simulation Conference
License: http://creativecommons.org/licenses/by/4.0/
The gist: Gaussian Process Regression (GPR) is a robust framework for uncertainty quantification, yet its O(n 3) complexity limits its scalability.
Terminology
Abstract
Gaussian Process Regression (GPR) is a robust framework for uncertainty quantification, yet its O(n 3) complexity limits its scalability. Low-rank Nystr"om approximations can reduce this burden to O(nm 2), but their accuracy depends heavily on the selection of landmark points. We propose an adaptive Nystr"om approach that greedily selects landmarks to minimize the trace residual of the kernel approximation error. Unlike static approximations, our method interleaves landmark expansion with hyperparameter optimization, allowing the selection process to adapt as the covariance structure is refined. Numerical experiments on five benchmark functions demonstrate that this method significantly outperforms random landmark selection in both accuracy and stability. It achieves predictive performance comparable to exact GP inference while maintaining linear scaling with respect to the sample size, providing a principled and efficient framework for large-scale computer experiments.
Sources
Related papers
- Doubly robust inference via calibration
- Bayesian Empirical Bayes: Simultaneous Inference from Probabilistic Symmetries
- Weak-Form Recovery of Stochastic Generators
- Optimal Watermark Localization in Mixed-Source Large Language Model Texts
- Optimized Conformal Selection: Powerful Selective Inference After Data-Dependent Score Construction
- Small area learning