Efficient Neural Field Learning via Adaptive Coverage and Focused Sampling
cs.LG, cs.AI
Submitted: 2026-10-01
Updated: 2026-10-01
Comments: 22 pages. Accepted at NeurIPS 2026
Code: https://github.com/guangzhao27/ACES-Adaptive-Coverage-aware-Efficient-Sampling
License: http://creativecommons.org/licenses/by/4.0/
The gist: Implicit neural representations (INRs) provide a flexible framework for modeling high-dimensional continuous fields, but their training is often inefficient due to uniform subsampling that ignores
Abstract
Implicit neural representations (INRs) provide a flexible framework for modeling high-dimensional continuous fields, but their training is often inefficient due to uniform subsampling that ignores spatial heterogeneity. Existing adaptive sampling methods partially address this issue by prioritizing high-error samples, but typically operate at the point level, often leading to redundant sampling in localized regions and insufficient coverage of the domain. We propose ACES (Adaptive Coverage-aware Efficient Sampling), a structured sampling framework that improves training efficiency by decoupling coverage and importance. ACES constructs adaptive spatial partitions to ensure domain coverage and reduce redundancy, and applies region-level importance weighting to prioritize informative regions during training. We provide a theoretical analysis showing that adaptive partitioning reduces gradient variance by increasing within-region homogeneity, and that controlled bias in region-level weighting may improve optimization efficiency relative to standard unbiased estimators. Experiments on scientific field learning tasks demonstrate that ACES achieves faster convergence and lower error than uniform and pointwise adaptive sampling baselines, with the largest gains in fields with highly localized complexity.
Sources
- A Study of Gradient Variance in Deep Learning
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
- DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
- Representation Learning for Spatiotemporal Physical Systems
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
- Nonparametric Teaching of Implicit Neural Representations
- Accelerating Minibatch Stochastic Gradient Descent using Stratified Sampling
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks