Manifold Dimension Estimation via Local Graph Structure
stat.ML, cs.LG, stat.AP
Submitted: 2025-10-16
Updated: 2026-09-14
Comments: multiple appendix sections added, main contents updated to incorporate new theoretical results
Code: https://github.com/loong-bi/manifold-dimension-estimation
License: http://creativecommons.org/licenses/by/4.0/
The gist: Most existing manifold dimension estimators rely on the assumption that the underlying manifold is locally flat within the neighborhoods under consideration.
Terminology
Abstract
Most existing manifold dimension estimators rely on the assumption that the underlying manifold is locally flat within the neighborhoods under consideration. More recently, curvature-adjusted principal component analysis (CA-PCA) has emerged as a powerful alternative by explicitly accounting for the manifold's curvature. Motivated by these ideas, we propose a manifold dimension estimation framework that captures the local graph structure of the manifold through regression on local PCA coordinates. Within this framework, we introduce two representative estimators: quadratic embedding (QE) and total least squares (TLS). Experiments on both synthetic and real-world datasets demonstrate that these methods perform competitively with, and often outperform, state-of-the-art approaches.
Sources
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Auto-Encoding Variational Bayes
- Intrinsic dimension estimation of data by principal component analysis
- A Survey and Comparative Evaluation of Intrinsic Dimension Estimators under the Manifold Hypothesis
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier