Bandwidth rules for Dirichlet kernel density estimation on the simplex
stat.ME
Submitted: 2026-11-03
Updated: 2026-11-03
Comments: 30 pages, 7 figures, 4 tables
Code: https://github.com/JiajinX/Dirichlet_KDE
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Dirichlet kernels provide a natural tool for density estimation on the simplex, but data-driven bandwidth selection for them has been mostly limited to likelihood cross-validation (LCV).
Abstract
Dirichlet kernels provide a natural tool for density estimation on the simplex, but data-driven bandwidth selection for them has been mostly limited to likelihood cross-validation (LCV). We develop bandwidth selectors for Dirichlet kernel estimators of densities and projected first derivatives for compositional data. Using a Dirichlet mixture as the reference model, we derive an exact representation of the mean integrated squared error (MISE) and define the exact MISE (EMI) selector. We also derive a closed-form least-squares cross-validation (LSCV) criterion and introduce the reference-smoothed least-squares (RSLS) selector, which replaces the unstable leave-one-out term of LSCV with the fitted Dirichlet mixture. For derivative estimation, we obtain projected derivatives of the Dirichlet density and their integrability conditions, extend the new bandwidth selectors, and carry out kernel mean shift clustering on the simplex. Simulations show that EMI is the most competitive selector for larger samples and Dirichlet-like targets, RSLS generally performs best for small samples and is more stable than LSCV for derivative estimation, and LCV remains competitive for non-Dirichlet targets in density estimation. Applications to wholesale customer expenditure and sectoral employment data illustrate density estimation and clustering, respectively.
Sources
- Dirichlet kernel density estimation on the simplex with missing data
- Higher order differential analysis with vectorized derivatives
- Blessing of dimensionality in cross-validated bandwidth selection on the sphere
- Dirichlet kernel density estimation for strongly mixing sequences on the simplex
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes