Two-Point Local Optimality in k-Means via Boundary-Point Screening
cs.LG
Submitted: 2026-10-05
Updated: 2026-10-05
Comments: 30 pages, including appendices. Code available at https://github.com/lwl-learning/BPS-2PLS
Code: https://github.com/lwl-learning/BPS-2PLS
License: http://creativecommons.org/licenses/by/4.0/
The gist: Lloyd's algorithm and the discrete local (D-local) optimization method (Li et al., 2025) for k-means provide only weak local-optimality guarantees, and their solution quality remains sensitive to
Abstract
Lloyd's algorithm and the discrete local (D-local) optimization method (Li et al., 2025) for k-means provide only weak local-optimality guarantees, and their solution quality remains sensitive to initialization. In this paper, we introduce r-point local optimality, under which no reassignment of at most r samples decreases the objective function, and focus on r=2. The main computational obstacle is the O(n 2(k 2+d)) cost of exhaustive two-point certification for n samples in d dimensions and k clusters. To address this challenge, we prove that (i) every improving two-point move of a D-local optimum must involve a cluster shared by both reassignments, and (ii) only certificate-defined boundary points can participate in an improving pair. Exploiting this structure, we propose Boundary-Point-Screened Two-Point Local Search (BPS-2PLS), which terminates at a two-point local optimum. For fixed k,d and nonvanishing cluster occupancy, the number m of retained candidates satisfies m= O P(n) under i.i.d. sampling from a bounded-support distribution with bounded density or from a Gaussian mixture. Across twelve benchmarks, BPS-2PLS attains the lowest available mean WCSS on ten. In a subsampling study, screening retains 0.10% to 2.81% of samples on average at the largest tested sizes. The code is available at https://github.com/lwl-learning/BPS-2PLS.
Sources
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks