Characteristic function-based tests for spatial randomness
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Characteristic function-based tests for spatial randomness".
Jane: Here's the gist of the paper. We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects Test Development The core of the new test involves a weighted L2-like distance, scaled by n, defined as Δ = ∫ R D (1/n) Σ j=1 n exp(i t ⊺ x j) − φˆX(t) w(t) d t The weight function w(t) is usually chosen as the squared modulus of the CF, φ0 (t)2, or the Gaussian or double exponential (Laplace) density (Meintanis, 2016> Weight Function Choices The paper explores several choices for the weight function w(t), including: 1.
Tom: Bessel-like weight function: This produces a simple rectangular φr The expectation of the CF test statistic under the null hypothesis is E0 (Δr) = 1 − E0(φr (x1 − x2)) 2.
Jane: Normalized squared modulus of the null distribution CF φ0 (t): This is a common choice for weight function in the CF-based test 3.
Tom: Centered Gaussian weight function: This is the only weight function that is both isotropic and separable, making it valuable in high dimensions 4.
Paper summary: Tom: To summarize what this paper is about, Yiran Zeng and Dale L. Zimmerman introduce a new test for complete spatial randomness that works on mapped point patterns in any rectangle or cube dimension. Their main contribution is using characteristic functions and a weighted L2 distance between the empirical and uniform characteristic functions to do this, which they say is the first test of its kind based on characteristic functions.
Jane: They claim this new test has surprising connections to two established spatial tools: Ripley’s K-function and Zimmerman’s w2 statistic. It’s also presented as being simple to calculate and not requiring any adjustments for edge effects, which is a big deal in practical applications.
Lu: The methodology centers around a weighted L2-like distance, delta, scaled by n, defined as an integral involving the empirical characteristic function minus the uniform one weighted by some weight function w(t), and they explore several choices for that weight function.
Meng: They test different weight functions: they look at Bessel-like weights which give a simple rectangular rhat, or the normalized squared modulus of the null distribution characteristic function, or even a centered Gaussian weight function which is isotropic and separable in high dimensions.
Lalam: They also explore a Cauchy weight function, which leads to a specific statistic delta r that involves sums over j and k with exponential terms; they found that this Cauchy-weighted CF test statistic has much lower computational cost than the isotropicedge-corrected L-test, so it’s the focus of their investigation.
Tom: So we're seeing them compare different ways to weight this distance, and they chose the Cauchy one because it’s fast, and they show that even with that weighting, simulations validate its accuracy against other tests.
Jane: The simulation results are strong; the two-tailed tests using either method show a type I error rate very close to zero point five, which gives us confidence in the test's performance under the null hypothesis. They also compared it against Zimmerman’s w2-test and Clark-Evans test in applications.
Lu: The paper develops efficient algorithms for finding the asymptotic null distribution of this Cauchy-weighted statistic, validating its speed for large sample sizes by showing it converges in distribution to infinity times lambda j Z two where Z equals a sequence of independent standard normal variables and lambda j are the eigenvalues of the linear operator T.
Meng: From my side, focusing on that efficient algorithm is key because if we’re going to deploy this, we need something fast, so showing it's computationally cheaper than the L-test gives us a solid reason to use it over other options.
Lalam: And they also developed a Bonferroni-corrected omnibus test using multiple values of parameter r; this omnibus version is shown to be more well rounded because it beats the Clark-Evans test and the L-test in almost every simulation setting of heterogeneity, aggregation and regularity, especially when...
Tom: So we’re seeing that the idea isn't just one single test; they’re proposing a whole family of tests, with an omnibus version that seems to be more robust across different spatial conditions.
Jane: And the implications for us are that this framework allows us to test for spatial randomness in these complex shapes in a way that feels intuitive and directly tied to established concepts like Ripley's K-function.
Conclusion: Tom: So wrapping up this discussion on "Characteristic function-based tests for spatial randomness", the main point is that this work provides a new, characteristic function based test that applies to any rectangular or cubic region. It’s built on a weighted L2 distance and it connects it back to Ripley's K-function and Zimmerman's w2 statistic.
Jane: The authors show that they can construct this test in a way that is very simple to calculate because it avoids the need for edge effect adjustments, which makes it much more practical for real-world data analysis.
Lu: Theoretically, they derived the asymptotic distribution of the Cauchy-weighted CF test statistic to converge in distribution to infinity times lambda j Z two where Z equals a sequence of independent standard normal variables and lambda j are the eigenvalues of the linear operator T.
Meng: From an engineering viewpoint, they’re focusing on that efficient algorithm because it's what makes this viable for real deployment at scale, showing it has much lower computational cost compared to other methods like the isotropicedge-corrected L-test.
Lalam: And the main thing to remember is that while the exact relationship between the choice of weight function and the power of these tests against different alternative hypotheses isn't fully clear yet, it’s still an open area for more investigation.
Tom: So, in short, this paper gives us a test based on characteristic functions that works well across different spatial geometries without needing those tedious edge corrections.
Jane: It offers a practical way to check for spatial randomness that feels connected to established spatial statistics while being computationally efficient enough for many uses.
University of Iowa
stat.ME, stat.CO
Submitted: 2025-04-10
Updated: 2025-09-22
Importance score: 73/100
The gist: We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on
Key concepts
- Characteristic Function (CF)
- The CF is a mathematical tool used to describe the distribution of spatial point patterns. It transforms the probability density function into a function of an imaginary variable, which allows for powerful statistical tests regarding randomness and pattern structure.
- Weighted L2-distance ($\Delta$)
- This new distance measures how far the empirical characteristic function is from the uniform one, using a weighted L2 norm. The weight function $w(t)$ can be chosen in several ways (like the squared modulus of the CF), tailoring the test to specific statistical properties.
- Asymptotic Distribution
- The paper determines how the test statistic behaves as the sample size ($n$) gets very large. It converges to a distribution involving eigenvalues ($\lambda_j$) and standard normal variables, providing a theoretical basis for understanding the test's accuracy.
Terminology
Summary
We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects
Test Development
The core of the new test involves a weighted L2-like distance, scaled by n, defined as Δ = ∫ R D (1/n) Σ j=1 n exp(i t ⊺ x j) − φˆX(t) w(t) d t The weight function w(t) is usually chosen as the squared modulus of the CF, φ0 (t)2, or the Gaussian or double exponential (Laplace) density (Meintanis, 2016>
Weight Function Choices
The paper explores several choices for the weight function w(t), including:
-
Bessel-like weight function: This produces a simple rectangular φr The expectation of the CF test statistic under the null hypothesis is E0 (Δr) = 1 − E0(φr (x1 − x2))
-
Normalized squared modulus of the null distribution CF φ0 (t): This is a common choice for weight function in the CF-based test
-
Centered Gaussian weight function: This is the only weight function that is both isotropic and separable, making it valuable in high dimensions
-
Cauchy weight function: The corresponding statistic in [0, 1] D is Δr = (1/n) Σ j,k=1 exp (-1/r Σ d=1 x j d - x k d! − 2 Σ j=1 Ö D d=1 r n squared − e(-x j d / r) − e(-(1−x j d) / r) o + n/n 2r
Asymptotic Distribution and Efficiency
The paper develops efficient algorithms for the asymptotic and small-sample null distributions of the Cauchy-weighted statistic in Section 4 The Cauchy-weighted CF test is shown to have a much lower computational cost than the isotropicedge-corrected L-test, so it is chosen as the focus of investigation The Bonferroni-corrected omnibus CF test is demonstrated to be more well rounded than the individual CF tests
Simulation and Application
Simulations assess the accuracy of both proposed null distributions for the test statistic, showing that the two-tailed test using either method has a type I error rate very close to the theoretical value 0.05 The power of the CF test under different alternatives is compared against tests like Zimmerman’s w2-test and Clark-Evans test In application, the CF test outperforms other tests in most simulation settings of heterogeneity, aggregation and regularity, especially when the sample size is large The analysis applies the CF test to four example point patterns used in Zimmerman (1993) to demonstrate CSR, aggregation, regularity and heterogeneity
Theoretical Foundations
The asymptotic distribution of Δ converges in distribution to Í∞ j=1 λj Z2 j, where (Z j) is a sequence of independent standard normal variables and (λ j) are the eigenvalues of the linear operator T The paper derives the eigenvalues and asymptotic distribution using an efficient algorithm based on a special matrix form under certain conditions The moments of any order may be obtained in closed form in this case, which is not true at least for the variance when other weights like Gaussian or double exponential density functions are used The mth cumulant of test statistic Δ satisfies κm = (n − 1)/(2n) m-1/(2m) D/rD + o(rD) (m ≥ 2)
Conclusion and Future Directions
The exact relationship between the choice of the weight function and the power of the CF tests for different alternative hypotheses is still unclear The empirical CF has a unified formula even for non-rectangular study regions, such as disks, polygons, or disconnected shapes The test can also be applied to other types of null hypotheses for spatial point processes The three-dimensional CF statistic may be used to test for space-time CSR, but in practice testing for space-time interaction is usually of more interest than testing for CSR
References
Arbenz, P., Gander, W. & Golub, G. H. (1988). Restricted rank modification of the symmetric eigenvalue problem: Theoretical considerations
Baddeley, A., Rubak, E. & Turner, R. (2015). Spatial Point Patterns: Methodology and Applications with R
Baringhaus, L. & Henze, N. (1988). A consistent test for multivariate normality based on the empirical characteristic function
Blatter, C. (2014). The probability that the distance between two random points in a 3 × 3 square is less than √3
Bunch, J. R., Nielsen, C. P. & Sorensen, D. C. (1978). Rank-one modification of the symmetric eigenproblem
Clark, P. J. & Evans, F. C. (1954). Distance to nearest neighbor as a measure of spatial relationships in populations
Diggle, P. J., Gates, D. J. & Stibbard, A. (1987). A nonparametric estimator for pairwise-interaction point processes
Donnelly, K. (1978). Simulations to determine the variance and edge-effect of total nearest neighbour distance
Epps, T. W. (2005). Tests for location-scale families based on the empirical characteristic function
Epps, T. W. & Pulley, L. B. (1983). A test for normality based on the empirical characteristic function
Eubank, R. L. & LaRiccia, V. N. (1992). Asymptotic comparison of Cramer-von Mises and nonparametric function estimation techniques for testing goodness-of-fit
Fan, Y. (1997). Goodness-of-fit tests for a multivariate distribution by the empirical characteristic function
Gerrard, D. J. (1969). Competition Quotient: a New Measure of the Competition Affecting Individual Forest Trees, vol. 20
Gil-Pelaez, J. (1951). Note on the inversion theorem
Golub, G. H. (1973). Some modified matrix eigenvalue problems
Ho, L. P. & Chiu, S. N. (2007). Testing uniformity of a spatial point pattern
Illian, J., Penttinen, A., Stoyan, H. & Stoyan, D. (2007). The homogeneous poisson point process
Imhof, J. P. (1961). Computing the distribution of quadratic forms in normal variables
Jimenez-Gamero, M. D., Alba-Fernandez, V., Munoz-García, J. & Chalco-Cano, Y. (2009). Goodness-of-fit tests based on empirical characteristic functions
Koutrouvelis, I. A. (1980). A goodness-of-fit test of simple hypotheses based on the empirical characteristic function
Koutrouvelis, I. A. & Kellermeier, J. (1981). A goodness-of-fit test based on the empirical characteristic function when parameters must be estimated
Li, R.-C. (1994). Solving secular equations stably and efficiently
Matern, B. ´ (1986). Some particular models
Meintanis, S. (2016). A review of testing procedures based on the empirical characteristic function
Møller, J., Syversveen, A. R. & Waagepetersen, R. P. (1998). Log Gaussian Cox processes
Numata, M. (1961). Forest vegetation in the vicinity of Choshi: coastal flora and vegetation at Choshi, Chiba Prefecture IV (in Japanese)
Polya, G. ´ (1949). Remarks on characteristic functions
Rajala, T., Olhede, S., Grainger, J. & Murrell, D. (2023). What is the Fourier transform of a spatial point process? IEEE Transactions on Information Theory PP
Ripley, B. D. (1977). Modelling spatial patterns
Ripley, B. D. (1978). The analysis of geographical maps
Ripley, B. D. (1979). Tests of ‘randomness’ for spatial point patterns
Ripley, B. D. (1988). Edge corrections for spatial point processes
Sato, K. (2004). Remarks on Polya’s theorem on characteristic functions
Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics
Shaked, M. & Shanthikumar, J. G. (2007). Multivariate stochastic orders
Shephard, N. (1991). From characteristic function to distribution function: A simple framework for the theory
Strauss, D. J. (1975). A model for clustering This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects
The paper develops efficient algorithms for the asymptotic and small-sample null distributions of the Cauchy-weighted statistic in Section 4 The Cauchy-weighted CF test is shown to have a much lower computational cost than the isotropicedge-corrected L-test, so it is chosen as the focus of investigation
Simulations assess the accuracy of both proposed null distributions for the test statistic, showing that the two-tailed test using either method has a type I error rate very close to the theoretical value 0.05 The power of the CF test under different alternatives is compared against tests like Zimmerman’s w2-test and Clark-Evans test In application, the CF test outperforms other tests in most simulation settings of heterogeneity, aggregation and regularity, especially when the sample size is large
The asymptotic distribution of Δ converges in distribution to Í∞ j=1 λj Z2 j, where (Z j) is a sequence of independent standard normal variables and (λ j) are the eigenvalues of the linear operator T The moments are given in Section 4.
Improvements for AI systems
-
Improved spatial pattern analysis for complete spatial randomness by implementing a new test based on weighted L2-distance between empirical and uniform characteristic functions. This allows AI systems to determine whether a mapped point pattern follows complete spatial randomness, which is crucial for validating models of spatial uniformity, heterogeneity, and regularity in various dimensions.
-
Enhanced detection of spatial interactions at different scales by utilizing the scale parameter r in the Cauchy weighted characteristic function test statistic. AI systems can now precisely identify whether aggregation or regularity occurs at specific distance scales by analyzing the behavior of 1 - Delta r against r, as shown in Figure 4 of the paper.
-
Development of efficient algorithms for finding the asymptotic null distribution of the Cauchy-weighted CF test statistic under a Cauchy weight function. This enables AI systems to perform fast and accurate hypothesis testing without relying on computationally expensive Monte Carlo simulations for large sample sizes, reducing computational overhead significantly compared to older tests like the isotropicedge-corrected L-test.
-
Creation of an omnibus Bonferroni-corrected CF test that combines multiple parameter values of r. This allows AI systems to create a more powerful test than the L-test or Clark-Evans test in most simulation settings, offering better performance against heterogeneity, aggregation, and regularity when sample sizes are large.
-
Ability to extend spatial tests to non-rectangular or sparsely sampled point patterns using the empirical characteristic function. This means AI can analyze complex spatial data structures beyond simple rectangles, as the
empirical CF has a simple unified formula regardless of what the sampling region looks like—a disk, a polygon, or even a disconnected (or sparsely sampled) region.
Related papers
- Global synchronization for multi-source data integration under blockwise missing patterns
- Optimized Conformal Selection: Powerful Selective Inference After Data-Dependent Score Construction
- Anchored multiple testing: a transparent use of e-closure to improve FDR procedures
- Doubly robust inference via calibration
- Bayesian Empirical Bayes: Simultaneous Inference from Probabilistic Symmetries
- Sensitivity Analysis for Trials with Irregular and Informative Assessment Times: Marginal Mean Models and Sensitivity Parameter Selection