Characteristic function-based tests for spatial randomness

arXiv:2504.07946 · stat.ME, stat.CO · Submitted 2025-04-10 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: We're looking at the paper: "Characteristic function-based tests for spatial randomness".

Jane: Here's the gist of the paper. We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects Test Development The core of the new test involves a weighted L2-like distance, scaled by n, defined as Δ = ∫ R D (1/n) Σ j=1 n exp(i t ⊺ x j) − φˆX(t) w(t) d t The weight function w(t) is usually chosen as the squared modulus of the CF, φ0 (t)2, or the Gaussian or double exponential (Laplace) density (Meintanis, 2016> Weight Function Choices The paper explores several choices for the weight function w(t), including: 1.

Tom: Bessel-like weight function: This produces a simple rectangular φr The expectation of the CF test statistic under the null hypothesis is E0 (Δr) = 1 − E0(φr (x1 − x2)) 2.

Jane: Normalized squared modulus of the null distribution CF φ0 (t): This is a common choice for weight function in the CF-based test 3.

Tom: Centered Gaussian weight function: This is the only weight function that is both isotropic and separable, making it valuable in high dimensions 4.

Paper summary: Tom: To summarize what this paper is about, Yiran Zeng and Dale L. Zimmerman introduce a new test for complete spatial randomness that works on mapped point patterns in any rectangle or cube dimension. Their main contribution is using characteristic functions and a weighted L2 distance between the empirical and uniform characteristic functions to do this, which they say is the first test of its kind based on characteristic functions.

Jane: They claim this new test has surprising connections to two established spatial tools: Ripley’s K-function and Zimmerman’s w2 statistic. It’s also presented as being simple to calculate and not requiring any adjustments for edge effects, which is a big deal in practical applications.

Lu: The methodology centers around a weighted L2-like distance, delta, scaled by n, defined as an integral involving the empirical characteristic function minus the uniform one weighted by some weight function w(t), and they explore several choices for that weight function.

Meng: They test different weight functions: they look at Bessel-like weights which give a simple rectangular rhat, or the normalized squared modulus of the null distribution characteristic function, or even a centered Gaussian weight function which is isotropic and separable in high dimensions.

Lalam: They also explore a Cauchy weight function, which leads to a specific statistic delta r that involves sums over j and k with exponential terms; they found that this Cauchy-weighted CF test statistic has much lower computational cost than the isotropicedge-corrected L-test, so it’s the focus of their investigation.

Tom: So we're seeing them compare different ways to weight this distance, and they chose the Cauchy one because it’s fast, and they show that even with that weighting, simulations validate its accuracy against other tests.

Jane: The simulation results are strong; the two-tailed tests using either method show a type I error rate very close to zero point five, which gives us confidence in the test's performance under the null hypothesis. They also compared it against Zimmerman’s w2-test and Clark-Evans test in applications.

Lu: The paper develops efficient algorithms for finding the asymptotic null distribution of this Cauchy-weighted statistic, validating its speed for large sample sizes by showing it converges in distribution to infinity times lambda j Z two where Z equals a sequence of independent standard normal variables and lambda j are the eigenvalues of the linear operator T.

Meng: From my side, focusing on that efficient algorithm is key because if we’re going to deploy this, we need something fast, so showing it's computationally cheaper than the L-test gives us a solid reason to use it over other options.

Lalam: And they also developed a Bonferroni-corrected omnibus test using multiple values of parameter r; this omnibus version is shown to be more well rounded because it beats the Clark-Evans test and the L-test in almost every simulation setting of heterogeneity, aggregation and regularity, especially when...

Tom: So we’re seeing that the idea isn't just one single test; they’re proposing a whole family of tests, with an omnibus version that seems to be more robust across different spatial conditions.

Jane: And the implications for us are that this framework allows us to test for spatial randomness in these complex shapes in a way that feels intuitive and directly tied to established concepts like Ripley's K-function.

Conclusion: Tom: So wrapping up this discussion on "Characteristic function-based tests for spatial randomness", the main point is that this work provides a new, characteristic function based test that applies to any rectangular or cubic region. It’s built on a weighted L2 distance and it connects it back to Ripley's K-function and Zimmerman's w2 statistic.

Jane: The authors show that they can construct this test in a way that is very simple to calculate because it avoids the need for edge effect adjustments, which makes it much more practical for real-world data analysis.

Lu: Theoretically, they derived the asymptotic distribution of the Cauchy-weighted CF test statistic to converge in distribution to infinity times lambda j Z two where Z equals a sequence of independent standard normal variables and lambda j are the eigenvalues of the linear operator T.

Meng: From an engineering viewpoint, they’re focusing on that efficient algorithm because it's what makes this viable for real deployment at scale, showing it has much lower computational cost compared to other methods like the isotropicedge-corrected L-test.

Lalam: And the main thing to remember is that while the exact relationship between the choice of weight function and the power of these tests against different alternative hypotheses isn't fully clear yet, it’s still an open area for more investigation.

Tom: So, in short, this paper gives us a test based on characteristic functions that works well across different spatial geometries without needing those tedious edge corrections.

Jane: It offers a practical way to check for spatial randomness that feels connected to established spatial statistics while being computationally efficient enough for many uses.

University of Iowa

stat.ME, stat.CO

Submitted: 2025-04-10

Updated: 2025-09-22

Importance score: 73/100

The gist: We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on

Key concepts

Characteristic Function (CF)
The CF is a mathematical tool used to describe the distribution of spatial point patterns. It transforms the probability density function into a function of an imaginary variable, which allows for powerful statistical tests regarding randomness and pattern structure.
Weighted L2-distance ($\Delta$)
This new distance measures how far the empirical characteristic function is from the uniform one, using a weighted L2 norm. The weight function $w(t)$ can be chosen in several ways (like the squared modulus of the CF), tailoring the test to specific statistical properties.
Asymptotic Distribution
The paper determines how the test statistic behaves as the sample size ($n$) gets very large. It converges to a distribution involving eigenvalues ($\lambda_j$) and standard normal variables, providing a theoretical basis for understanding the test's accuracy.

Terminology

Summary

We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects

Test Development

The core of the new test involves a weighted L2-like distance, scaled by n, defined as Δ = ∫ R D (1/n) Σ j=1 n exp(i t ⊺ x j) − φˆX(t) w(t) d t The weight function w(t) is usually chosen as the squared modulus of the CF, φ0 (t)2, or the Gaussian or double exponential (Laplace) density (Meintanis, 2016>

Weight Function Choices

The paper explores several choices for the weight function w(t), including:

  1. Bessel-like weight function: This produces a simple rectangular φr The expectation of the CF test statistic under the null hypothesis is E0 (Δr) = 1 − E0(φr (x1 − x2))

  2. Normalized squared modulus of the null distribution CF φ0 (t): This is a common choice for weight function in the CF-based test

  3. Centered Gaussian weight function: This is the only weight function that is both isotropic and separable, making it valuable in high dimensions

  4. Cauchy weight function: The corresponding statistic in [0, 1] D is Δr = (1/n) Σ j,k=1 exp (-1/r Σ d=1 x j d - x k d! − 2 Σ j=1 Ö D d=1 r n squared − e(-x j d / r) − e(-(1−x j d) / r) o + n/n 2r

Asymptotic Distribution and Efficiency

The paper develops efficient algorithms for the asymptotic and small-sample null distributions of the Cauchy-weighted statistic in Section 4 The Cauchy-weighted CF test is shown to have a much lower computational cost than the isotropicedge-corrected L-test, so it is chosen as the focus of investigation The Bonferroni-corrected omnibus CF test is demonstrated to be more well rounded than the individual CF tests

Simulation and Application

Simulations assess the accuracy of both proposed null distributions for the test statistic, showing that the two-tailed test using either method has a type I error rate very close to the theoretical value 0.05 The power of the CF test under different alternatives is compared against tests like Zimmerman’s w2-test and Clark-Evans test In application, the CF test outperforms other tests in most simulation settings of heterogeneity, aggregation and regularity, especially when the sample size is large The analysis applies the CF test to four example point patterns used in Zimmerman (1993) to demonstrate CSR, aggregation, regularity and heterogeneity

Theoretical Foundations

The asymptotic distribution of Δ converges in distribution to Í∞ j=1 λj Z2 j, where (Z j) is a sequence of independent standard normal variables and (λ j) are the eigenvalues of the linear operator T The paper derives the eigenvalues and asymptotic distribution using an efficient algorithm based on a special matrix form under certain conditions The moments of any order may be obtained in closed form in this case, which is not true at least for the variance when other weights like Gaussian or double exponential density functions are used The mth cumulant of test statistic Δ satisfies κm = (n − 1)/(2n) m-1/(2m) D/rD + o(rD) (m ≥ 2)

Conclusion and Future Directions

The exact relationship between the choice of the weight function and the power of the CF tests for different alternative hypotheses is still unclear The empirical CF has a unified formula even for non-rectangular study regions, such as disks, polygons, or disconnected shapes The test can also be applied to other types of null hypotheses for spatial point processes The three-dimensional CF statistic may be used to test for space-time CSR, but in practice testing for space-time interaction is usually of more interest than testing for CSR

References

Arbenz, P., Gander, W. & Golub, G. H. (1988). Restricted rank modification of the symmetric eigenvalue problem: Theoretical considerations

Baddeley, A., Rubak, E. & Turner, R. (2015). Spatial Point Patterns: Methodology and Applications with R

Baringhaus, L. & Henze, N. (1988). A consistent test for multivariate normality based on the empirical characteristic function

Blatter, C. (2014). The probability that the distance between two random points in a 3 × 3 square is less than √3

Bunch, J. R., Nielsen, C. P. & Sorensen, D. C. (1978). Rank-one modification of the symmetric eigenproblem

Clark, P. J. & Evans, F. C. (1954). Distance to nearest neighbor as a measure of spatial relationships in populations

Diggle, P. J., Gates, D. J. & Stibbard, A. (1987). A nonparametric estimator for pairwise-interaction point processes

Donnelly, K. (1978). Simulations to determine the variance and edge-effect of total nearest neighbour distance

Epps, T. W. (2005). Tests for location-scale families based on the empirical characteristic function

Epps, T. W. & Pulley, L. B. (1983). A test for normality based on the empirical characteristic function

Eubank, R. L. & LaRiccia, V. N. (1992). Asymptotic comparison of Cramer-von Mises and nonparametric function estimation techniques for testing goodness-of-fit

Fan, Y. (1997). Goodness-of-fit tests for a multivariate distribution by the empirical characteristic function

Gerrard, D. J. (1969). Competition Quotient: a New Measure of the Competition Affecting Individual Forest Trees, vol. 20

Gil-Pelaez, J. (1951). Note on the inversion theorem

Golub, G. H. (1973). Some modified matrix eigenvalue problems

Ho, L. P. & Chiu, S. N. (2007). Testing uniformity of a spatial point pattern

Illian, J., Penttinen, A., Stoyan, H. & Stoyan, D. (2007). The homogeneous poisson point process

Imhof, J. P. (1961). Computing the distribution of quadratic forms in normal variables

Jimenez-Gamero, M. D., Alba-Fernandez, V., Munoz-García, J. & Chalco-Cano, Y. (2009). Goodness-of-fit tests based on empirical characteristic functions

Koutrouvelis, I. A. (1980). A goodness-of-fit test of simple hypotheses based on the empirical characteristic function

Koutrouvelis, I. A. & Kellermeier, J. (1981). A goodness-of-fit test based on the empirical characteristic function when parameters must be estimated

Li, R.-C. (1994). Solving secular equations stably and efficiently

Matern, B. ´ (1986). Some particular models

Meintanis, S. (2016). A review of testing procedures based on the empirical characteristic function

Møller, J., Syversveen, A. R. & Waagepetersen, R. P. (1998). Log Gaussian Cox processes

Numata, M. (1961). Forest vegetation in the vicinity of Choshi: coastal flora and vegetation at Choshi, Chiba Prefecture IV (in Japanese)

Polya, G. ´ (1949). Remarks on characteristic functions

Rajala, T., Olhede, S., Grainger, J. & Murrell, D. (2023). What is the Fourier transform of a spatial point process? IEEE Transactions on Information Theory PP

Ripley, B. D. (1977). Modelling spatial patterns

Ripley, B. D. (1978). The analysis of geographical maps

Ripley, B. D. (1979). Tests of ‘randomness’ for spatial point patterns

Ripley, B. D. (1988). Edge corrections for spatial point processes

Sato, K. (2004). Remarks on Polya’s theorem on characteristic functions

Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics

Shaked, M. & Shanthikumar, J. G. (2007). Multivariate stochastic orders

Shephard, N. (1991). From characteristic function to distribution function: A simple framework for the theory

Strauss, D. J. (1975). A model for clustering This is the first test of its kind to be based on characteristic functions and utilizes a weighted L2-distance between the empirical and uniform characteristic functions The test shows surprising connections to Ripley’s K-function and Zimmerman’s w2 statistic It is also simple to calculate and does not require adjusting for edge effects

The paper develops efficient algorithms for the asymptotic and small-sample null distributions of the Cauchy-weighted statistic in Section 4 The Cauchy-weighted CF test is shown to have a much lower computational cost than the isotropicedge-corrected L-test, so it is chosen as the focus of investigation

Simulations assess the accuracy of both proposed null distributions for the test statistic, showing that the two-tailed test using either method has a type I error rate very close to the theoretical value 0.05 The power of the CF test under different alternatives is compared against tests like Zimmerman’s w2-test and Clark-Evans test In application, the CF test outperforms other tests in most simulation settings of heterogeneity, aggregation and regularity, especially when the sample size is large

The asymptotic distribution of Δ converges in distribution to Í∞ j=1 λj Z2 j, where (Z j) is a sequence of independent standard normal variables and (λ j) are the eigenvalues of the linear operator T The moments are given in Section 4.

Improvements for AI systems

  1. Improved spatial pattern analysis for complete spatial randomness by implementing a new test based on weighted L2-distance between empirical and uniform characteristic functions. This allows AI systems to determine whether a mapped point pattern follows complete spatial randomness, which is crucial for validating models of spatial uniformity, heterogeneity, and regularity in various dimensions.

  2. Enhanced detection of spatial interactions at different scales by utilizing the scale parameter r in the Cauchy weighted characteristic function test statistic. AI systems can now precisely identify whether aggregation or regularity occurs at specific distance scales by analyzing the behavior of 1 - Delta r against r, as shown in Figure 4 of the paper.

  3. Development of efficient algorithms for finding the asymptotic null distribution of the Cauchy-weighted CF test statistic under a Cauchy weight function. This enables AI systems to perform fast and accurate hypothesis testing without relying on computationally expensive Monte Carlo simulations for large sample sizes, reducing computational overhead significantly compared to older tests like the isotropicedge-corrected L-test.

  4. Creation of an omnibus Bonferroni-corrected CF test that combines multiple parameter values of r. This allows AI systems to create a more powerful test than the L-test or Clark-Evans test in most simulation settings, offering better performance against heterogeneity, aggregation, and regularity when sample sizes are large.

  5. Ability to extend spatial tests to non-rectangular or sparsely sampled point patterns using the empirical characteristic function. This means AI can analyze complex spatial data structures beyond simple rectangles, as the empirical CF has a simple unified formula regardless of what the sampling region looks like—a disk, a polygon, or even a disconnected (or sparsely sampled) region.

Related papers