VIDE 2.0: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys
summary
The gist
Current and future spectroscopic and photometric galaxy surveys will deliver unprecedented numbers of galaxies, with expected counts in the tens of millions vide 2.0…
In short
VIDE 2.0 is an improved void-finding algorithm for massive galaxy surveys, designed to handle millions of galaxies efficiently. It uses a parameter-free method based on Voronoi tessellation and watershed schemes to robustly identify voids and manage survey boundaries deterministically, leading to significant speedups and reduced memory usage compared to previous versions.
Key concepts
- Voronoi Tessellation
- This is a mathematical technique used to divide a space into regions based on proximity. In this algorithm, it's used without needing extra particles to define the void boundaries. It helps precisely map out the shape and location of voids in the galaxy distribution.
- Watershed Scheme
- The watershed scheme works with the Voronoi tessellation to further delineate distinct regions, specifically identifying where one void ends and another begins. This process is crucial for accurately separating individual voids within a large survey area.
- Deterministic Boundary Handling
- VIDE 2.0 handles survey edges and incompleteness without relying on random boundary particles or sampling pinholes. Instead, it uses a rule-based mechanism that is fully deterministic, meaning the exact same input always produces the exact same output catalog, ensuring reproducibility.
- Stage IV Void Cosmology Readiness
- The upgraded pipeline successfully produced converged statistical measures—like void number function and cross-correlations—from large mock catalogs. This demonstrates that VIDE 2.0 provides the reliable, non-stochastic inputs needed for advanced cosmological studies like Stage IV void cosmology.
Terminology used across episodes
This episode discusses
- VIDE 2.0: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys · Paper Radio
- Data Release 1 of the Dark Energy Spectroscopic Instrument
- Why Cosmic Voids Matter: Pristine Evolution
- From Voids to Clusters: Mergers and Evolutionary Pathways of Star-Forming and Quenched Low-Mass Galaxies · Paper Radio
- An Historical View: The Discovery of Voids in the Galaxy Distribution
- Exploring Cosmological Constraints of the Void-Lensing Cross-Correlation in the CSST Photometric Survey
- AVISM: Algorithm for Void Identification in coSMology
The paper
VIDE 2.0: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys · Read on arXiv
Paul M. Sutter, Benjamin D. Wandelt
Department of Physics and Astronomy, Johns Hopkins University · Department of Applied Mathematics and Statistics, Johns Hopkins University
Current and future spectroscopic and photometric galaxy surveys will deliver unprecedented numbers of galaxies, with expected counts in the tens of millions. To answer the computational challenges posed by these surveys, in this paper we present VIDE 2.0, a significantly improved and enhanced void finding algorithm and analysis pipeline based on VIDE. Leveraging the parameter-free identification of voids via a Voronoi tessellation and watershed scheme, we implement a robust mechanism for handling survey boundaries and incompleteness without relying on vast numbers of boundary particles. This new method identifies edge galaxies and flags voids contaminated by their presence. The mechanism is fully deterministic, producing bit-for-bit reproducible catalogs from identical inputs. An automatic rule for setting the mask resolution renders the entire pipeline parameter-free. Combined with other performance enhancements to the underlying VIDE engine, we find significant (>100 times) speedups and a dramatic reduction in memory usage compared to previous versions: a 12-million-galaxy DESI Y1-class mock catalog now completes in roughly 15 minutes on a single laptop, where VIDE 1.0 could not run a catalog of even 10 6 galaxies on the same hardware. We are also able to identify voids existing closer to survey boundaries via deterministic per-void contamination flags, maximizing their statistical potential. We exercise the upgraded pipeline on two large mock suites (MultiDark-Patchy DR12 and AbacusSummit DESI Y1 ELG), demonstrating converged cosmic-variance covariances for the void number function, the void-galaxy cross-correlation, and the void ellipticity distribution -- key ingredients for Stage IV void cosmology. VIDE 2.0 is now well suited to handle large numbers of galaxies in mock and real observations, and ready to tackle the challenges of future campaigns.
Transcript
Introduction to the show: ident: Astrophysics. The day in astrophysics: observations, models and what the data forces.
Vera: We're looking at the paper: "VIDE 2.0: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys".
Jocelyn: Here's the gist of the paper. Current and future spectroscopic and photometric galaxy surveys will deliver unprecedented numbers of galaxies, with expected counts in the tens of millions vide 2.0, a significantly improved and enhanced void finding algorithm and analysis pipeline based on vide (P.
Vera: M.
Jocelyn: Sutter et al.
Vera: 2015).
Paper summary: Vera: So, wrapping up on "VIDE two point zero: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys" and its authors Paul M <ref:2611.14742#pg1,VIDE 2.0: Robust, Scalable Void Finding for Extremely Large Galaxy Surveys>. Sutter and Benjamin D. Wandelt Vera. What we’ve seen is that this upgraded pipeline addresses the computational hurdles posed by the millions of galaxies we’re expecting from next generation spectroscopic and photometric surveys Vera.
Jocelyn: The title itself, "Robust, Scalable Void Finding," speaks to how they solved both the reliability problem and the scale problem simultaneously Jocelyn. It’s not just about finding voids; it's about finding them reliably across huge scales Jocelyn.
Subrahmanyan: And the implication is that we can now move forward with Stage IV void cosmology because we have a method that delivers deterministic, ensemble-level covariance estimation from commodity hardware Subrahmanyan. This means the theoretical predictions for how structure forms in the universe can be tested against real, massive galaxy surveys with much greater confidence Subrahmanyan.
Vera: The key is that they maintained that parameter-free spirit from earlier work while adding deterministic boundary handling, which produces bit-for-bit identical catalogs given the same inputs Vera. It gives researchers maximum freedom to use these void catalogs for whatever cosmological questions they have in mind Vera.
Jocelyn: And for listeners who just want the simple picture, it means that when we look at those giant galaxy surveys, we can trust the void measurements because they aren't being skewed by weird boundary artifacts or random setup choices Jocelyn. They’re ready for the real observations coming down the pipe Jocelyn.
Conclusion: Vera: So we're wrapping up on VIDE two point zero, this new void finding pipeline by Sutter and Wandelt Vera. Essentially, they’ve taken an older algorithm and made it much better for handling the massive galaxy counts coming from next-gen surveys Vera.
Jocelyn: It’s all about making sure that when you look at millions of galaxies, you don't end up with a mess because of the survey edges or missing data Jocelyn. They use this Voronoi tessellation and watershed scheme to find the voids in a way that doesn't rely on just dumping tons of extra boundary points into the system Jocelyn.
Subrahmanyan: The authors are pushing for this because they need a reliable way to get those void statistics for Stage IV cosmology, which means understanding how structure actually builds up across cosmic time Subrahmanyan. They claim this deterministic approach gives them those converged cosmic variance covariances that they need Subrahmanyan.
Vera: That sounds like it tackles the main headache of making sure your results aren't just random noise from the setup itself, right? It’s about getting a catalog that’s truly reproducible Vera.
Jocelyn: Exactly. They even have this mechanism to flag voids that might be contaminated by galaxies right near the survey boundary, which lets them keep more of those edge cases in their analysis Jocelyn.
Subrahmanyan: The implication here is that we can now run these complex void studies on standard hardware and get results that match what we’d expect from massive real surveys Subrahmanyan. It moves the bottleneck away from needing supercomputers just to process the initial data Subrahmanyan.
Vera: So, it’s about making those high-end cosmological insights accessible to a wider range of researchers by making the input pipeline extremely robust and fast Vera.
Jocelyn: And that deterministic nature is huge. It means if you run the exact same input catalog and mask twice, you get the exact same void catalog back every single time Jocelyn.
Subrahmanyan: That reproducibility is what lets us trust the ensemble work for things like measuring how big cosmic structures are evolving Subrahmanyan.
Vera: And it’s a big step for testing those models against the real data we're about to see from these new telescopes Vera.
More episodes
- 2607.17929-gevolution 2.0: GPU-accelerated relativistic N-body simulations for cosmology
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2509.02657-On the synergetic use of Ariel and JWST for exoplanet atmospheric science
- 2609.10042-Modelling Fourier filtering wavefront sensors for PSD-based methods: the AOPERA tool
- 2511.05639-Performance of the AstroPix Prototype Module for the Barrel Imaging Calorimeter at the ePIC Detector and in Space-Based Payloads
- 2610.19909-RPCA: a Resolved PSF reconstruction method for undersampled images
- 2512.03440-An Analysis of LIGO Glitches Using t-SNE During the First Part of the Fourth LIGO-Virgo-KAGRA Observing Run
- 2608.10284-Lunar Reflective Interferometry
- 2610.16633-Institutional broadening of the Japanese astronomy and astrophysics research community during 1996-2025