A Fast and Scalable Transformer Pipeline for Binary Black Hole Detection
gr-qc, astro-ph.GA
Submitted: 2026-08-31
Updated: 2026-09-23
Code: https://github.com/chayanchatterjee/castor
License: http://creativecommons.org/licenses/by/4.0/
The gist: With the projected increase in the detection rate of compact-binary coalescences in the coming decade, there is critical need to develop fast, robust, and scalable alternatives to matched filtering
Terminology
Abstract
With the projected increase in the detection rate of compact-binary coalescences in the coming decade, there is critical need to develop fast, robust, and scalable alternatives to matched filtering for gravitational-wave searches. Transformer models have revolutionized natural language and audio processing but their application to gravitational-wave astronomy is still largely unexplored. In this work, we introduce, a transformer-based coincident search pipeline for detecting binary black hole gravitational-wave signals from Advanced LIGO detectors. One of the major features of our model is that it allows the false-alarm rate to be estimated via time slides cheaply without requiring repeated evaluations of the neural network. We evaluate on datasets from the Machine-Learning Gravitational-Wave Search Challenge (MLGWSC-1) and on approximately five months of real O3b observing strain. When tested on benchmark datasets, ranks among the most sensitive machine-learning pipelines and successfully recovers the majority of confident events from the GWTC-3 catalog that lie within its training range. We also benchmark against another transformer architecture, GW-Whisper, a domain-adaptation of OpenAI's audio foundation model. We find that substantially outperforms the repurposed audio model in sensitivity and also reduces the computational cost of background estimation by a factor of 20. Our results demonstrate a highly practical, scalable approach for deep-learning gravitational wave searches and empirical background estimation for future observing runs.
Sources
- GWTC-4.0: Updating the Gravitational-Wave Transient Catalog with Observations from the First Part of the Fourth LIGO-Virgo-KAGRA Observing Run
- GWTC-4.0: Methods for Identifying and Characterizing Gravitational-wave Transients
- GWTC-5.0: Observations from the Second Part of the Fourth LIGO-Virgo-KAGRA Observing Run and Updates to the Gravitational-Wave Transient Catalog
- Cosmic Explorer: The U.S. Contribution to Gravitational-Wave Astronomy beyond LIGO
- The GstLAL Search Analysis Methods for Compact Binary Mergers in Advanced LIGO's Second and Advanced Virgo's First Observing Runs
- LIGO Detector Characterization in the Second and Third Parts of the Fourth Observing Run
- Rapid data quality investigations of gravitational-wave events with the Data Quality Report Builder toolkit
- Scalable matched-filtering pipeline for gravitational-wave searches of compact binary mergers
- The Sound of Noise: Leveraging the Inductive Bias of Pre-trained Audio Transformers for Glitch Identification in LIGO
- Applications of machine learning in gravitational wave research with current interferometric detectors
- A machine-learning pipeline for real-time detection of gravitational waves from compact binary coalescences
- AI-enabled gravitational-waves searches for binary neutron stars at optimal sensitivity
- Binary Neutron Star Merger Search Pipeline Powered by Deep Learning
- New Gravitational Wave Discoveries Enabled by Machine Learning
- Enhancing gravitational-wave detection: a machine learning pipeline combination approach with robust uncertainty quantification
- Pre-trained Audio Transformer as a Foundational AI Tool for Gravitational Waves
- Robust Speech Recognition via Large-Scale Weak Supervision
- DoRA: Weight-Decomposed Low-Rank Adaptation
Related papers
- Improving Slow-Roll Estimates in Starobinsky Inflation Using an Analytic Hubble Parameter
- Listening to the Horizon: Probing Near-Horizon Reflectivity with GW250114
- A Pairwise Surrogate for Gravitational-Wave Spectra from Highly Relativistic Vacuum Bubble Collisions
- Tests of General Relativity with Einstein Telescope
- A weakly modelled view of the joint compact-binary mass plane: population structure and spectral-siren cosmology
- Unitary quantum matter-bounce in a universe with a positive cosmological constant