Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models

summary

The gist

Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models is proposed to provide accurate, fast…

In short

The study proposes using a domain-aware coreset construction pipeline to make flood depth prediction fast and accurate for watersheds. By selecting representative storm events, it conditions a tabular foundation model at inference time, achieving high accuracy (R2 of 0.663) using only 0.7% of the total training data per watershed.

Key concepts

Tabular Foundation Model (TFM)
A single transformer model pretrained on a wide variety of synthetic tabular tasks. Instead of retraining for every new task, it solves a specific prediction problem by conditioning itself on a small set of labeled examples provided at inference time.
Domain-Aware Coreset Construction
A two-stage process to select a compact, hydrologically representative subset of simulation data. Stage 1 stratifies storms by return period and watershed, while Stage 2 uses target-aware spatial selectors to choose hexagons that cover the flood response surface effectively.
In-Context Learning (ICL)
The technique where the TFM is conditioned on a small context set of examples during inference. This allows the model to perform a specific task—like predicting flood depth—without needing full retraining, leveraging its strong pretrained knowledge.

Terminology used across episodes

This episode discusses

The paper

Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models · Read on arXiv

Lipai Huang, Adithi Srinath, Manas Singh, Junwei Ma, Ali Mostafavi

Urban Resilience.AI Lab · Department of Computer Science and Engineering, Texas A&M University

Near-real-time flood depth prediction demands surrogate models that are accurate, fast, and transferable across watersheds. Supervised surrogates can match physics-based simulators in accuracy but need millions of training rows per watershed and cannot extrapolate beyond their original mesh. We propose a domain-aware coreset construction pipeline that conditions a tabular foundation model at inference time. The pipeline stratifies storms by return period and most-affected watershed, then samples hexagons with a target-aware spatial selector. With 0.7% of the per-watershed training pool, the model attains a mean R squared of 0.663 across nine Houston-area watersheds, within 98.5% of the supervised reference (R squared = 0.673). It transfers to held-out watersheds without task-specific retraining, staying ahead of a coreset-trained supervised baseline. On real storms it exceeds the supervised reference on a far out-of-distribution case and trails it on a mostly in-distribution one. Domain-aware coreset construction lets tabular foundation models deliver data-efficient, watershed-transferable flood predictions without per-watershed training.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models".

Jane: Here's the gist of the paper. Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models is proposed to provide accurate, fast, and transferable watershed-level flood depth predictions by conditioning a tabular foundation model at inference time using a domain-aware coreset <ref:2606.05265#pg2> This pipeline achieves a mean R2 of 0.663 across nine Houston-area watersheds with only 0.7% of the per-watershed training pool <ref:2606.05265#pg9> It demonstrates that a vanilla TFM conditioned on the domain-aware coreset recovers 98.5% of a supervised baseline on held-out watersheds without retraining <ref:2606.05265#pg2> Domain-Aware Coreset Construction The pipeline involves a two-stage construction process to compress the physics-based simulation archive into a compact, hydrologically representative subset <ref:2606.05265#pg4> Stage 1 stratifies storm events by return period and most-affected watershed, while Stage 2 selects hexagons with a target-aware spatial selector <ref:2606.05265#pg5> The stratification ensures that rare high-RP events and their host watersheds survive sampling noise <ref:2606.05265#pg2> The coreset is the Cartesian product of N events sampled in Stage 1 and Nh hexagons selected per watershed in Stage 2, resulting in N rows per watershed <ref:2606.05265#pg8> How the training signal is built The input data consists of a HEC-RAS simulation database with 592 synthetic storm events across nine Houston-area watersheds <ref:2606.05265#pg4> Each row in the dataset carries 11 predictors and a target, including eight static geospatial features and three dynamic storm predictors <ref:2606.05265#pg4> Events are annotated with two derived fields used for stratification: the most-affected watershed and the RP bin <ref:2606.05265#pg5> The return period is assigned using a procedure that compares peak cumulative rainfall against NOAA Atlas 14 thresholds <ref:2606.05265#pg8> Where the gains come from The selection of in-context examples is central, addressing the issue that naive sampling ignores spatial autocorrelation and event-magnitude imbalance <ref:2606.05265#pg9> The two-stage construction balances event diversity against perwatershed hexagon coverage by setting a maximum context size N = 50k <ref:2606.05265#pg8> Target-aware spatial selection methods, such as FL-Depth, are shown to select hexagons that span the flood response surface by incorporating a z-scored target-depth signal <ref:2606.05265#pg9> Model Performance and Transferability The evaluation shows that Vanilla TabPFN-v2.6 reaches the highest mean R2 of 0.663 across nine watersheds at N = 50k <ref:2606.05265#pg10> This model recovers 98.5% of the Full-KB-XGB reference on held-out watersheds without retraining <ref:2606.05265#pg2> Cross-watershed transfer is achieved via a leave-one-out protocol where the context is built from other watersheds' coresets <ref:2606.05265#pg9> The model's performance on real storms confirms its capability to handle far out-of-distribution cases <ref:2606.05265#pg2> Vanilla TabPFN-v2.6 is identified as the optimal TFM in this evaluation due to its strong pretrained prior <ref:2606.05265#pg10> The dual stratification and target-aware selection are key design elements driving this success <ref:2606.05265#pg10> Future work includes evaluating on a wider set of historical storms and exploring hybrids combining TFM in-context inference with tree-based fitting <ref:2606.05265#pg10> The paper also notes that the 50k-row context cap leaves room to explore larger native windows of TabPFN-v2.6 at roughly 100k <ref:2606.05265#pg10> The mesh-to-H3 conversion standardizes spatial units but future evaluation should report sensitivity at both the H3 and original mesh-cell resolution <ref:2606.05265#pg10> The results here are reported in R2, and complementary metrics such as RMSE, MAE, and high-depth tail accuracy would further characterize operational reliability <ref:2606.05265#pg10> REFERENCES arXiv:2606.05265v1

cs.LG: 3 Jun 2026 Urban Resilience.AI Lab, Zachry Department of Civil and Environmental Engineering, Texas A&M University, College Station, TX, USA bDepartment of Computer Science and Engineering, Texas A&M University, College Station, TX Resilitix Intelligence LLC Institute for a Disaster Resilient Texas, Texas A&M University, College Station, TX A R T I C L E I N F O Keywords: Domain-aware coreset construction In-context learning Tabular foundation model Flood depth prediction Cross-watershed transferability Hydrodynamic surrogate A B S T R A C T Near-real-time flood depth prediction demands surrogate models that are accurate, fast, and transferable across watersheds We propose a domain-aware coreset construction pipeline that conditions a tabular foundation model at inference time The pipeline stratifies storms by return period and most-affected watershed, then samples hexagons with a target-aware spatial selector With 0.7% of the per-watershed training pool, the model attains a mean R2 of 0.663 across nine Houston-area watersheds, within 98.5% of the supervised reference (R2 = 0.673) It transfers to held-out watersheds without task-specific retraining, staying ahead of a coreset-trained supervised baseline On real storms it exceeds the supervised reference on a far out-of-distribution case and trails it on a mostly in-distribution one Domain-aware coreset construction lets tabular foundation models deliver data-efficient, watershed-transferable flood predictions without per-watershed training 1.

Tom: Introduction Timely flood depth information supports emergency managers and infrastructure operators during extreme weather events, and also underpins downstream assessments of flood exposure (Yin and Mostafavi, 2023), mobility disruption, and community resilience (Yin, Li and Mostafavi, 2026) Yet generating it at scale remains computationally demanding (Li, Ma, Brody and Mostafavi, 2025) Physics-based hydrodynamic models such as the Hydrologic Engineering Center’s River Analysis System (HEC-RAS) provide the engineering reference for inundation depth prediction Their cost grows quickly with simulated extent and mesh resolution, especially when many storm events must be screened A direct HEC-RAS sweep is therefore impractical for near-real-time forecasting or broad scenario testing (Ma, Li, Li and Mostafavi, 2026) Machine learning (ML) surrogates trained on simulator output have become a standard alternative and offer near-instant inference once trained (Bentivoglio, Isufi, Jonkman and Taormina, 2022; Mosavi, Ozturk and Chau, 2018) Existing surrogate work falls into two patterns The first trains one model per mesh cell, capturing local dynamics at fine resolution while producing a fragmented collection that cannot be applied beyond the original mesh (Lee, Huang, Antolini, Garcia, Juan, Brody and Mostafavi, 2024) The second trains a single supervised model on the full knowledge base of one watershed, which yields strong inwatershed accuracy but binds the predictor to its training region (Zahura, Goodall, Sadler, Shen, Morsy and Behl, 2020) Both patterns share the same operational drawback: each requires millions of training rows, and adding a new watershed or recalibrating after an event-regime shift entails another full training pass Tree-based gradient boosting (Chen and Guestrin, 2016) still dominates this space because deep tabular methods continue to underperform tree ensembles on structured input (Grinsztajn, Oyallon and Varoquaux, 2022) Deep learning has produced striking results on adjacent hydrologic tasks such as rainfall-runoff modeling (Kratzert, Klotz, Brenner, Schulz and Herrnegger, 2018), but for spatially distributed flood-depth surrogates the treebased pattern remains the practical default Transformer and foundation-model architectures have recently been adapted to structured disaster-management tasks, including post-disaster building-damage categorization (Xiao and Mostafavi, 2025), multimodal impact assessment (Xiao, Yin and Mostafavi, 2026), and graphbased damage prediction (Esparza, Battala and Mostafavi, 2026) Tabular foundation models (TFMs) such as TabPFN (Hollmann et al., 2025) and TabICL (Qu et al., 2024) offer a different path A TFM is a single transformer pretrained on a wide distribution of synthetic tabular tasks It solves a new task at inference time by conditioning on a labeled context set rather than through gradient updates This in-context learning (ICL) framing avoids per-task retraining, and a sufficiently strong pretrained backbone can rival task-specific supervised models on tabular benchmarks However, the context windows of the tabular foundation models considered in this work are bounded at roughly 104 to 105 rows (Hollmann et al., 2025; Grinsztajn, Flöge, Key, Birkel, Jund, Roof, Jäger, Hollmann and Hutter, 2025), while a single watershed’s simulation knowledge base typically reaches millions 3.

Jane: Data The primary data is the MaxFloodCast HEC-RAS simulation database (Lee et al., 2024) covering nine watersheds in Harris County, Texas The database contains 592 synthetic storm events generated by applying a Rasterized Time-series Resampling Method to historic storms in the area, with durations from 1 to 33 hours and hourly rainfall grids at approximately 1,010 m resolution Flood inundation depths are simulated by HEC-RAS 2D over an unstructured mesh of 26,301 cells (nominal size ≈ 366 m), refined along major watercourses and breaklined at high-elevation features From this database we inherit the cell-level peak inundation depth target and the per-event rainfall metadata To establish a uniform spatial unit across all variables, we discretize each mesh cell into H3 Level 10 hexagons (about 75 m edge length) via polygon polyfill (≈ 7.7 hexagons per mesh cell on average) Hexagons in the same mesh cell share that cell’s dynamic features (rainfall, depth) but carry their own static features, yielding 592 events × 177,330 hexagons ≈ 105 million rows with no missing values Each row carries 11 predictors and a target (Table 1) Eight static predictors describe local topography and hydrology: elevation, imperviousness, Topographic Wetness Index (TWI), road density within a 500 m radius, distance to coast, Height above Nearest Drainage (HAND), distance to the nearest stream, and distance to the nearest stream of order ≥ 4 Three dynamic predictors describe each storm: cumulative rainfall, peak rainfall intensity, and precipitation duration Among the static predictors, TWI follows the standard ln(SCA∕ tan β) formulation under D∞ flow routing (Tarboton, 1997) computed in SAGA GIS (Conrad, Bechtel, Bock, Dietrich, Fischer, Gerlitz, Wehberg and Böhner, 2015), and road density is the fraction of road area within a 500 m circular kernel applied to a 15 m-buffered roadway raster The target is the per-event peak inundation depth at each hexagon simulated by HEC-RAS Each storm is annotated with two derived fields used for stratification: the most-affected watershed and the RP bin 4.

Tom: Methodology 4.1.

Paper summary: Tom: So, we're wrapping up our look at this paper, "Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models". We've seen how they build a system that conditions a tabular foundation model at inference time using a domain aware coreset.

Jane: The central thesis is that near real time flood depth prediction demands surrogates that are accurate, fast, and transferable across watersheds, and this paper proposes a pipeline to achieve that by compressing the simulation archive first.

Lu: They compress it through a two stage construction: one stage stratifies events by return period and watershed, while the second selects H3 Level ten hexagons with a target aware facility location strategy on page three of this work <ref:2606.05265#pg2>.

Meng: The main claim they make is that vanilla foundation models can match the watershed level baseline with a fifty thousand row coreset, achieving a mean R squared of zero point six six three across nine Houston area watersheds.

Tom: And the key takeaway for us is that this approach allows them to recover ninety eight point five percent of a supervised reference on held out watersheds without retraining, and they transfer cross watershed accuracy using a leave one out protocol on page two of this work <ref:2606.05265#pg2>.

Jane: It seems like they’re showing how you can get decent flood depth predictions just by conditioning the model at inference time instead of doing heavy per watershed fine tuning.

Lalam: The paper shows that this method allows tabular foundation models to deliver data efficient watershed transferable flood predictions without requiring per watershed training.

Conclusion: Tom: Looking at the title, "Data-efficient flood depth prediction through domain aware coreset selection and tabular foundation models", it really captures the essence of what they did. It’s about using smart data sampling to make heavy AI models work on flood prediction tasks without needing massive amounts of per watershed training data.

Jane: I think the implication is that we can move towards faster, more accessible tools for emergency managers because they don't have to wait for huge training runs every time a new area needs predicting.

Lu: This method points toward using foundation models in an in context learning framework, where the coreset acts as the labeled context set to condition the model at inference time.

Meng: From a deployment standpoint, it means less compute per watershed and less maintenance when you have a new area needing coverage. The trade off is that you still need that initial two stage construction pipeline to build that representative subset, which takes upfront effort.

Tom: Exactly. It’s about using targeted data selection—that domain aware coreset construction—to make large tabular models practical for real world application in this kind of hydrology problem.

More episodes

← Home