Graph-based Automated Discovery of Concise Soil Hydraulic Functions from Data: Beyond Empirical Formulations

summary

The gist

Soil hydraulic functions are fundamental to modelling water flow and transport in vadose-zone hydrology and are central to a wide range of hydrological and geoscientific applications Here we present…

In short

This research used a graph-based automated model discovery framework to find explicit soil hydraulic functions from experimental data across 249 soil samples. The resulting model is more accurate for predicting unsaturated hydraulic conductivity than the standard MvG model, offering a new, analytically integrable functional form for soil water retention curves.

Key concepts

Graph Encoding
The framework represents a mathematical equation as a directed acyclic graph (DAG). Nodes represent variables or operators in the equation, and edges show how these components are computationally connected. Edge features encode parameters that can vary between different soil samples, allowing the model to capture sample-specific behavior.
Generation-Evaluation-Evolution
This is the core discovery process driven by genetic programming. The system randomly generates candidate equations (graphs), evaluates them using a loss function that penalizes both prediction errors and excessive complexity (number of parameters), and then uses crossover and mutation to evolve better models over many iterations.
Loss Function
The evaluation metric used to judge a candidate model consists of two parts: data loss, which measures the average squared error between the model's predictions and the experimental data, and a complexity penalty. This penalty discourages overly complex equations that might just memorize the data without generalizing well.
Soil Texture Dependence
Statistical analysis showed that soil-specific parameters are strongly related to soil texture. For instance, coarse soils favored one parameter setting (p=1), while fine soils favored another (p=3). This indicates that the model's parameters naturally adapt based on the physical properties of the soil particles.

Terminology used across episodes

This episode discusses

The paper

Graph-based Automated Discovery of Concise Soil Hydraulic Functions from Data: Beyond Empirical Formulations · Read on arXiv

Hao Xu, Jinshen Sun, Yuntian Chen, *Dongxiao Zhang

Zhejiang Key Laboratory of Industrial Intelligence and Digital Twin · Department of Electrical Engineering, Tsinghua University · CNPC Engineering Technology R&D Company Limited

Soil hydraulic functions underpin water flow and transport modeling in the vadose zone, yet they are commonly represented by expert-designed formulations such as the Mualem-van Genuchten (MvG) model. Because these formulations rest on predefined functional assumptions, balancing predictive accuracy and parametric compactness across soil textures remains challenging. Here we introduce a graph-based equation discovery framework that distills soil hydraulic functions from experimental data. Reapplied to the original datasets that motivated the MvG parameterization, the framework recovers a concise water retention function together with an analytical unsaturated hydraulic conductivity expression whose mathematical structure departs from classical empirical forms. Evaluated across soils of contrasting texture, the discovered model predicts unsaturated hydraulic conductivity more accurately than MvG and its common variants, while its fitted parameters retain interpretable correlations with measurable soil physical properties. These findings suggest that data-driven discovery can yield compact, analytically tractable constitutive relations that move beyond fixed empirical formulations.

Transcript

Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.

Kai: We're looking at the paper: "Graph-based Automated Discovery of Concise Soil Hydraulic Functions from Data".

Mira: Here's the gist of the paper. Soil hydraulic functions are fundamental to modelling water flow and transport in vadose-zone hydrology and are central to a wide range of hydrological and geoscientific applications Here we present a graph-based automated model discovery framework for discovering explicit soil hydraulic functions directly from experimental data Across 249 real soil samples spanning diverse textural classes, the discovered functions achieve more accurate predictions of unsaturated hydraulic conductivity than the MvG model This work demonstrates that data-driven model discovery can move beyond traditional empirical derivation and provide a promising route for developing accurate and explicit constitutive models.

Kai: Automated Model Discovery Framework The proposed framework encodes an equation as a directed acyclic graph G=(V,E), where nodes correspond to variables or operators and edges capture computational dependencies To capture variability across different soil samples, edge features encode parametric dependencies through fixed constants or undetermined parameters.

Mira: The discovery process follows a “generation-evaluation-evolution” paradigm implemented through genetic programming.

Kai: This involves randomly generating candidate graphs, applying crossover and mutation operations to explore the expression space, and evaluating each graph using a loss function.

Paper summary: Kai: So we're looking at this paper today called "Graph-based Automated Discovery of Concise Soil Hydraulic Functions from Data: Beyond Empirical Formulations". Mira, what’s the main idea here?

Mira: Basically, they’re tackling how soil hydraulic functions are modeled. right now, most people use these expert-designed empirical formulas like the Mualem van Genuchten model. but those models have trouble being both accurate and compact when you look at different soil types. this paper proposes a graph-based method to discover these functions directly from experimental data instead of just guessing them based on existing formulas.

Lev: So it’s about building a system that finds the actual equation, not just fitting some curve to the data points we already have. that sounds like it could be useful for checking if the underlying physics are actually what we think they are or if we're missing something fundamental.

Kai: Exactly, and they claim this discovery works across two hundred forty-nine real soil samples that cover a lot of different textures <ref:2605.19379#pg2,across 249 real soil samples>. the core thesis is that this automated discovery method finds a specific mathematical structure for water retention and hydraulic conductivity that is different from the classic MvG model.

Mira: They show that this newly discovered structure leads to better predictions for unsaturated hydraulic conductivity compared to the MvG model, achieving an overall root mean square error of two point five zero two for log of K r compared to three point zero six nine for the MvG model, as stated in the abstract >

Lev: That difference in error numbers is significant because it means the new form is statistically better at predicting how water moves through the soil than what we’re currently using for many applications. but we need to remember that this discovery relies on finding a structure that's inherently analytically integrable, so it can actually be used to calculate the hydraulic conductivity from an expression.

Kai: That’s a key part of why they focus on the analytical structure, because if you can integrate it, you get a closed-form equation for the soil hydraulic function instead of just a black box prediction. but what about how they actually do this discovery?

Mira: They use something called an automated model discovery framework based on encoding an equation as a directed acyclic graph. so they are defining variables and operators as nodes, and the way those variables connect is captured by edges that describe dependencies, including parameters or constants.

Lev: That sounds like genetic programming is involved, right? exploring the space of possible equations randomly by generating candidate graphs and then using crossover and mutation to refine them based on a loss function. that’s how they search for the best structure >

Kai: Right, so they are trying out millions of potential equation shapes against their soil data. the loss function is what guides it, composed of two parts: data loss, which is like mean squared error, and a complexity penalty based on how many soil specific parameters are in the graph.

Paper summary: Mira: That complexity penalty is interesting because it stops them from just finding an infinitely complicated equation that fits noise perfectly; they want something relatively simple. and they found that the soil-specific parameters are tied to things like particle size, where coarse soils favor one parameter value and fine soils favor another >

Lev: So the framework isn't just blindly searching for *any* fit; it’s searching for a compact, physically relevant structure that has a specific relationship with the soil texture properties. that makes it more interpretable than some of those deep learning approaches I mentioned earlier, where you get a prediction but don't really know what the equation means.

Kai: That makes sense because we’re trying to move away from those black box predictors where you can't see the mechanism. they are aiming for something that is both accurate and analytically sound, which is a big thing for real world modeling >

Mira: And it seems they succeeded in finding a tangent-based form that has comparable water retention fitting but provides much improved hydraulic conductivity prediction, as shown by that RMSE of two point five zero two versus the MvG model's three point zero six nine >

Lev: That’s good performance for a model derived purely from data without starting with the MvG assumptions baked in. but we should also look at what they say about generalizability; how well this discovered function works outside of those two hundred forty-nine specific soil samples > <ref:2605.19379#pg2>

Kai: They tested it on the Unsaturated Soil Hydraulic Database, UNSODA, which is another set of data covering different regions and soil types. the results suggest that the discovered model has superior distributional robustness because it effectively eliminates that long error tail when predicting the hydraulic conductivity function >

Mira: It’s interesting how this data-driven discovery process led to a functional form that is fundamentally distinct from what we see in classical soil physics literature, even though it still retains an analytical structure for integration >

Lev: The fact that they retained an analytical structure is important because it means the output isn't just a curve you have to use for look-up tables; it's a formula you can plug things into, which is what engineers and hydrologists need >

Kai: So, to sum up this paper called "Graph-based Automated Discovery of Concise Soil Hydraulic Functions from Data: Beyond Empirical Formulations", they used an automated graph framework to discover a new soil hydraulic function that outperforms the MvG model in predicting hydraulic conductivity across diverse soils, and that new function is analytically integrable >

Mira: And it matters because it provides a path toward developing explicit constitutive models that are both accurate and robust, moving away from purely empirical formulations where the underlying physics isn't fully captured >

Lev: For practical use on real hardware or large-scale simulations, having an equation you can integrate is much more reliable than a complex neural network that you can't easily debug when it starts failing in an unexpected scenario >

Conclusion: Kai: So, this paper is about taking experimental soil data and using a graph to automatically discover the actual mathematical formula for how water moves through that soil.

Mira: Yeah, they're showing how you can move past just fitting curves to find a real physical structure that describes the soil hydraulic functions.

Lev: From an engineering standpoint, I’m really interested in whether this discovered structure is something we can actually build on real hardware or simulate reliably.

Kai: They tested this against two hundred forty-nine samples from a huge database, and the result is that their new formula for how water flows is more accurate than the standard Mualem van Genuchten model.

Mira: That's significant because it means we have a better tool to predict unsaturated hydraulic conductivity when we don't know the exact physics beforehand.

Lev: A better prediction is good, but what they found about the parameters for soil texture—that coarse soils lean toward one parameter and fine soils toward another—is something that would need careful testing on real-world data.

Kai: So, the authors managed to find a form that has both high predictive power and stays relatively simple enough to be analytically integrated into an actual equation.

Mira: It's about balancing having a highly accurate result with keeping the underlying mathematical structure manageable for modeling.

Lev: It's interesting because they found this new functional form is fundamentally different from what we usually see in soil physics literature, even though it still has that integrable structure.

Kai: And that analytical structure is what makes it useful; it lets you derive the hydraulic conductivity directly from an expression rather than just using a lookup table.

Mira: It provides a new pathway for developing explicit constitutive models, which means we can actually write down the math describing the soil behavior instead of relying on black box predictions.

Lev: If we can get that kind of explicit model, it makes designing better drainage systems or predicting water movement in complex subsurface environments much more feasible.

More episodes

← Home