Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-63 System and Applications
summary
The gist
Explainable artificial intelligence (XAI) methods are being evaluated for regression problems in geoscientific applications using an emulator of the Lorenz-63 system to understand their limitations…
In short
This study evaluates how common Explainable AI (XAI) methods work when used for regression problems in Earth science, using a chaotic Lorenz-63 model as a test case. It found that methods designed for classification often fail in regression settings. The research provides practical advice on selecting and tailoring explanations to specific stakeholder needs in operational modeling.
Key concepts
- Regression vs. Classification
- Regression predicts continuous values, unlike classification which predicts discrete categories. Most existing XAI tools are built for classification tasks, meaning they may not accurately show feature importance or influence when predicting continuous physical quantities in Earth science models.
- Lorenz-63 System Emulator
- This is a simplified computer model of the Lorenz system, a classic chaotic system used to simulate atmospheric dynamics. It serves as a tractable, physically meaningful environment to test the limitations and failure modes of general XAI methods when applied to complex regression problems.
- Post-hoc XAI Methods
- These are techniques applied *after* a model is trained to explain its predictions. Examples include Saliency and SHAP, which quantify how much each input variable contributed to a specific output prediction, helping users understand the model's decisions.
Terminology used across episodes
This episode discusses
- Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-63 System and Applications · Paper Radio
- AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers
- Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulators
- FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale
- Physics Steering: Causal Control of Cross-Domain Concepts in a Physics Foundation Model · Paper Radio
- Shapley explainability on the data manifold
- Applications of Explainable artificial intelligence in Earth system science
- Efficient Constrained Pattern Mining Using Dynamic Item Ordering for Explainable Classification
- Investigating the influence of noise and distractors on the interpretation of neural networks
- Adam: A Method for Stochastic Optimization
- Using data assimilation tools to dissect GraphDOP
- AIFS -- ECMWF's data-driven forecasting system
- ClimaX: A foundation model for weather and climate
- Bridging the Gap in XAI-Why Reliable Metrics Matter for Explainability and Compliance
- Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
- SmoothGrad: removing noise by adding noise
- Explainable artificial intelligence (XAI) for scaling: An application for deducing hydrologic connectivity at watershed scale
- From Baselines to Transport Geodesics: Axiomatic Attribution via Optimal Generative Flows · Paper Radio
The paper
Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-63 System and Applications · Read on arXiv
Department of Computer Science, University of Reading · Department of Meteorology, University of Reading · National Centre for Atmospheric Science (NCAS) · Met Office
Transcript
Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.
Kai: I'm Kai.
Mira: And I'm Mira, here with Lev.
Kai: We're looking at the paper: "Explainable AI for Geoscientific Regression".
Mira: Here's the gist of the paper. Explainable artificial intelligence (XAI) methods are being evaluated for regression problems in geoscientific applications using an emulator of the Lorenz-63 system to understand their limitations and failure modes <ref:2608.07406#pg20>.
Kai: This work reviews XAI approaches through a structured framework, applying them to a chaotic model to ground the discussion before surveying their use across Earth system sciences <ref:2608.07406#pg4>.
Mira: Pruning redundant reasoning tokens The paper establishes that most existing XAI methods were developed for classification tasks and may not transfer well to the regression problems that dominate geoscientific applications <ref:2608.07406#pg4>.
Kai: The authors ground their discussion by applying a selection of methods to a machine learning emulator of the Lorenz 1963 system, an archetypal chaotic model that provides a tractable, physically meaningful setting for exposing the limitations and failure modes of general-purpose XAI in regression contexts <ref:2608.07406#pg4>.
Paper summary: Kai: So, looking back at "Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-sixty-three System and Applications", the core message is that we need to be careful about assuming that XAI methods built for classification will just work when applied to regression problems in geosciences <ref:2608.07406#pg1>.
Mira: They argue it’s important to review these approaches through a structured framework, looking at both their theory and how they actually perform practically, especially since the Lorenz sixty-three system provides a good testbed for this > <ref:2608.07406#pg1>
Lev: The implication is that we need to be much more intentional about how we select our baseline states because you can't just pick an arbitrary starting point without considering its physical meaning >
Kai: And they give some practical advice, like don't assume methods transfer directly and always choose your reference states with intent, grounding them in something physically justifiable >
Mira: They also stress matching the explanation to stakeholder questions rather than trying to explain the whole model at once; tailor the explanation to what that specific user needs >
Lev: And they point out a big challenge: scaling these methods up to massive systems like weather models means we really need XAI tools that can handle huge numbers of inputs and outputs reliably >
Kai: The paper suggests that for operational use in high-stakes environments, we need to refine these methods and develop new techniques specifically suited for the unique characteristics of Earth system modeling >
Conclusion: Kai: So, we've looked at how different explainable AI methods work when applied to predicting continuous values in chaotic systems, specifically using an emulator of the Lorenz sixty-three system.
Mira: And what this paper is doing is taking a structured look at those methods—how they are built and what they actually do—before applying them to the bigger picture in Earth system science.
Lev: The authors are showing that most current XAI tools were made for things like classification, which isn't quite right for regression problems, where you're predicting a continuous number.
Kai: They use the Lorenz sixty-three system because it’s a chaotic model, and that gives them a clear place to test where these general AI explanations break down.
Mira: They examine several techniques like gradients and SHAP, and they find that the input variable labeled y has the biggest impact right near points where things diverge in the model.
Lev: But they also point out how important it is to be careful about what you consider a starting point or a reference state because that choice really matters for the explanation's reliability.
Kai: So, when you're building these models for things like weather or climate, the paper suggests that explanations shouldn't try to explain everything at once.
Mira: They want explanations tailored to what each stakeholder actually needs, not just one big answer trying to cover all the model complexity.
Lev: The big practical points they give are about picking your reference states with intention and making sure you only look at inputs that make physical sense for the system you're modeling.
Kai: It seems like the main challenge right now is figuring out how to make these explanations more reliable and scalable for really massive models, not just little test systems.
Mira: And they suggest that we need to develop new, domain-specific methods because the current routine tools have technical limitations when you move into high-stakes operational use.
Lev: That leads us right into thinking about how we can adapt these sensitivity methods—like adjoint methods—to fit these specific needs in the real world.
More episodes
- 2611.14082-Two atoms with strong light-induced dipolar interactions
- 2611.14040-Characterization of BNLs 20 and 30 micrometer thick LGADs for the Electron Ion Collider
- 2611.13399-Lift-element-based dynamic network of vortex gust-airfoil interactions
- 2611.13476-Hopfion Superlattices in 3D Twisted Moir'e Light Fields
- 2611.13642-Investigation of the timing performance of double-sided p-type 3D silicon sensors produced by CNM
- 2611.13830-SiPM optical readout of a PICOSEC Micromegas precise timing detector
- 2611.14152-Where are the shortest-path nodes in spatial networks?
- 2611.14219-Sub-Ice: semi-automated mapping of basal channels from ice shelf surface elevation data
- 2611.16341-SUMNO: Spatially Unrolled Multigrid Neural Operator for Fluid Flow Surrogates
- 2611.16090-Multi-UTE Myelin Fraction Mapping: Repeatability and Cross-Field-Strength Reproducibility at 1.5T and 3T