Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-63 System and Applications

summary

The gist

Explainable artificial intelligence (XAI) methods are being evaluated for regression problems in geoscientific applications using an emulator of the Lorenz-63 system to understand their limitations…

In short

This study evaluates how common Explainable AI (XAI) methods work when used for regression problems in Earth science, using a chaotic Lorenz-63 model as a test case. It found that methods designed for classification often fail in regression settings. The research provides practical advice on selecting and tailoring explanations to specific stakeholder needs in operational modeling.

Key concepts

Regression vs. Classification
Regression predicts continuous values, unlike classification which predicts discrete categories. Most existing XAI tools are built for classification tasks, meaning they may not accurately show feature importance or influence when predicting continuous physical quantities in Earth science models.
Lorenz-63 System Emulator
This is a simplified computer model of the Lorenz system, a classic chaotic system used to simulate atmospheric dynamics. It serves as a tractable, physically meaningful environment to test the limitations and failure modes of general XAI methods when applied to complex regression problems.
Post-hoc XAI Methods
These are techniques applied *after* a model is trained to explain its predictions. Examples include Saliency and SHAP, which quantify how much each input variable contributed to a specific output prediction, helping users understand the model's decisions.

Terminology used across episodes

This episode discusses

The paper

Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-63 System and Applications · Read on arXiv

Department of Computer Science, University of Reading · Department of Meteorology, University of Reading · National Centre for Atmospheric Science (NCAS) · Met Office

Transcript

Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.

Kai: I'm Kai.

Mira: And I'm Mira, here with Lev.

Kai: We're looking at the paper: "Explainable AI for Geoscientific Regression".

Mira: Here's the gist of the paper. Explainable artificial intelligence (XAI) methods are being evaluated for regression problems in geoscientific applications using an emulator of the Lorenz-63 system to understand their limitations and failure modes <ref:2608.07406#pg20>.

Kai: This work reviews XAI approaches through a structured framework, applying them to a chaotic model to ground the discussion before surveying their use across Earth system sciences <ref:2608.07406#pg4>.

Mira: Pruning redundant reasoning tokens The paper establishes that most existing XAI methods were developed for classification tasks and may not transfer well to the regression problems that dominate geoscientific applications <ref:2608.07406#pg4>.

Kai: The authors ground their discussion by applying a selection of methods to a machine learning emulator of the Lorenz 1963 system, an archetypal chaotic model that provides a tractable, physically meaningful setting for exposing the limitations and failure modes of general-purpose XAI in regression contexts <ref:2608.07406#pg4>.

Paper summary: Kai: So, looking back at "Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods with the Lorenz-sixty-three System and Applications", the core message is that we need to be careful about assuming that XAI methods built for classification will just work when applied to regression problems in geosciences <ref:2608.07406#pg1>.

Mira: They argue it’s important to review these approaches through a structured framework, looking at both their theory and how they actually perform practically, especially since the Lorenz sixty-three system provides a good testbed for this > <ref:2608.07406#pg1>

Lev: The implication is that we need to be much more intentional about how we select our baseline states because you can't just pick an arbitrary starting point without considering its physical meaning >

Kai: And they give some practical advice, like don't assume methods transfer directly and always choose your reference states with intent, grounding them in something physically justifiable >

Mira: They also stress matching the explanation to stakeholder questions rather than trying to explain the whole model at once; tailor the explanation to what that specific user needs >

Lev: And they point out a big challenge: scaling these methods up to massive systems like weather models means we really need XAI tools that can handle huge numbers of inputs and outputs reliably >

Kai: The paper suggests that for operational use in high-stakes environments, we need to refine these methods and develop new techniques specifically suited for the unique characteristics of Earth system modeling >

Conclusion: Kai: So, we've looked at how different explainable AI methods work when applied to predicting continuous values in chaotic systems, specifically using an emulator of the Lorenz sixty-three system.

Mira: And what this paper is doing is taking a structured look at those methods—how they are built and what they actually do—before applying them to the bigger picture in Earth system science.

Lev: The authors are showing that most current XAI tools were made for things like classification, which isn't quite right for regression problems, where you're predicting a continuous number.

Kai: They use the Lorenz sixty-three system because it’s a chaotic model, and that gives them a clear place to test where these general AI explanations break down.

Mira: They examine several techniques like gradients and SHAP, and they find that the input variable labeled y has the biggest impact right near points where things diverge in the model.

Lev: But they also point out how important it is to be careful about what you consider a starting point or a reference state because that choice really matters for the explanation's reliability.

Kai: So, when you're building these models for things like weather or climate, the paper suggests that explanations shouldn't try to explain everything at once.

Mira: They want explanations tailored to what each stakeholder actually needs, not just one big answer trying to cover all the model complexity.

Lev: The big practical points they give are about picking your reference states with intention and making sure you only look at inputs that make physical sense for the system you're modeling.

Kai: It seems like the main challenge right now is figuring out how to make these explanations more reliable and scalable for really massive models, not just little test systems.

Mira: And they suggest that we need to develop new, domain-specific methods because the current routine tools have technical limitations when you move into high-stakes operational use.

Lev: That leads us right into thinking about how we can adapt these sensitivity methods—like adjoint methods—to fit these specific needs in the real world.

More episodes

← Home