Surrogate Modeling and Explainable Artificial Intelligence for Complex Systems: A Workflow for Automated Simulation Exploration
cs.AI, cs.MA, stat.ME
Submitted: 2025-10-19
Updated: 2026-10-31
Comments: version 2, after first reviews, second round. Thx to J. Levy for help
Code: https://github.com/ANR-MIMICO/SMPT
License: http://creativecommons.org/licenses/by/4.0/
The gist: Complex systems are increasingly explored through simulation-driven workflows that combine physics-based and empirical models with optimization and analytics.
Terminology
Abstract
Complex systems are increasingly explored through simulation-driven workflows that combine physics-based and empirical models with optimization and analytics. Despite their power, these workflows face two central obstacles: high computational cost from repeated expensive simulator runs, and limited transparency when decisions rely on opaque black-box models. We propose a workflow that addresses both challenges by training lightweight emulators on compact designs of experiments that (i) provide fast, low-latency approximations of expensive simulators, (ii) enable rigorous uncertainty quantification, and (iii) support global and local eXplainable Artificial Intelligence (XAI) analyses. This work formalizes a methodological bridge accommodating continuous, categorical, and integer variables across diverse domains, from engineering design to socio-environmental agent-based models. To validate surrogate explanations and examine how faithfully they reflect simulator behavior, we introduce a comparative methodology incorporating active validation filters, including explanation consistency and aleatoric uncertainty quantification. Furthermore, we provide practical guidelines for coupling experimental designs with emulator training to select architectures that balance computational efficiency with interpretability. We demonstrate the framework across two contrasting paradigms: a deterministic multidisciplinary design simulation of a hybrid-electric aircraft and a stochastic agent-based simulation of urban segregation. Results show that coupling surrogates with XAI enables large-scale exploration in seconds, reveals critical nonlinear interactions, and highlights potential design and policy levers while establishing consistent explanations across architectures.
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents