Adaptive Real-Time Grid Operation via Online Feedback Optimization with Sensitivity Estimation
summary
The gist
In this paper we propose an approach based on an Online Feedback Optimization (OFO) controller with grid input-output sensitivity estimation for real-time grid operation, e.g…
In short
The paper proposes a model-free approach for real-time grid operation using Online Feedback Optimization (OFO). It sequentially estimates time-varying system sensitivity using recursive least squares based on real measurements, bypassing the need for an accurate full grid model. This allows the controller to track optimal power flow solutions at subsecond speeds and maintain robust performance even with changing grid conditions.
Key concepts
- Online Feedback Optimization (OFO)
- A computationally efficient method used to track the solutions of a complex optimization problem, like AC-OPF, in real-time. It operates at fast control loop rates, allowing the system to adapt quickly to changes in the grid without needing a complete mathematical model of every component.
- Sensitivity Estimation
- The core innovation where the controller learns how much the output (like voltage) changes when inputs (like power flow commands) change. This is done recursively using measurements and a least-squares approach, allowing the system to estimate time-varying relationships without knowing the full grid model beforehand.
- Model-Free Approach
- A control strategy that does not require an accurate, complete mathematical model of the entire electrical grid. Instead, it learns the necessary system dynamics—the sensitivity—directly from real-time measurements during operation, making it adaptable to unpredictable resources and constraints.
- Persistency of Excitation
- A condition ensuring that the control inputs provide enough varied information over time so that all relevant aspects of the system's behavior can be observed. This mathematical requirement guarantees that the sensitivity estimates converge reliably to their true values.
Terminology used across episodes
This episode discusses
- Adaptive Real-Time Grid Operation via Online Feedback Optimization with Sensitivity Estimation · Paper Radio
- Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
- Cross-layer Design for Real-Time Grid Operation: Estimation, Optimization and Power Flow · Paper Radio
The paper
Adaptive Real-Time Grid Operation via Online Feedback Optimization with Sensitivity Estimation · Read on arXiv
Miguel Picallo, Lukas Ortmann, Saverio Bolognani, Florian Dorfler
Automatic Control Laboratory, ETH Zurich
In this paper we propose an approach based on an Online Feedback Optimization (OFO) controller with grid input-output sensitivity estimation for real-time grid operation, e.g., at subsecond time scales. The OFO controller uses grid measurements as feedback to update the value of the controllable elements in the grid, and track the solution of a time-varying AC Optimal Power Flow (AC-OPF). Instead of relying on a full grid model, e.g., grid admittance matrix, OFO only requires the steady-state sensitivity relating a change in the controllable inputs, e.g., power injections set-points, to a change in the measured outputs, e.g., voltage magnitudes. Since an inaccurate sensitivity may lead to a model-mismatch and jeopardize the performance, we propose a recursive least-squares estimation that enables OFO to learn the sensitivity from measurements during real-time operation, turning OFO into a model-free approach. We analytically certify the convergence of the proposed OFO with sensitivity estimation, and validate its performance on a simulation using the IEEE 123-bus test feeder, and comparing it against a state-of-the-art OFO with constant sensitivity.
DOI: 10.1016/j.epsr.2022.108405
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: We're looking at the paper: "Adaptive Real-Time Grid Operation via Online Feedback Optimization with Sensitivity Estimation".
Dev: Here's the gist of the paper. In this paper we propose an approach based on an Online Feedback Optimization (OFO) controller with grid input-output sensitivity estimation for real-time grid operation, e.g., at subsecond time scales.
Rosa: The proposed method is a model-free OFO approach that sequentially estimates a time-varying sensitivity while operating the grid, bypassing the need to know the whole grid model accurately and having full grid observability.
Dev: The core problem addressed The increasing amount of controllable yet sometimes unpredictable power resources in electrical grids leads to new challenges and opportunities in operation.
Rosa: Fast control decisions are required to avoid constraint violations such as overvoltages, especially in distribution grids.
Title and authors: Rosa: This paper is by Miguel Picallo, Lukas Ortmann, Saverio Bolognani, and Florian Dorfler from ETH Zurich. They’re tackling the challenge of real-time grid operation using this Online Feedback Optimization with Sensitivity Estimation technique.
Dev: And what they do is propose a method that lets the controller track the solution of a time-varying Optimal Power Flow problem—that's the AC-OPF—even when you don't have all those expensive, high-fidelity grid models ready to go.
Taro: So, if we think about what this means practically, it suggests we can get fast enough control decisions for distribution grids where things change constantly and constraints like voltage limits are really tight.
Rosa: Precisely. The main implication is that you don't need a perfect grid model to have safe and optimal control at subsecond time scales, which is crucial for handling unpredictable power resources in modern grids.
Dev: And they focus on the fact that because an inaccurate sensitivity estimate can cause performance issues, they build this learning mechanism—the recursive least squares estimation—to ensure the controller adapts as things change during operation.
The paper's summary: Rosa: The summary of this paper explains that instead of needing a full grid model, which is often unavailable or too expensive for distribution systems, the Online Feedback Optimization approach only requires knowing the steady-state sensitivity relating changes in controllable inputs to changes in measured outputs.
Dev: They then propose using a recursive least squares estimation based on measuring the change in outputs caused by changing controllable inputs as their feedback signal to learn this time-varying sensitivity during real-time operation.
Taro: So, the mechanism is that they are sequentially estimating this sensitivity while the grid is actually running, which bypasses the need to know the whole system model accurately and gives them full grid observability.
Rosa: That’s a big deal for deployment because it turns OFO into a model-free approach, meaning you don't have to spend all that time building an accurate nonlinear grid model just to run the control.
Dev: They combine this sensitivity estimation with a persistently exciting OFO controller, which gathers enough information about the sensitivity while driving the control inputs directly toward the AC-OPF solution.
The paper's improvements: Rosa: One of the main improvements they highlight is that by using this learned sensitivity estimate, the controller preserves stability even when you use a constant power flow sensitivity approximation instead of the actual one during operation.
Dev: That means they are robust against model mismatch because the system is actively learning what it needs to know about those sensitivities through real-time measurements from output variations and input changes.
Taro: From my side, I see that this is important for failure modes because if something unexpected happens, like a sudden change in topology or a line fault, the controller has learned enough to react gracefully instead of breaking down because it's not relying on a fixed guess.
Rosa: And they provide convergence guarantees—they certify that both the estimated sensitivity and the actual control input are converging toward their true values over time, even when there’s time variation or some noise in the measurements.
Conclusion: Dev: So, to wrap up, this paper on "Adaptive Real-Time Grid Operation via Online Feedback Optimization with Sensitivity Estimation" suggests we can use this model-free plug-and-play controller for real-time power grid operation that allows for safe and optimal control.
Rosa: The big picture here is that because of the convergence guarantees they provide, this method can be used to maintain optimal power flow set points at subsecond time scales without needing a complete grid model or an accurate admittance matrix.
Taro: It’s interesting how they link persistent excitation design to specific aspects of the problem, like topology changes or communication issues. That suggests we can target where the learning is most needed when unforeseen operational conditions arise.
Dev: Right, so this work provides quantifiable tracking error bounds that depend on things like the persistency of excitation and measurement noise characteristics, which gives us a clearer safety case for how reliable this system is in practice.
Rosa: It’s a solid piece of work for making real-time grid operation more adaptable by letting the controller learn its environment instead of just relying on a fixed setup.
More episodes
- 2608.13438-ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
- 2610.34593-Future Prediction as Training-Only Video Supervision for Pretrained VLA Policies
- 2610.35385-EmbodiedLab: Beyond Manipulation, Benchmarking Embodied Agents That Act to Know
- 2610.36378-Data-Driven Hamiltonian for Neural Optimal Control
- 2610.37275-A Heuristic for Scheduling Autonomous Vehicles at Intersections
- 2610.37288-Dynamic Coordination of Autonomous Vehicles at Intersections
- 2610.37632-Real-Time Coordination of Autonomous Vehicles at Intersections
- 2611.13779-Softness is something you also need! Why compliance helps control: information metrics of a passive walker with compliant ankle
- 2611.13411-Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees
- 2611.14488-Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies