Non-convex Feedback Optimization with Input and Output Constraints

summary

The gist

In this paper, we present a novel control scheme for feedback optimization that can steer a physical plant to the solution of a constrained optimization problem without numerically solving the…

In short

The paper proposes a novel discrete-time controller for feedback optimization that steers a physical plant to solve constrained optimization problems without numerically solving them. The controller is based on discretizing a continuous projected gradient flow, offering global convergence guarantees for non-convex problems and being easy to tune with only the step-size as the parameter.

Key concepts

Feedback Optimization
This involves designing a controller that adjusts system inputs based on measurements of the plant's output to minimize a cost function subject to constraints. The paper focuses on enforcing output constraints in this context, which is difficult when the system model is unknown.
Projected Gradient Flow
The proposed discrete-time controller can be viewed as a time discretization of a continuous-time projected gradient flow. This mathematical interpretation helps establish the convergence properties of the control scheme to first-order optimal points of the optimization problem.
LICQ (Linear Independence Constraint Qualification)
This is a condition ensuring that at any point on the feasible set, the gradients of all active inequality constraints are linearly independent. Satisfying LICQ guarantees that Lagrange multipliers are unique and bounded, which is crucial for analyzing constrained optimization problems.

Terminology used across episodes

This episode discusses

The paper

Non-convex Feedback Optimization with Input and Output Constraints · Read on arXiv

Verena Áberle, Adrian Hauswirth, Lukas Ortmann, Saverio Bolognani, Florian Örfler

ETH Zurich

DOI: 10.1109/LCSYS.2020.3002152

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: We're looking at the paper: "Non-convex Feedback Optimization with Input and Output Constraints".

Dev: Here's the gist of the paper. In this paper, we present a novel control scheme for feedback optimization that can steer a physical plant to the solution of a constrained optimization problem without numerically solving the problem <ref:2004.06407#pg2>.

Rosa: Our controller can be interpreted as a discretization of a continuous-time projected gradient flow <ref:2004.06407#pg2>.

Dev: Problem Formulation and Context The paper focuses on designing a discrete-time controller to enforce output constraints in feedback optimization <ref:2004.06407#pg2>.

Rosa: The general problem considered is minimizing a cost function subject to system dynamics and constraints, specifically minimizing u,y Φ(u, y) subject to y = h(u) u ∈ U, y ∈ Y <ref:2004.06407#pg4>.

Paper summary: Rosa: So this paper is about this new control scheme for feedback optimization that can steer a physical plant to solve a constrained optimization problem without actually solving the whole problem numerically, which is really interesting because it avoids needing an explicit model of the system dynamics <ref:2004.06407#pg1>.

Dev: Yeah, what they claim is that this controller functions like a discretization of a continuous-time projected gradient flow, which means it’s based on standard optimization ideas but adapted for real-time feedback control <ref:2004.06407#pg1>.

Taro: It sounds like it's trying to handle those constraints on the steady-state outputs, and the paper says this approach combines a few good things: it enforces those constraints asymptotically, and temporary violations can be easily quantified <ref:2004.06407#pg1>.

Rosa: And one big thing they highlight is that you only need information about the steady-state input-output sensitivities of the plant, not the whole system model itself <ref:2004.06407#pg1>.

Dev: That’s a key point because it makes it more robust against disturbances and uncertainties compared to other methods, like feedforward numerical optimization <ref:2004.06407#pg1>.

Taro: They also say that even for problems that aren't convex, this global convergence is guaranteed <ref:2004.06407#pg1>.

Rosa: And tuning it is pretty simple too, because the step-size alpha is the only thing you need to tune <ref:2004.06407#pg1>.

Dev: So, this paper "Non-convex Feedback Optimization with Input and Output Constraints" proposes a discrete-time controller that uses measured output information to steer a plant toward an optimal solution while managing constraints without needing the full system model, which is what matters for real applications.

Conclusion: Rosa: Looking at the title and what we just talked about, this paper really focuses on taking feedback optimization where it can handle those output constraints asymptotically <ref:2004.06407#pg1>.

Dev: And the authors are using a controller that's interpreted as a discretization of a continuous-time projected gradient flow, which is a solid way to think about how the system moves toward an optimum <ref:2004.06407#pg1>.

Taro: It means for someone just listening, this method offers global convergence guarantees even when the optimization problem isn't convex, which is something we need in real-world systems that aren't perfectly modeled <ref:2004.06407#pg1>.

Rosa: And they emphasize that it requires only reduced model information—specifically those steady-state input-output sensitivities—which makes it very practical to use <ref:2004.06407#pg1>.

Dev: The main implication is that we can enforce constraints on the plant's steady-state outputs with zero asymptotic error, and they show it doesn't require integrating dual variables to do that <ref:2004.06407#pg1>.

Taro: It’s a pretty well-behaved convergence behavior without those nasty oscillations that you sometimes see in other schemes when they try to satisfy constraints during the transition phase <ref:2004.06407#pg1>.

Rosa: So, this paper presents a new discrete-time controller for feedback optimization with the property that constraints on the steady-state plant outputs are enforced asymptotically <ref:2004.06407#pg1>.

Dev: This approach offers global convergence guarantees for non-convex problems and fixed step-sizes, it's easy to tune, and it exhibits a well-behaved convergence behavior without oscillations <ref:2004.06407#pg1>.

Taro: It's also noted that this method is robust with respect to uncertainty in those input-output sensitivities <ref:2004.06407#pg1>.

More episodes

← Home