Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Online Optimal Control with Affine Constraints

Oct 10, 2020
Yingying Li, Subhro Das, Na Li

Share this with someone who'll enjoy it:

This paper considers online optimal control with affine constraints on the states and actions under linear dynamics with random disturbances. We consider convex stage cost functions that change adversarially. Besides, we consider time-invariant and known system dynamics and constraints. To solve this problem, we propose Online Gradient Descent with Buffer Zone (OGD-BZ). Theoretically, we show that OGD-BZ can guarantee the system to satisfy all the constraints despite any realization of the disturbances under proper parameters. Further, we investigate the policy regret of OGD-BZ, which compares OGD-BZ's performance with the performance of the optimal linear policy in hindsight. We show that OGD-BZ can achieve $\tilde O(\sqrt T)$ policy regret under proper parameters, where $\tilde O(\cdot)$ absorbs logarithmic terms of $T$.

   Access Paper Source

Share this with someone who'll enjoy it: