Stability analysis of discrete-time infinite-horizon optimal control with discounted costReport as inadecuate




Stability analysis of discrete-time infinite-horizon optimal control with discounted cost - Download this document for free, or read online. Document in PDF available to download.

1 CRAN - Centre de Recherche en Automatique de Nancy 2 UTCN - Universitatea Tehnica din Cluj-Napoca 3 Department of Electrical and Electronic Engineering Melbourne

Abstract : We analyse the stability of general nonlinear discrete-time systems controlled by an optimal sequence of inputs that minimizes an infinite-horizon discounted cost. First, assumptions related to the controllability of the system and its detectability with respect to the stage cost are made. Uniform semiglobal and practical stability of the closed-loop system is then established, where the adjustable parameter is the discount factor. Stronger stability properties are thereupon guaranteed by gradually strengthening the assumptions. Next, we show that the Lyapunov function used to prove stability is continuous under additional conditions, implying that stability has a certain amount of nominal robustness. The presented approach is flexible and we show that robust stability can still be guaranteed when the sequence of inputs applied to the system is no longer optimal but near-optimal. We also analyse stability for cost functions in which the importance of the stage cost increases with time, opposite to discounting. Finally, we exploit stability to derive new relationships between the optimal value functions of the discounted and undiscounted problems, when the latter is well-defined.

Keywords : Cost function Stability analysis Asymptotic stability Optimal control Dynamic programming Lyapunov methods





Author: Romain Postoyan - Lucian Busoniu - Dragan Nesic - Jamal Daafouz -

Source: https://hal.archives-ouvertes.fr/



DOWNLOAD PDF




Related documents