May  2006, 6(3): 535-558. doi: 10.3934/dcdsb.2006.6.535

Optimal control for discrete event systems with arbitrary control pattern


College of International Business and Management, Shanghai University, Shanghai 201800


Department of Intelligence and Informatics, Konan University, 8-9-1 Okamoto, Kobe 658-8501

Received  December 2004 Revised  October 2005 Published  February 2006

In this paper, we present a new model for optimal control of discrete event systems (DESs) with an arbitrary control pattern. Here, a discrete event system is defined as a collection of event sets that depend on strings. When the system generates a string, the next event that may occur should be in the corresponding event set. In the optimal control model, there are rewards for choosing control inputs at strings and the sets of available control inputs also depend on strings. The performance measure is to find a policy under the condition where the discounted total reward among strings from the initial state is maximized. By applying ideas from Markov decision processes, we divide the problem into three sub-cases where the optimal value is respectively finite, positive infinite and negative infinite. For the case with finite optimal values, the optimality equation is shown and further characterized with its solutions. We also characterize the structure of the set of all optimal policies. Moreover, we discuss invariance and closeness of several languages. We present a new supervisory control problem of DESs with the control pattern being dependent on strings. We study the problem in both the event feedback control and the state feedback control by generalizing concepts of invariant and closed languages/predicates. Finally, we apply the above model and results to a job-matching problem.
Citation: Qiying Hu, Wuyi Yue. Optimal control for discrete event systems with arbitrary control pattern. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 535-558. doi: 10.3934/dcdsb.2006.6.535

Vincent Renault, Michèle Thieullen, Emmanuel Trélat. Optimal control of infinite-dimensional piecewise deterministic Markov processes and application to the control of neuronal dynamics via Optogenetics. Networks & Heterogeneous Media, 2017, 12 (3) : 417-459. doi: 10.3934/nhm.2017019


Thierry Horsin, Peter I. Kogut, Olivier Wilk. Optimal $L^2$-control problem in coefficients for a linear elliptic equation. II. Approximation of solutions and optimality conditions. Mathematical Control & Related Fields, 2016, 6 (4) : 595-628. doi: 10.3934/mcrf.2016017


Vladimir Turetsky, Valery Y. Glizer. Optimal decision in a Statistical Process Control with cubic loss. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021096


Alexander Arguchintsev, Vasilisa Poplevko. An optimal control problem by parabolic equation with boundary smooth control and an integral constraint. Numerical Algebra, Control & Optimization, 2018, 8 (2) : 193-202. doi: 10.3934/naco.2018011


Hang-Chin Lai, Jin-Chirng Lee, Shuh-Jye Chern. A variational problem and optimal control. Journal of Industrial & Management Optimization, 2011, 7 (4) : 967-975. doi: 10.3934/jimo.2011.7.967


Marzia Bisi, Maria Groppi, Giorgio Martalò, Romina Travaglini. Optimal control of leachate recirculation for anaerobic processes in landfills. Discrete & Continuous Dynamical Systems - B, 2021, 26 (6) : 2957-2976. doi: 10.3934/dcdsb.2020215


Roberto C. Cabrales, Gema Camacho, Enrique Fernández-Cara. Analysis and optimal control of some solidification processes. Discrete & Continuous Dynamical Systems, 2014, 34 (10) : 3985-4017. doi: 10.3934/dcds.2014.34.3985


Kamil Aida-Zade, Jamila Asadova. Numerical solution to optimal control problems of oscillatory processes. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021166


Kai Liu. Quadratic control problem of neutral Ornstein-Uhlenbeck processes with control delays. Discrete & Continuous Dynamical Systems - B, 2013, 18 (6) : 1651-1661. doi: 10.3934/dcdsb.2013.18.1651


Yuri B. Gaididei, Carlos Gorria, Rainer Berkemer, Peter L. Christiansen, Atsushi Kawamoto, Mads P. Sørensen, Jens Starke. Stochastic control of traffic patterns. Networks & Heterogeneous Media, 2013, 8 (1) : 261-273. doi: 10.3934/nhm.2013.8.261


Ciro D'Apice, Olha P. Kupenko, Rosanna Manzo. On boundary optimal control problem for an arterial system: First-order optimality conditions. Networks & Heterogeneous Media, 2018, 13 (4) : 585-607. doi: 10.3934/nhm.2018027


Vladimir Gaitsgory, Alex Parkinson, Ilya Shvartsman. Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time. Discrete & Continuous Dynamical Systems - B, 2019, 24 (4) : 1743-1767. doi: 10.3934/dcdsb.2018235


Ellina Grigorieva, Evgenii Khailov, Andrei Korobeinikov. An optimal control problem in HIV treatment. Conference Publications, 2013, 2013 (special) : 311-322. doi: 10.3934/proc.2013.2013.311


Andrea Bacchiocchi, Germana Giombini. An optimal control problem of monetary policy. Discrete & Continuous Dynamical Systems - B, 2021, 26 (11) : 5769-5786. doi: 10.3934/dcdsb.2021224


Jianxiong Ye, An Li. Necessary optimality conditions for nonautonomous optimal control problems and its applications to bilevel optimal control. Journal of Industrial & Management Optimization, 2019, 15 (3) : 1399-1419. doi: 10.3934/jimo.2018101


Ana P. Lemos-Paião, Cristiana J. Silva, Delfim F. M. Torres. A sufficient optimality condition for delayed state-linear optimal control problems. Discrete & Continuous Dynamical Systems - B, 2019, 24 (5) : 2293-2313. doi: 10.3934/dcdsb.2019096


Lucas Bonifacius, Ira Neitzel. Second order optimality conditions for optimal control of quasilinear parabolic equations. Mathematical Control & Related Fields, 2018, 8 (1) : 1-34. doi: 10.3934/mcrf.2018001


Vaibhav Mehandiratta, Mani Mehra, Günter Leugering. Fractional optimal control problems on a star graph: Optimality system and numerical solution. Mathematical Control & Related Fields, 2021, 11 (1) : 189-209. doi: 10.3934/mcrf.2020033


Sofia O. Lopes, Fernando A. C. C. Fontes, Maria do Rosário de Pinho. On constraint qualifications for nondegenerate necessary conditions of optimality applied to optimal control problems. Discrete & Continuous Dynamical Systems, 2011, 29 (2) : 559-575. doi: 10.3934/dcds.2011.29.559


Gökçe Dİlek Küçük, Gabil Yagub, Ercan Çelİk. On the existence and uniqueness of the solution of an optimal control problem for Schrödinger equation. Discrete & Continuous Dynamical Systems - S, 2019, 12 (3) : 503-512. doi: 10.3934/dcdss.2019033

2020 Impact Factor: 1.327


  • PDF downloads (39)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]