American Institute of Mathematical Sciences

Advanced
January  2005, 1(1): 65-80. doi: 10.3934/jimo.2005.1.65

Two new optimal models for controlling discrete event systems

Qiying Hu 1, and  Wuyi Yue 2,

1. 

College of International Business and Management, Shanghai University, Shanghai 201800, China
2. 

Department of Intelligence and Informatics, Konan University, 8-9-1 Okamoto, Kobe 658-8501, Japan

Received  May 2004 Revised  November 2004 Published  January 2005

Supervisory control belongs essentially to the logic level for control problems in discrete event systems (DESs) and its corresponding control task is hard. This is unlike many practical optimal control problems which belong to the performance level and whose control tasks are soft. In this paper, we present two new optimal control problems of DESs: one with cost functions for choosing control inputs, and the other for occurring events. Their performance measures are to minimize the maximal discounted total cost among all possible strings that the system generates. Since this is a nonlinear optimization problem, we model such systems by using Markov decision processes. We then present the optimality equations for both control problems and obtain their optimal solutions. When the cost functions are stationary, we show that both the optimality equations and their solutions are also stationary. We then use these equations and solutions to describe and solve uniformly the basic synthesizing problems in the two branches of the supervisory control area: those being the event feedback control and the state feedback control. Moreover, we show that the control invariant languages and the control invariant predicates with their permissive supervisors and state feedbacks not only have meanings in supervisory control of DESs, but are also the optimal solutions for some optimal control problems. This shows a link existing between the logic level and the performance level for the control of discrete event systems. Finally, a numerical example is given to illustrate some results for supervisory control of a DES.
Keywords: Optimal control, discrete event systems, state feedback., supervisor.
Mathematics Subject Classification: 37V45, 90C4.
Citation: Qiying Hu, Wuyi Yue. Two new optimal models for controlling discrete event systems. Journal of Industrial and Management Optimization, 2005, 1 (1) : 65-80. doi: 10.3934/jimo.2005.1.65
[1]

Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems II: Control synthesis problems. Journal of Industrial and Management Optimization, 2008, 4 (4) : 713-726. doi: 10.3934/jimo.2008.4.713
[2]

Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial and Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63
[3]

Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems I: framework and maximal permissive state feedback. Journal of Industrial and Management Optimization, 2008, 4 (1) : 107-123. doi: 10.3934/jimo.2008.4.107
[4]

Qiying Hu, Wuyi Yue. Optimal control for discrete event systems with arbitrary control pattern. Discrete and Continuous Dynamical Systems - B, 2006, 6 (3) : 535-558. doi: 10.3934/dcdsb.2006.6.535
[5]

Changzhi Wu, Kok Lay Teo, Volker Rehbock. Optimal control of piecewise affine systems with piecewise affine state feedback. Journal of Industrial and Management Optimization, 2009, 5 (4) : 737-747. doi: 10.3934/jimo.2009.5.737
[6]

Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial and Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082
[7]

Yuan Xu, Xin Jin, Saiwei Wang, Yang Tang. Optimal synchronization control of multiple euler-lagrange systems via event-triggered reinforcement learning. Discrete and Continuous Dynamical Systems - S, 2021, 14 (4) : 1495-1518. doi: 10.3934/dcdss.2020377
[8]

Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete and Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011
[9]

Galina Kurina, Sahlar Meherrem. Decomposition of discrete linear-quadratic optimal control problems for switching systems. Conference Publications, 2015, 2015 (special) : 764-774. doi: 10.3934/proc.2015.0764
[10]

Ran Dong, Xuerong Mao. Asymptotic stabilization of continuous-time periodic stochastic systems by feedback control based on periodic discrete-time observations. Mathematical Control and Related Fields, 2020, 10 (4) : 715-734. doi: 10.3934/mcrf.2020017
[11]

Elimhan N. Mahmudov. Optimal control of second order delay-discrete and delay-differential inclusions with state constraints. Evolution Equations and Control Theory, 2018, 7 (3) : 501-529. doi: 10.3934/eect.2018024
[12]

Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist. Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. Journal of Geometric Mechanics, 2013, 5 (1) : 1-38. doi: 10.3934/jgm.2013.5.1
[13]

Stefan Jerg, Oliver Junge, Marcus Post. Global optimal feedbacks for stochastic quantized nonlinear event systems. Journal of Computational Dynamics, 2014, 1 (1) : 163-176. doi: 10.3934/jcd.2014.1.163
[14]

Peng Cheng, Yanqing Liu, Yanyan Yin, Song Wang, Feng Pan. Fuzzy event-triggered disturbance rejection control of nonlinear systems. Journal of Industrial and Management Optimization, 2021, 17 (6) : 3297-3307. doi: 10.3934/jimo.2020119
[15]

Tobias Geiger, Daniel Wachsmuth, Gerd Wachsmuth. Optimal control of ODEs with state suprema. Mathematical Control and Related Fields, 2021, 11 (3) : 555-578. doi: 10.3934/mcrf.2021012
[16]

N. U. Ahmed. Existence of optimal output feedback control law for a class of uncertain infinite dimensional stochastic systems: A direct approach. Evolution Equations and Control Theory, 2012, 1 (2) : 235-250. doi: 10.3934/eect.2012.1.235
[17]

Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete and Continuous Dynamical Systems, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153
[18]

Cristiana J. Silva, Helmut Maurer, Delfim F. M. Torres. Optimal control of a Tuberculosis model with state and control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 321-337. doi: 10.3934/mbe.2017021
[19]

Guirong Jiang, Qishao Lu. The dynamics of a Prey-Predator model with impulsive state feedback control. Discrete and Continuous Dynamical Systems - B, 2006, 6 (6) : 1301-1320. doi: 10.3934/dcdsb.2006.6.1301
[20]

Haiying Jing, Zhaoyu Yang. The impact of state feedback control on a predator-prey model with functional response. Discrete and Continuous Dynamical Systems - B, 2004, 4 (3) : 607-614. doi: 10.3934/dcdsb.2004.4.607

2020 Impact Factor: 1.801

Tools

Metrics

  • PDF downloads (53)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy