Optimal Event-Triggered Control Using Adaptive Dynamic Programming PDF Download

Author: Sarangapani Jagannathan
Publisher: CRC Press
ISBN: 1040049168
Category : Technology & Engineering
Languages : en
Pages : 348

View

Book Description
Optimal Event-triggered Control using Adaptive Dynamic Programming discusses event triggered controller design which includes optimal control and event sampling design for linear and nonlinear dynamic systems including networked control systems (NCS) when the system dynamics are both known and uncertain. The NCS are a first step to realize cyber-physical systems (CPS) or industry 4.0 vision. The authors apply several powerful modern control techniques to the design of event-triggered controllers and derive event-trigger condition and demonstrate closed-loop stability. Detailed derivations, rigorous stability proofs, computer simulation examples, and downloadable MATLAB® codes are included for each case. The book begins by providing background on linear and nonlinear systems, NCS, networked imperfections, distributed systems, adaptive dynamic programming and optimal control, stability theory, and optimal adaptive event-triggered controller design in continuous-time and discrete-time for linear, nonlinear and distributed systems. It lays the foundation for reinforcement learning-based optimal adaptive controller use for infinite horizons. The text then: Introduces event triggered control of linear and nonlinear systems, describing the design of adaptive controllers for them Presents neural network-based optimal adaptive control and game theoretic formulation of linear and nonlinear systems enclosed by a communication network Addresses the stochastic optimal control of linear and nonlinear NCS by using neuro dynamic programming Explores optimal adaptive design for nonlinear two-player zero-sum games under communication constraints to solve optimal policy and event trigger condition Treats an event-sampled distributed linear and nonlinear systems to minimize transmission of state and control signals within the feedback loop via the communication network Covers several examples along the way and provides applications of event triggered control of robot manipulators, UAV and distributed joint optimal network scheduling and control design for wireless NCS/CPS in order to realize industry 4.0 vision An ideal textbook for senior undergraduate students, graduate students, university researchers, and practicing engineers, Optimal Event Triggered Control Design using Adaptive Dynamic Programming instills a solid understanding of neural network-based optimal controllers under event-sampling and how to build them so as to attain CPS or Industry 4.0 vision.

Author: Jiayue Sun
Publisher: Springer Nature
ISBN: 9819959292
Category : Technology & Engineering
Languages : en
Pages : 144

View

Book Description
This open access book focuses on the practical application of Adaptive Dynamic Programming (ADP) in chemotherapy drug delivery, taking into account clinical variables and real-time data. ADP's ability to adapt to changing conditions and make optimal decisions in complex and uncertain situations makes it a valuable tool in addressing pressing challenges in healthcare and other fields. As optimization technology evolves, we can expect to see even more sophisticated and powerful solutions emerge.

Author: Derong Liu
Publisher: Springer
ISBN: 3319508156
Category : Technology & Engineering
Languages : en
Pages : 594

View

Book Description
This book covers the most recent developments in adaptive dynamic programming (ADP). The text begins with a thorough background review of ADP making sure that readers are sufficiently familiar with the fundamentals. In the core of the book, the authors address first discrete- and then continuous-time systems. Coverage of discrete-time systems starts with a more general form of value iteration to demonstrate its convergence, optimality, and stability with complete and thorough theoretical analysis. A more realistic form of value iteration is studied where value function approximations are assumed to have finite errors. Adaptive Dynamic Programming also details another avenue of the ADP approach: policy iteration. Both basic and generalized forms of policy-iteration-based ADP are studied with complete and thorough theoretical analysis in terms of convergence, optimality, stability, and error bounds. Among continuous-time systems, the control of affine and nonaffine nonlinear systems is studied using the ADP approach which is then extended to other branches of control theory including decentralized control, robust and guaranteed cost control, and game theory. In the last part of the book the real-world significance of ADP theory is presented, focusing on three application examples developed from the authors’ work: • renewable energy scheduling for smart power grids;• coal gasification processes; and• water–gas shift reactions. Researchers studying intelligent control methods and practitioners looking to apply them in the chemical-process and power-supply industries will find much to interest them in this thorough treatment of an advanced approach to control.

Author: Zhang Ren
Publisher: Springer Nature
ISBN: 9811939985
Category : Technology & Engineering
Languages : en
Pages : 1902

View

Book Description
This book includes original, peer-reviewed research papers from the 2021 5th Chinese Conference on Swarm Intelligence and Cooperative Control (CCSICC2021), held in Shenzhen, China on January 19-22, 2022. The topics covered include but are not limited to: reviews and discussions of swarm intelligence, basic theories on swarm intelligence, swarm communication and networking, swarm perception, awareness and location, swarm decision and planning, cooperative control, cooperative guidance, swarm simulation and assessment. The papers showcased here share the latest findings on theories, algorithms and applications in swarm intelligence and cooperative control, making the book a valuable asset for researchers, engineers, and university students alike.

Author: Ding Wang
Publisher: Springer Nature
ISBN: 9811972915
Category : Technology & Engineering
Languages : en
Pages : 283

View

Book Description
This book intends to report new optimal control results with critic intelligence for complex discrete-time systems, which covers the novel control theory, advanced control methods, and typical applications for wastewater treatment systems. Therein, combining with artificial intelligence techniques, such as neural networks and reinforcement learning, the novel intelligent critic control theory as well as a series of advanced optimal regulation and trajectory tracking strategies are established for discrete-time nonlinear systems, followed by application verifications to complex wastewater treatment processes. Consequently, developing such kind of critic intelligence approaches is of great significance for nonlinear optimization and wastewater recycling. The book is likely to be of interest to researchers and practitioners as well as graduate students in automation, computer science, and process industry who wish to learn core principles, methods, algorithms, and applications in the field of intelligent optimal control. It is beneficial to promote the development of intelligent optimal control approaches and the construction of high-level intelligent systems.

Author: Ding Wang
Publisher: Springer
ISBN: 9811312532
Category : Technology & Engineering
Languages : en
Pages : 307

View

Book Description
This book reports on the latest advances in adaptive critic control with robust stabilization for uncertain nonlinear systems. Covering the core theory, novel methods, and a number of typical industrial applications related to the robust adaptive critic control field, it develops a comprehensive framework of robust adaptive strategies, including theoretical analysis, algorithm design, simulation verification, and experimental results. As such, it is of interest to university researchers, graduate students, and engineers in the fields of automation, computer science, and electrical engineering wishing to learn about the fundamental principles, methods, algorithms, and applications in the field of robust adaptive critic control. In addition, it promotes the development of robust adaptive critic control approaches, and the construction of higher-level intelligent systems.

Author: Fuchun Sun
Publisher: Springer
ISBN: 9811052301
Category : Computers
Languages : en
Pages : 619

View

Book Description
This book constitutes the refereed proceedings of the Third International Conference on Cognitive Systems and Signal Processing, ICCSIP2016, held in Beijing, China, in December 2016. The 59 revised full papers presented were carefully reviewed and selected from 171 submissions. The papers are organized in topical sections on Control and Decision; Image and Video; Machine Learning; Robotics; Cognitive System; Cognitive Signal Processing.

Author: Huaguang Zhang
Publisher: Springer Science & Business Media
ISBN: 144714757X
Category : Technology & Engineering
Languages : en
Pages : 432

View

Book Description
There are many methods of stable controller design for nonlinear systems. In seeking to go beyond the minimum requirement of stability, Adaptive Dynamic Programming in Discrete Time approaches the challenging topic of optimal control for nonlinear systems using the tools of adaptive dynamic programming (ADP). The range of systems treated is extensive; affine, switched, singularly perturbed and time-delay nonlinear systems are discussed as are the uses of neural networks and techniques of value and policy iteration. The text features three main aspects of ADP in which the methods proposed for stabilization and for tracking and games benefit from the incorporation of optimal control methods: • infinite-horizon control for which the difficulty of solving partial differential Hamilton–Jacobi–Bellman equations directly is overcome, and proof provided that the iterative value function updating sequence converges to the infimum of all the value functions obtained by admissible control law sequences; • finite-horizon control, implemented in discrete-time nonlinear systems showing the reader how to obtain suboptimal control solutions within a fixed number of control steps and with results more easily applied in real systems than those usually gained from infinite-horizon control; • nonlinear games for which a pair of mixed optimal policies are derived for solving games both when the saddle point does not exist, and, when it does, avoiding the existence conditions of the saddle point. Non-zero-sum games are studied in the context of a single network scheme in which policies are obtained guaranteeing system stability and minimizing the individual performance function yielding a Nash equilibrium. In order to make the coverage suitable for the student as well as for the expert reader, Adaptive Dynamic Programming in Discrete Time: • establishes the fundamental theory involved clearly with each chapter devoted to a clearly identifiable control paradigm; • demonstrates convergence proofs of the ADP algorithms to deepen understanding of the derivation of stability and convergence with the iterative computational methods used; and • shows how ADP methods can be put to use both in simulation and in real applications. This text will be of considerable interest to researchers interested in optimal control and its applications in operations research, applied mathematics computational intelligence and engineering. Graduate students working in control and operations research will also find the ideas presented here to be a source of powerful methods for furthering their study.

Author: Yinyan Zhang
Publisher: Springer Nature
ISBN: 3030333841
Category : Technology & Engineering
Languages : en
Pages : 225

View

Book Description
This book discusses methods and algorithms for the near-optimal adaptive control of nonlinear systems, including the corresponding theoretical analysis and simulative examples, and presents two innovative methods for the redundancy resolution of redundant manipulators with consideration of parameter uncertainty and periodic disturbances. It also reports on a series of systematic investigations on a near-optimal adaptive control method based on the Taylor expansion, neural networks, estimator design approaches, and the idea of sliding mode control, focusing on the tracking control problem of nonlinear systems under different scenarios. The book culminates with a presentation of two new redundancy resolution methods; one addresses adaptive kinematic control of redundant manipulators, and the other centers on the effect of periodic input disturbance on redundancy resolution. Each self-contained chapter is clearly written, making the book accessible to graduate students as well as academic and industrial researchers in the fields of adaptive and optimal control, robotics, and dynamic neural networks.

Author: Andrea L'Afflitto
Publisher: Springer Nature
ISBN: 3031397673
Category : Technology & Engineering
Languages : en
Pages : 363

View

Book Description
Control of Autonomous Aerial Vehicles is an edited book that provides a single-volume snapshot on the state of the art in the field of control theory applied to the design of autonomous unmanned aerial vehicles (UAVs), aka “drones”, employed in a variety of applications. The homogeneous structure allows the reader to transition seamlessly through results in guidance, navigation, and control of UAVs, according to the canonical classification of the main components of a UAV’s autopilot. Each chapter has been written to assist graduate students and practitioners in the fields of aerospace engineering and control theory. The contributing authors duly present detailed literature reviews, conveying their arguments in a systematic way with the help of diagrams, plots, and algorithms. They showcase the applicability of their results by means of flight tests and numerical simulations, the results of which are discussed in detail. Control of Autonomous Aerial Vehicles will interest readers who are researchers, practitioners or graduate students in control theory, autonomous systems or robotics, or in aerospace, mechanical or electrical engineering.