RHONN identifier-control scheme for nonlinear discrete-time systems with unknown time-delays

This work presents a neural identifier-control scheme for uncertain nonlinear discrete-time systems with unknown time-delays. This scheme is based on a neural identifier to get a model of the system and a discrete-time block control technique based on sliding modes to generate the control law. The neural identifier is based on a Recurrent High Order Neural Network (RHONN) trained with an Extended Kalman Filter (EKF) based algorithm. Applicability is shown using real-time test results for linear induction motors. Also, a Lyapunov analysis is added in order to prove the semi-globally uniformly ultimately boundedness (SGUUB) of the proposed neural identifier-control scheme.     

Terminal iterative learning control for discrete-time nonlinear systems based on neural networks

The terminal iterative learning control is designed for nonlinear systems based on neural networks. A terminal output tracking error model is obtained by using a system input and output algebraic function as well as the differential mean value theorem. The radial basis function neural network is utilized to construct the input for the system. The weights are updated by optimizing an objective function and an auxiliary error is introduced to compensate the approximation error from the neural network. Both time-invariant input case and time-varying input case are discussed in the note. Strict convergence analysis of proposed algorithm is proved by the Lyapunov like method. Simulations based on train station control problem and batch reactor are provided to demonstrate the effectiveness of the proposed algorithms.     

Decentralized adaptive synchronization with bounded identification errors for discrete-time nonlinear multi-agent systems with unknown parameters and unknown high-frequency gains

This paper addresses the challenging problem of decentralized adaptive control for a class of coupled hidden leader-follower multi-agent systems, in which each agent is described by a nonlinearly parameterized uncertain model in discrete time and can interact with its neighbors via the history information from its neighbors. One of the agents is a leader, who knows the desired reference trajectory, while other agents cannot receive the desired reference signal or are unaware of existence of the leader. In order to tackle unknown internal parameters and unknown high-frequency gains, a projection-type parameter estimation algorithm is proposed. Based on the certainty equivalence principle and neighborhood history information, the decentralized adaptive control is designed, under which, the boundedness of identification error is guaranteed with the help of the Lyapunov theory. Under some conditions, it is shown that the multi-agent system eventually achieves synchronization in the presence of strong couplings. Finally, a simulation example is given to support the results of the proposed scheme.     

Discrete Razumikhin-type stability theorems for stochastic discrete-time delay systems

By using the Razumikhin-type technique, for stochastic discrete-time delay systems, this paper establishes the discrete Razumikhin-type theorems on the pth moment stability, the global pth moment stability and the pth moment exponential stability, respectively. The almost sure exponential stability is also investigated by using the pth moment exponential stability and the Borel–Cantelli lemma. As the applications of t he established theorems, stability of a special class of stochastic discrete-time delay systems, synchronization of the stochastic discrete-time delay dynamical networks and stabilization of a stochastic discrete-time linear delay time invariant system are examined.     

Reachable set estimation for discrete-time bilinear systems with time-varying delays

The problem of reachable set estimation is studied for discrete-time bilinear system in this paper. Time-varying delays and bounded input disturbances are both considered in bilinear system. The aim is to find reachable set that converges from all the states of system with initial conditions. By constructing Lyapunov–Krasovskii functional, sufficient delay-dependent less conservative stable conditions of reachable set estimation are obtained for bilinear delay system via the reciprocally convex combination and delay partition approaches. The derived theorem can guarantee that all the states of system with initial conditions from some domain are bounded in an ellipsoid and all the states from other domain are converged exponentially within a ball. One simulation example is presented to illustrate the correctness of the derived result in this paper.     

On convergence of the discrete-time nonlinear extended state observer

This paper concerns with the convergence of the discrete-time nonlinear extended state observer (ESO). Several kinds of discrete-time nonlinear ESO (NLESO) are proposed and then sufficient conditions based on linear matrix inequality (LMI) method are obtained to quantitatively reveal the relationship between the plant, the sampling interval, the parameter values of NLESO and its convergence. The theoretical results are verified by simulation using a motion control system. It shows that there may exist an optimal ω_o for a certain fixed sampling interval, and a smaller sampling interval generally generates better performance. What’s more, the proposed digital implementations of NLESO improve its performance over traditional Euler approximation discretization method.     

Output reachable set estimation for discrete-time switched systems with persistent dwell-time

This paper is concerned with the output reachable set estimation for discrete-time switched systems. The switching signal is considered as persistent dwell-time (PDT), which is more general and flexible compared with the common dwell-time and average dwell-time switching. The estimation of output reachable set is determined by a collection of bounding ellipsoids based on a family of quasi-time-dependent (QTD) Lyapunov functions. Furthermore, a set of non-fragile QTD controllers is designed. Finally, two examples are employed to illustrate the potentials of proposed methods.     

A new method for designing distributed reduced-order functional observers of interconnected time-delay systems

This paper reports a new method for designing distributed reduced-order functional observers of a class of interconnected systems with time delays. The systems under consideration belong to a class of large-scale systems where each system is formed by a number of interconnected subsystems. Moreover, the interconnections and the states of the local subsystems are subject to heterogeneous time delays. The novel contribution of this paper lies in the development of new coordinate state transformations, which are used to transform the interconnected subsystems into decoupled subsystems. Most significantly, each decoupled subsystem does not contain any time delay in the state vector. Moreover, each decoupled subsystem is expressed in an observable canonical form, with time delays only appearing in the inputs and outputs of the system. Due to this novel structure, a reduced-order functional observer for each decoupled subsystem can be easily designed to estimate the unmeasurable local state vector. The designed observers for the local subsystems do not need to exchange the state estimates amongst themselves, and therefore, each observer for each local subsystem can be designed independently. Because of the state transformations, the designed observers have a more general structure than any of the existing distributed functional observers available in the literature. Numerical examples are given to illustrate the effectiveness and advantages of our results.     

New approaches to positive observer design for discrete-time positive linear systems

This paper aims at providing new design approaches for positive observers of discrete-time positive linear systems based on a construction method of linear copositive Lyapunov function for positive systems. First, an efficient positive observer design approach is proposed by using linear programming such that the observer error system is exponentially stable. Furthermore, an interval observer design is proposed for uncertain positive systems. Then, the results are extended to positive time delay systems. In contrast with the previous design approaches, the new design method provides a general observer design with lower computational burden. Finally, three comparison examples are given to show the merit of the new design approach.     

Chaotic behavior of discrete-time linear inclusion dynamical systems

Given any finite family of real d-by-d nonsingular matrices $\{S_1,\dots ,S_l\},$ by extending the well-known Li–Yorke chaos of a deterministic nonlinear dynamical system to a discrete-time linear inclusion or hybrid or switched system:

$\begin{array}{c}\hfill x_n\in \{S_k{x}_{n?1};1\le k\le l\},x_0\in {\mathbb{R}}^d\mathrm{and}n\ge 1,\end{array}$

we study the chaotic dynamics of the state trajectory (x_n(x₀, σ))_{n ≥ 1} with initial state $x_0\in {\mathbb{R}}^d,$ governed by a switching law $\sigma :\mathbb{N}\to \{1,\dots ,l\}$. Two sufficient conditions are given so that for a “large” set of switching laws σ, there exhibits the scrambled dynamics as follows: for all $x_0,y_0\in {\mathbb{R}}^d,x_0\ne y_0,$

$\begin{array}{c}\hfill \underset{n\to +\infty }{lim\; inf}\parallel x_n(x_0,\sigma )?x_n(y_0,\sigma )\parallel =0\mathrm{and}\underset{n\to +\infty }{lim\; sup}\parallel x_n(x_0,\sigma )?x_n(y_0,\sigma )\parallel =\infty .\end{array}$

This implies that there coexist positive, zero and negative Lyapunov exponents and that the trajectories (x_n(x₀, σ))_{n ≥ 1} are extremely sensitive to the initial states $x_0\in {\mathbb{R}}^d$. We also show that a periodically stable linear inclusion system, which may be product unbounded, does not exhibit any such chaotic behavior. An explicit simple example shows the discontinuity of Lyapunov exponents with respect to the switching laws.     

Controller design for discrete-time hybrid linear parameter-varying systems with semi-Markov mode switching

The paper is concerned with the stability and stabilization problems for a family of hybrid linear parameter-varying systems with stochastic mode switching. The switching phenomenon is modeled by a semi-Markov stochastic process which is more generalized than a Markov stochastic process. With the construction of a Lyapunov function that depends on both the parameter variation and operating mode, numerical testable stability and stabilization criteria are established in the sense of σ-error mean square stability with the aid of some mathematical techniques that can eliminate the terms containing products of matrices. To test the effectiveness of the designed stabilizing controller, we apply the developed theoretical results to a numerical example.     

Observer-based fault detection for uncertain nonlinear systems

This paper addresses L₂ observer-based fault detection issues for a class of nonlinear systems in the presence of parametric and dynamic uncertainties, respectively. To this end, three different types of uncertain affine nonlinear system models studied in this paper are described first. Then, the integrated design schemes of L₂ observer-based fault detection systems are derived with the aid of Hamilton–Jacobi inequalities (HJIs), respectively. Numerical examples are also provided in the end to demonstrate the effectiveness of the proposed results.     

Explicit condition for consensus of third-order discrete-time multi-agent systems without accelerated velocity measurements

This paper investigates the consensus problem for third-order discrete-time multi-agent systems in directed networks. For the case when each agent can only receive the information of position and velocity from its neighbors, necessary and sufficient conditions for consensus have been proposed. In contrast to the preceding work, we not only present the exact consensus value, but also illustrate the influence of scaling parameters and nonzero eigenvalues of the involved Laplacian matrix on consensus. Two numerical examples are given to demonstrate the effectiveness of the obtained results.     

Data-driven optimal tracking control for discrete-time systems with delays using adaptive dynamic programming

In this paper, the data-driven adaptive dynamic programming (ADP) algorithm is proposed to deal with the optimal tracking problem for the general discrete-time (DT) systems with delays for the first time. The model-free ADP algorithm is presented by using only the system’s input, output and the reference trajectory of the finite steps of historical data. First, the augmented state equation is constructed based on the time-delay system and the reference system. Second, a novel data-driven state equation is derived by virtue of the history data composed of input, output and reference trajectory, which is considered as a state estimator.Then, a novel data-driven Bellman equation for the linear quadratic tracking (LQT) problem with delays is deduced. Finally, the data-driven ADP algorithm is designed to solve the LQT problem with delays and does not require any system dynamics. The simulation result demonstrates the validity of the proposed data-driven ADP algorithm in this paper for the LQT problem with delays.     

Pattern-based NN control for uncertain pure-feedback nonlinear systems

Implementing human-like learning and control for nonlinear dynamical systems operating in different control situations is an important and challenging issue. This paper presents a pattern-based neural network (NN) control strategy for nonlinear pure-feedback systems via deterministic learning (DL). Firstly, an appropriately designed adaptive neural dynamic surface controller is proposed to achieve the finite time tracking control. By analyzing the recurrent property of NN input signals, a partial persistent excitation (PE) condition for radial basis function (RBF) network is established, the implicit desired control dynamics under different control situations are accurately identified via DL in the case that the dimension of NN input is reduced. And a set of pattern-based experienced actual and virtual controllers is constructed using the learned knowledge. Secondly, to classify different control situations, when the system is operating in different control situations but controlled by current normal experienced controller, the dynamics of each subsystem are accurately identified via DL, n sets of dynamical estimators are constructed using the learned knowledge. Thirdly, in the recognition phase, n sets of residuals are achieved by comparing each set of estimators with the monitored system, sudden change in the control situation is rapidly recognized based on the principle of the earliest occurrence of the minimum residual. Finally, in the control phase, according to the recognition result, the correct experienced actual and virtual controllers will be selected to control the plant, guaranteed stability and superior control performance are achieved without any further re-adaptation online. Simulation studies are given to verify the proposed scheme can not only acquire and memorize knowledge like humans, but also reuse the learned knowledge to achieve rapid recognition and control of current control situation.     

Probabilistic fuzzy logic controller for uncertain nonlinear systems

This paper proposes a probabilistic fuzzy proportional - integral (PFPI) controller for controlling uncertain nonlinear systems. Firstly, the probabilistic fuzzy logic system (PFLS) improves the capability of the ordinary fuzzy logic system (FLS) to overcome various uncertainties in the controlled dynamical systems by integrating the probability method into the fuzzy logic system. Moreover, the input/output relationship for the proposed PFPI controller is derived. The resulting structure is equivalent to nonlinear PI controller and the equivalent gains for the proposed PFPI controller are a nonlinear function of input variables. These gains are changed as the input variables changed. The sufficient conditions for the proposed PFPI controller, which achieve the bounded-input bounded-output (BIBO) stability are obtained based on the small gain theorem. Finally, the obtained results indicate that the PFPI controller is able to reduce the effect of the system uncertainties compared with the fuzzy PI (FPI) controller.     

Necessary and sufficient conditions to stability of discrete-time delay systems

This paper is concerned with the stability analysis of discrete-time linear systems with time-varying delays. The novelty of this paper lies in that a novel Lyapunov–Krasovskii functional that updates periodically along with the time is proposed to reduce the conservatism and eventually be able to achieve the non-conservativeness in stability analysis. It can be proved that the stability of a discrete-time linear delay system is equivalent to the existence of a periodic Lyapunov–Krasovskii functional. Two necessary and sufficient stability conditions in terms of linear matrix inequalities are proposed in this paper. Furthermore, the novel periodic Lyapunov–Krasovskii functional is employed to solve the ?₂-gain performance analysis problem when exogenous disturbance is considered. The effectiveness of the proposed results is illustrated by several numerical examples.