Data-driven adaptive optimal control of linear uncertain systems with unknown jumping dynamics

This paper focuses on the optimal control of a DC torque motor servo system which represents a class of continuous-time linear uncertain systems with unknown jumping internal dynamics. A data-driven adaptive optimal control strategy based on the integration of adaptive dynamic programming (ADP) and switching control is presented to minimize a predefined cost function. This takes the first step to develop switching ADP methods and extend the application of ADP to time-varying systems. Moreover, an analytical method to give the initial stabilizing controller for policy iteration ADP is proposed. It is shown that under the proposed adaptive optimal control law, the closed-loop switched system is asymptotically stable at the origin. The effectiveness of the strategy is validated via simulations on the DC motor system model.     

Decentralized adaptive synchronization with bounded identification errors for discrete-time nonlinear multi-agent systems with unknown parameters and unknown high-frequency gains

This paper addresses the challenging problem of decentralized adaptive control for a class of coupled hidden leader-follower multi-agent systems, in which each agent is described by a nonlinearly parameterized uncertain model in discrete time and can interact with its neighbors via the history information from its neighbors. One of the agents is a leader, who knows the desired reference trajectory, while other agents cannot receive the desired reference signal or are unaware of existence of the leader. In order to tackle unknown internal parameters and unknown high-frequency gains, a projection-type parameter estimation algorithm is proposed. Based on the certainty equivalence principle and neighborhood history information, the decentralized adaptive control is designed, under which, the boundedness of identification error is guaranteed with the help of the Lyapunov theory. Under some conditions, it is shown that the multi-agent system eventually achieves synchronization in the presence of strong couplings. Finally, a simulation example is given to support the results of the proposed scheme.     

Robust adaptive visual tracking control for uncertain robotic systems with unknown dead-zone inputs

This paper is concerned with the image-based visual servoing (IBVS) control for uncalibrated camera-robot system with unknown dead-zone constraint, where the uncertain kinematics and dynamics are also considered. The control implementation is achieved by constructing a smooth inverse model for dead-zone-input to eliminate the nonlinear effect resulting from the actuator constraint. A novel adaptive algorithm, which does not require a priori knowledge of the parameter intervals of dead-zone model, is proposed to update the parameter values online, and the dead-zone slopes are not required the same. Furthermore, to accommodate the uncertainties of uncalibrated camera-robot system, adaptation laws are developed to estimate the uncertain parameters, simultaneously avoiding singularity of the image Jacobian matrix. With the full consideration of unknown dead-zone constraint and system uncertainties, an adaptive robust visual tracking control scheme together with dead-zone compensation is subsequently established such that the image tracking error converges to the origin. Based on a 3-DOF manipulator, simulations are conducted to verify the tracking performance of the proposed controller.     

Fuzzy adaptive control of nonlinear MIMO systems with unknown dead zone outputs

This paper addresses a novel fuzzy adaptive control method for a class of uncertain nonlinear multi-input multi-output (MIMO) systems with unknown dead-zone outputs and immeasurable states. The immeasurable states under consideration are estimated by designing a fuzzy state observer. Based on the properties of the Nussbaum-type function, the difficulty of fuzzy adaptive control caused by the unknown dead zone outputs of MIMO nonlinear uncertain systems is overcome. The presented design algorithm not only guarantees that all the signals in the closed-loop system are semi-globally uniformly ultimately bounded, but also ensures that the outputs of the MIMO system converge to a small neighborhood of the desired outputs. The main contributions of this research lie in that the developed MIMO systems are more general, and an efficient design method of output-feedback controller is investigated for the studied MIMO systems, which is more applicable in practical environment. Simulation results illustrate the effectiveness of the proposed scheme.     

Distributed adaptive event-triggered protocol for tracking control of leader-following multi-agent systems

A novel adaptive event-triggered control protocol is developed to investigate the tracking control problem of multi-agent systems with general linear dynamics. By introducing the event-triggered control strategy, each agent can decide when to transfer its state to its neighbors at its own triggering instants, which can greatly reduce communication burden of agents. It is shown that the “Zeno phenomenon” does not occur by verifying that there exists a positive lower bound on the inter-event time intervals of agents under the proposed adaptive event-triggered control algorithm. Finally, an example is provided to testify the effectiveness of the obtained theoretical results.     

Mixed order robust adaptive control for general linear time invariant systems

We provide a solution to the adaptive control problem of an unknown linear system of a given derivation order, using a reference model or desired poles defined in a possibly different derivation order and employing continuous adjustment of parameters ruled by possibly another different derivation order. To this purpose, we present an extension for the fractional settings of the Bezout’s lemma and gradient steepest descent adjustment. We analyze both the direct and indirect approaches to adaptive control. We discuss some robustness advantages/disadvantages of the fractional adjustment of parameters in comparison with the integer one and, through simulations, the possibility to define optimal derivation order controllers.     

Distributed adaptive output-feedback tracking control of non-affine multi-agent systems with prescribed performance

This paper addresses the distributed adaptive output-feedback tracking control problem of uncertain multi-agent systems in non-affine pure-feedback form under a directed communication topology. Since the control input is implicit for each non-affine agent, we introduce an auxiliary first-order dynamics to circumvent the difficulty in control protocol design and avoid the algebraic loop problem in control inputs and the unknown control gain problem. A decentralized input-driven observer is applied to reconstruct state information of each agent, which makes the design and synthesis extremely simplified. Based on the dynamic surface control technique and neural network approximators, a distributed output-feedback control protocol with prescribed tracking performance is derived. Compared with the existing results, the restrictive assumptions on the partial derivative of non-affine functions are removed. Moreover, it is proved that the output tracking errors always stay in a prescribed performance bound. The simulation results are provided to demonstrate the effectiveness of the proposed method.     

Model reference adaptive control for switched linear systems using switched multiple models control strategy

In this paper, the multiple model strategy is applied to the adaptive control of switched linear systems to improve the transient performance. The solvability of the adaptive stabilization problem of each subsystem is not required. Firstly, the two-layer switching mechanism is designed. The state-dependent switching law with dwell time constraint is designed in the outer-layer switching to guarantee the stability of the switched systems. During the interval of dwell time constraint, the parameter resetting adaptive laws are designed in the inner-layer switching to improve the transient performance. Secondly, the minimum dwell time constraint providing enough time for multiple model adaptive control strategy to work fully and maintaining the stability of the switched systems is found. Finally, the proposed switched multiple model adaptive control strategy guarantees that all the closed-loop system signals remain bounded and the state tracking error converges to zero.     

An integrated data-driven Markov parameters sequence identification and adaptive dynamic programming method to design fault-tolerant optimal tracking control for completely unknown model systems

In this paper, an integrated design of data-driven fault-tolerant tracking control is addressed relying on the Markov parameters sequence identification and adaptive dynamic programming techniques. For the unknown model systems, the sequence of Markov parameters together with the covariance of innovation signal is firstly estimated by least square method. After a transformation of value function from stochastic to deterministic, a policy iteration adaptive dynamic programming algorithm is then formulated to find the optimal tracking control law. In order to eliminate the influence of unpredicted faults, an active fault-tolerant supervisory control strategy is further constructed by synthesizing fault detection, isolation, estimation and compensation. All these involved designs are performed in the data-driven manner, and thus avoid the information requirement about system drift dynamics. From the perspective of system operation management, the above integrated control scheme provides a framework to achieve the tracking performance optimization, monitoring and maintaining simultaneously. The effectiveness of these conclusions is finally verified via two case studies.     

Adaptive tracking control for nonlinear heterogeneous multi-agent systems with unknown dynamics

This paper is concerned with the tracking control problem for nonlinear heterogeneous multi-agent systems with a static leader, where the leader’s state is only available to a small portion of follower agents. The considered multi-agent system is composed of first- and second-order follower agents with unknown nonlinearities and unknown disturbances, and the communication graph of follower agents is fixed and directed. A robust adaptive neural network controller is designed for each follower agent. By applying the Lyapunov theory with the singular value analysis method, it is shown that all follower agents will synchronize to the leader agent with bounded residual errors. A numerical example is presented to demonstrate the effectiveness of the theoretical findings.     

Distributed formation control for multiple quadrotor UAVs under Markovian switching topologies with partially unknown transition rates

This paper addresses distributed formation control for a group of quadrotor unmanned aerial vehicles (UAVs) under Markovian switching topologies with partially unknown transition rates. Instead of the general stochastic topology, the graph is governed by a set of Markov chains to the edges, which can recover the traditional Markovian switching topologies in line with the practical communication network. Extended high gain observers (EHGOs) are constructed with a two-time-scale format to deal with the issue of nonlinear input coefficients, so that there could be a higher estimation precision of the system uncertainties. To impel multiple quadrotor UAVs to achieve a predesigned formation shape, a modified integral sliding mode (ISM) control protocol is proposed here with a multi-time-scale structure, which allows independent analysis of the dynamics in each time scale. The stability proof for the system state space origin is derived from the singular perturbation method and Lyapunov stability theory. In addition, the introduced ISM controller can deal with the time varying desired references with the bounded accelerations and is robust to the disturbances. Finally, simulations on six quadrotor UAVs are given to verify the effectiveness of the theoretical results.     

Adaptive iterative learning protocol design for nonlinear multi-agent systems with unknown control direction

This paper investigates a new adaptive iterative learning control protocol design for uncertain nonlinear multi-agent systems with unknown gain signs. Based on Nussbaum gain, adaptive iterative learning control protocols are designed for each follower agent and the adaptive laws depend on the information available from the agents in the neighbourhood. The proper protocols guarantee each follower agent track the leader perfectly on the finite time interval and the Nussbaum-type item can seek control direction adaptively. Furthermore, the formation problem is studied as an extension. Finally, simulation examples are given to demonstrate the effectiveness of the proposed method in this article.     

Command filter-based finite-time adaptive fuzzy control for nonlinear systems with uncertain disturbance

In this paper, a command filter-based adaptive fuzzy controller is constructed for a class of nonlinear systems with uncertain disturbance. By using the error compensation signals and fuzzy logic system, a command filter-based control strategy is presented to make that the tracking error converge to an any small neighborhood of zero and all closed-loop signals are bounded. In the design procedure, fuzzy logic system is employed to estimate unknown package nonlinear functions, which avoids excessive and burdensome computations. The control scheme not only resolves the explosion of complexity problem but also eliminates the filtering error in finite-time. An example has evaluated the validity of the control method.     

Iterative learning control for linear delay systems with deterministic and random impulses

This paper investigates convergence of iterative learning control for linear delay systems with deterministic and random impulses by virtute of the representation of solutions involving a concept of delayed exponential matrix. We address linear delay systems with deterministic impulses by designing a standard P-type learning law via rigorous mathematical analysis. Next, we extend to consider the tracking problem for delay systems with random impulses under randomly varying length circumstances by designing two modified learning laws. We present sufficient conditions for both deterministic and random impulse cases to guarantee the zero-error convergence of tracking error in the sense of Lebesgue-p norm and the expectation of Lebesgue-p norm of stochastic variable, respectively. Finally, numerical examples are given to verify the theoretical results.     

Subspace predictive control with the data-driven event-triggered law for linear time-invariant systems

In this paper, a subspace predictive control (SPC) method with a novel data-driven event-triggered law is proposed for linear time-invariant systems with unknown model parameters. Based on the conventional SPC method, the event-triggered law is introduced to substitute the typical receding horizon optimization, which reduces the data computation load of the traditional SPC method. The key parameters of the event-triggered law are derived by the Q-learning method via system data and the input-to-state stability of the system can be ensured with the designed event-triggered law. The simulation results illustrate the effect and merits of the proposed method with comparisons.     

Adaptive finite-time control for stochastic nonlinear systems subject to unknown covariance noise

This paper is devoted to the adaptive finite-time control for a class of stochastic nonlinear systems driven by the noise of covariance. The traditional growth conditions assumed on the drift and diffusion terms are removed through a technical lemma, and the negative effect generated by unknown covariance noise is compensated by combining adaptive control technique with backstepping recursive design. Then, without imposing any growth assumptions, a smooth adaptive state-feedback controller is skillfully designed and analyzed with the help of the adding a power integrator method and stochastic backstepping technique. Distinctive from the global stability in probability or asymptotic stability in probability obtained in related work, the proposed design algorithm can guarantee the solution of the closed-loop system to be finite-time stable in probability. Finally, a stochastic simple pendulum system is skillfully constructed to demonstrate the effectiveness of the proposed control scheme.     

Data-driven optimal tracking control for discrete-time systems with delays using adaptive dynamic programming

In this paper, the data-driven adaptive dynamic programming (ADP) algorithm is proposed to deal with the optimal tracking problem for the general discrete-time (DT) systems with delays for the first time. The model-free ADP algorithm is presented by using only the system’s input, output and the reference trajectory of the finite steps of historical data. First, the augmented state equation is constructed based on the time-delay system and the reference system. Second, a novel data-driven state equation is derived by virtue of the history data composed of input, output and reference trajectory, which is considered as a state estimator.Then, a novel data-driven Bellman equation for the linear quadratic tracking (LQT) problem with delays is deduced. Finally, the data-driven ADP algorithm is designed to solve the LQT problem with delays and does not require any system dynamics. The simulation result demonstrates the validity of the proposed data-driven ADP algorithm in this paper for the LQT problem with delays.     

Security control for Markov jump system with adversarial attacks and unknown transition rates via adaptive sliding mode technique

This paper is concerned with the security control problem for a class of Markov jump systems subject to false data injection attack and incomplete transition rates. An on-line estimation strategy is provided for the time-variant and unknown cyber-attack modes. And then, an adaptive sliding mode controller is synthesized with different robust terms for different modes to guarantee the reachability of the specified sliding surface. Moreover, the sufficient conditions for the stability of the closed-loop systems are derived. Finally, it is shown from simulation results that the effect of both false data injection attack and incomplete TRs can be effectively attenuated by the present adaptive SMC method.     

Reliable control for event-triggered singular Markov jump systems with partly unknown transition probabilities and actuator faults

In this paper, the problem of reliable controller design for event-triggered singular Markov jump systems with partly known transition probabilities, nonlinear perturbations and actuator faults is studied. To mitigate the burden of data transmissions over network, two event-triggered schemes with different triggering conditions are introduced. The switch law between the two event-triggered schemes is governed by a random variable with Bernoulli distribution. Taking nonlinear perturbations and actuator faults into account, the resulting closed-loop system is converted into a time-delay singular Markov jump system with partly known transition probabilities. Sufficient conditions of stochastically admissible for the resulting closed-loop system are obtained in terms of a group of linear matrix inequalities. The co-design of desirable reliable controller and weighting matrices of event-triggered schemes is presented. Finally, two numerical examples are given to show the effectiveness of the developed results.