The filtering based parameter identification for bilinear-in-parameter systems

This paper discusses the parameter estimation for a class of bilinear-in-parameter systems with colored noise. By utilizing the filtering technique, we derive the relationship between the filtered output and the measurement output and obtain two linear regressive sub-models. A filtering based multi-innovation stochastic gradient algorithm is derived for interactively identifying each sub-model. The proposed algorithm avoids the estimation of correlated noise and improves the parameter estimation accuracy by making full use of the measurement data. The numerical simulation results indicate that the proposed algorithm has higher estimation accuracy than the hierarchical multi-innovation stochastic gradient algorithm.     

Combined state and parameter estimation for a bilinear state space system with moving average noise

This paper considers the identification problem of bilinear systems with measurement noise in the form of the moving average model. In particular, we present an interactive estimation algorithm for unmeasurable states and parameters based on the hierarchical identification principle. For unknown states, we formulate a novel bilinear state observer from input-output measurements using the Kalman filter. Then a bilinear state observer based multi-innovation extended stochastic gradient (BSO-MI-ESG) algorithm is proposed to estimate the unknown system parameters. A linear filter is utilized to improve the parameter estimation accuracy and a filtering based BSO-MI-ESG algorithm is presented using the data filtering technique. In the numerical example, we illustrate the effectiveness of the proposed identification methods.     

Fitting the exponential autoregressive model through recursive search

This paper focuses on the recursive parameter estimation methods for the exponential autoregressive (ExpAR) model. Applying the negative gradient search and introducing a forgetting factor, a stochastic gradient and a forgetting factor stochastic gradient algorithms are presented. In order to improve the parameter estimation accuracy and the convergence rate, the multi-innovation identification theory is employed to derive a forgetting factor multi-innovation stochastic gradient algorithm. A simulation example is provided to test the effectiveness of the proposed algorithms.     

Kalman filtering based gradient estimation algorithms for observer canonical state-space systems with moving average noises

This paper focuses on the joint parameter and state estimation issue for observer canonical state-space systems with white noises in state equations and moving average noises in output equations. By means of the Kalman filtering and the gradient search, we derive a Kalman filtering based extended stochastic gradient algorithm. For purpose of achieving the higher parameter estimation accuracy, a Kalman filtering based multi-innovation extended stochastic gradient algorithm is proposed on the basis of the multi-innovation identification theory. Finally, the effectiveness of the proposed algorithms is validated through a numerical example.     

Modified multi-innovation stochastic gradient algorithm for Wiener–Hammerstein systems with backlash

In this paper, the identification of the Wiener–Hammerstein systems with unknown orders linear subsystems and backlash is investigated by using the modified multi-innovation stochastic gradient identification algorithm. In this scheme, in order to facilitate subsequent parameter identification, the orders of linear subsystems are firstly determined by using the determinant ratio approach. To address the multi-innovation length problem in the conventional multi-innovation least squares algorithm, the innovation updating is decomposed into sub-innovations updating through the usage of multi-step updating technique. In the identification procedure, by reframing two auxiliary models, the unknown internal variables are replaced by using the outputs of the corresponding auxiliary model. Furthermore, the convergence analysis of the proposed algorithm has shown that the parameter estimation error can converge to zero. Simulation examples are provided to validate the efficiency of the proposed algorithm.     

Model recovery for multi-input signal-output nonlinear systems based on the compressed sensing recovery theory

This paper considers the parameter and order estimation for multiple-input single-output nonlinear systems. Since the orders of the system are unknown, a high-dimensional identification model and a sparse parameter vector are established to include all the valid inputs and basic parameters. Applying the data filtering technique, the input-output data are filtered and the original identification model with autoregressive noise is changed into the identification model with white noise. Based on the compressed sensing recovery theory, a data filtering-based orthogonal matching pursuit algorithm is presented for estimating the system parameters and the orders. The presented method can obtain highly accurate estimates from a small number of measurements by finding the highest absolute inner product. The simulation results confirm that the proposed algorithm is effective for recovering the model of the multiple-input single-output Hammerstein finite impulse response systems.     

Multi-innovation gradient estimation algorithms and convergence analysis for feedback nonlinear equation-error moving average systems

Considering the colored noises from the process environments, the parameter estimation problems for the feedback nonlinear equation-error systems interfered by moving average noises are addressed in this paper. Due to small computational burden, the gradient search principle is adopted to the feedback nonlinear systems and an overall extended stochastic gradient algorithm is derived for parameter estimation. Introducing the innovation length, the scalar innovation is expanded into the innovation vector and a multi-innovation extended stochastic gradient algorithm is further developed to reach the high estimation accuracy by utilizing more dynamical observed data. Furthermore, to assure the convergence of the proposed algorithms, their convergence properties are analyzed through the stochastic process theory. Finally, the experimental results indicate the effectiveness of the proposed algorithms.     

Several gradient parameter estimation algorithms for dual-rate sampled systems

This paper presents three identification methods for dual-rate sampled systems. The first method combines the stochastic gradient algorithm with the polynomial transformation technique, which can estimate the parameters of the identification model. The second method is the finite impulse response model based stochastic gradient algorithm, which can indirectly estimate the parameters of the dual-rate systems by using all the inputs and the available outputs. The third method is the missing output estimation model based stochastic gradient algorithm with a forgetting factor, which can directly estimate the parameters of the dual-rate systems by using all the inputs and all the outputs (include the estimated outputs). An example is provided to verify the effectiveness of the proposed methods.     

The data-filtering based bias compensation recursive least squares identification for multi-input single-output systems with colored noises

For the multi-input single-output (MISO) system corrupted by colored noise, we transform the original system model into a new MISO output error model with white noise through data filtering technology. Based on the newly obtained model and the bias compensation principle, a novel data filtering-based bias compensation recursive least squares (BCRLS) identification algorithm is developed for identifying the parameters of the MISO system with colored noise disturbance. Unlike the exiting BCRLS method for the MISO system (see, in Section 3), without computing the complicated noise correlation functions, still the proposed method can achieve the unbiased parameters estimation of the MISO system in the case of colored process noises. The proposed algorithm simplifies the implementation of and further expands the application scope of the existing BCRLS method. Three numerical examples clearly illustrate the validity of and the good performances of the proposed method, including its superiority over the BCRLS method and so on.     

Data filtering based maximum likelihood extended gradient method for multivariable systems with autoregressive moving average noise

For multivariable systems with autoregressive moving average noises, we decompose the multivariable system into m subsystems (m denotes the number of outputs) and present a maximum likelihood generalized extended gradient algorithm and a data filtering based maximum likelihood extended gradient algorithm to estimate the parameter vectors of these subsystems. By combining the maximum likelihood principle and the data filtering technique, the proposed algorithms are effective and have computational advantages over existing estimation algorithms. Finally, a numerical simulation example is given to support the developed methods and to show their effectiveness.     

A filtering based recursive least squares estimation algorithm for pseudo-linear auto-regressive systems

This paper uses the filtering technique, transforms a pseudo-linear auto-regressive system into an identification model and presents a new recursive least squares parameter estimation algorithm pseudo-linear auto-regressive systems. The proposed algorithm has a high computational efficiency because the dimensions of its covariance matrices become small compared with the recursive generalized least squares algorithm.     

Parameter estimation for an input nonlinear state space system with time delay

This paper researches parameter estimation problems for an input nonlinear system with state time-delay. Combining the linear transformation and the property of the shift operator, the system is transformed into a bilinear parameter identification model. A gradient based and a least squares based iterative parameter estimation algorithms are presented for identifying the state time-delay system. The simulation results confirm that the proposed two algorithms are effective and the least squares based iterative algorithm has faster convergence rates than the gradient based iterative algorithm.     

Parameter estimation algorithms for Hammerstein output error systems using Levenberg–Marquardt optimization method with varying interval measurements

This paper studies the parameter estimation problem of Hammerstein output error autoregressive (OEAR) systems. According to the maximum likelihood principle and the Levenberg–Marquardt optimization method, a maximum likelihood Levenberg–Marquardt recursive (ML-LM-R) algorithm using the varying interval input–output data is proposed. Furthermore, a stochastic gradient algorithm is also derived in order to compare it with the proposed ML-LM-R algorithm. Two numerical examples are provided to verify the effectiveness of the proposed algorithms.     

Hierarchical recursive least squares parameter estimation of non-uniformly sampled Hammerstein nonlinear systems based on Kalman filter

This paper focuses on parameter estimation problems for non-uniformly sampled Hammerstein nonlinear systems. By combining the lifting technique and state space transformation, we derive a nonlinear regression identification model with different input and output updating rates. Furthermore, the unmeasurable state vector is estimated by Kalman filter, and by using the hierarchical identification principle, we develop a hierarchical recursive least squares algorithm for estimating the unknown parameters of the identification model. Finally, illustrative examples are given to indicate that the proposed algorithm is effective.     

Identification of errors-in-variables ARX models using modified dynamic iterative PCA

Identification of autoregressive models with exogenous input (ARX) is a classical problem in system identification. This article considers the errors-in-variables (EIV) ARX model identification problem, where input measurements are also corrupted with noise. The recently proposed Dynamic Iterative Principal Components Analysis (DIPCA) technique solves the EIV identification problem but is only applicable to white measurement errors. We propose a novel identification algorithm based on a modified DIPCA approach for identifying the EIV-ARX model for single-input, single-output (SISO) systems where the output measurements are corrupted with coloured noise consistent with the ARX model. Most of the existing methods assume important parameters like input-output orders, delay, or noise-variances to be known. This work’s novelty lies in the joint estimation of error variances, process order, delay, and model parameters. The central idea used to obtain all these parameters in a theoretically rigorous manner is based on transforming the lagged measurements using the appropriate error covariance matrix, which is obtained using estimated error variances and model parameters. Simulation studies on two systems are presented to demonstrate the efficacy of the proposed algorithm.     

Filtering based parameter estimation for observer canonical state space systems with colored noise

This paper surveys the identification of observer canonical state space systems affected by colored noise. By means of the filtering technique, a filtering based recursive generalized extended least squares algorithm is proposed for enhancing the parameter identification accuracy. To ease the computational burden, the filtered regressive model is separated into two fictitious sub-models, and then a filtering based two-stage recursive generalized extended least squares algorithm is developed on the basis of the hierarchical identification. The stochastic martingale theory is applied to analyze the convergence of the proposed algorithms. An experimental example is provided to validate the proposed algorithms.     

Iterative identification for multiple-input systems with time-delays based on greedy pursuit and auxiliary model

This paper focuses on the identification of multiple-input single-output output-error systems with unknown time-delays. Since the time-delays are unknown, an identification model with a high dimensional and sparse parameter vector is derived based on overparameterization. Traditional identification methods cannot get sparse solutions and require a large number of observations unless the time-delays are predetermined. Inspired by the sparse optimization and the greedy algorithms, an auxiliary model based orthogonal matching pursuit iterative (AM-OMPI) algorithm is proposed by using the orthogonal matching pursuit, and then based on the gradient search, an auxiliary model based gradient pursuit iterative algorithm is proposed, which is computationally more efficient than the AM-OMPI algorithm. The proposed methods can simultaneously estimate the parameters and time-delays from a small number of sampled data. A simulation example is used to illustrate the effectiveness of the proposed algorithms.     

Leader-following consensus of multi-agent systems with connectivity-mixed attacks and actuator/sensor faults

This study investigates the leader-following consensus issue of multi-agent systems subject to simultaneous connectivity-mixed attacks, actuator/sensor faults and disturbances. Connectivity-mixed attacks are remodeled into connectivity-maintained and connectivity-paralyzed topologies in a switched version, and actuator/sensor faults are established with unified incipient-type and abrupt-type characteristics. Then, unknown input observer-based decoupling and estimation are incorporated to achieve unknown state and fault observations with the normalized technique, and the leader-following consensus-based compensation to faults, resilience to attacks and robustness to disturbances are also realized with the neighboring output information and sensor fault estimation through the distributed framework. Criteria of achieving exponential leader-following consensus of multi-agent systems under cyber-physical threats are derived with dual attack frequency and activation rate indicators. Simulation example is conducted to exemplify the validation and merits of the proposed leader-following consensus algorithm.     

Filtering search results using an optimal set of terms identified by an artificial neural network

Information filtering (IF) systems usually filter data items by correlating a set of terms representing the user’s interest (a user profile) with similar sets of terms representing the data items. Many techniques can be employed for constructing user profiles automatically, but they usually yield large sets of term. Various dimensionality-reduction techniques can be applied in order to reduce the number of terms in a user profile. We describe a new terms selection technique including a dimensionality-reduction mechanism which is based on the analysis of a trained artificial neural network (ANN) model. Its novel feature is the identification of an optimal set of terms that can classify correctly data items that are relevant to a user. The proposed technique was compared with the classical Rocchio algorithm. We found that when using all the distinct terms in the training set to train an ANN, the Rocchio algorithm outperforms the ANN based filtering system, but after applying the new dimensionality-reduction technique, leaving only an optimal set of terms, the improved ANN technique outperformed both the original ANN and the Rocchio algorithm.