A Bayesian Approach for Analyzing Hierarchical Data With Missing Outcomes Through Structural Equation Models

Structural equation models are widely appreciated in behavioral, social, and psychological research to model relations between latent constructs and manifest variables, and to control for measurement errors. Most applications of structural equation models are based on fully observed data that are independently distributed. However, hierarchical data with a correlated structure are common in behavioral research, and very often, missing data are encountered. In this article, we propose a 2-level structural equation model for analyzing hierarchical data with missing entries, and describe a Bayesian approach for estimation and model comparison. We show how to use WinBUGS software to get the solution conveniently. The proposed methodologies are illustrated through a simulation study, and a real application in relation to organizational and management research concerning the study of the interrelationships of the latent constructs about job satisfaction, job responsibility, and life satisfaction for citizens in 43 countries.     

Bayesian Analysis of Multivariate Latent Curve Models With Nonlinear Longitudinal Latent Effects

In longitudinal studies, investigators often measure multiple variables at multiple time points and are interested in investigating individual differences in patterns of change on those variables. Furthermore, in behavioral, social, psychological, and medical research, investigators often deal with latent variables that cannot be observed directly and should be measured by 2 or more manifest variables. Longitudinal latent variables occur when the corresponding manifest variables are measured at multiple time points. Our primary interests are in studying the dynamic change of longitudinal latent variables and exploring the possible interactive effect among the latent variables.

Much of the existing research in longitudinal studies focuses on studying change in a single observed variable at different time points. In this article, we propose a novel latent curve model (LCM) for studying the dynamic change of multivariate manifest and latent variables and their linear and interaction relationships. The proposed LCM has the following useful features: First, it can handle multivariate variables for exploring the dynamic change of their relationships, whereas conventional LCMs usually consider change in a univariate variable. Second, it accommodates both first- and second-order latent variables and their interactions to explore how changes in latent attributes interact to produce a joint effect on the growth of an outcome variable. Third, it accommodates both continuous and ordered categorical data, and missing data.     

Bayesian Analysis of Mixture Structural Equation Models With an Unknown Number of Components

Multivariate heterogenous data with latent variables are common in many fields such as biological, medical, behavioral, and social-psychological sciences. Mixture structural equation models are multivariate techniques used to examine heterogeneous interrelationships among latent variables. In the analysis of mixture models, determination of the number of mixture components is always an important and challenging issue. This article aims to develop a full Bayesian approach with the use of reversible jump Markov chain Monte Carlo method to analyze mixture structural equation models with an unknown number of components. The proposed procedure can simultaneously and efficiently select the number of mixture components and conduct parameter estimation. Simulation studies show the satisfactory empirical performance of the method. The proposed method is applied to study risk factors of osteoporotic fractures in older people.     

Bayesian Analysis of Semiparametric Hidden Markov Models With Latent Variables

In psychological, social, behavioral, and medical studies, hidden Markov models (HMMs) have been extensively applied to the simultaneous modeling of heterogeneous observation and hidden transition in the analysis of longitudinal data. However, the majority of the existing HMMs are developed in a parametric framework without latent variables. This study considers a novel semiparametric HMM, which comprises a semiparametric latent variable model to investigate the complex interrelationships among latent variables and a nonparametric transition model to examine the linear and nonlinear effects of potential predictors on hidden transition. The Bayesian P-splines approach and Markov chain Monte Carlo methods are developed to estimate the unknown, a Bayesian model comparison statistic, is employed to conduct model comparison. The empirical performance of the proposed methodology is evaluated through simulation studies. An application to a data set derived from the National Longitudinal Survey of Youth is presented.     

Bayesian Quantile Structural Equation Models

Structural equation modeling is a common multivariate technique for the assessment of the interrelationships among latent variables. Structural equation models have been extensively applied to behavioral, medical, and social sciences. Basic structural equation models consist of a measurement equation for characterizing latent variables through multiple observed variables and a mean regression-type structural equation for investigating how explanatory latent variables influence outcomes of interest. However, the conventional structural equation does not provide a comprehensive analysis of the relationship between latent variables. In this article, we introduce the quantile regression method into structural equation models to assess the conditional quantile of the outcome latent variable given the explanatory latent variables and covariates. The estimation is conducted in a Bayesian framework with Markov Chain Monte Carlo algorithm. The posterior inference is performed with the help of asymmetric Laplace distribution. A simulation shows that the proposed method performs satisfactorily. An application to a study of chronic kidney disease is presented.     

A Multidimensional Finite Mixture Structural Equation Model for Nonignorable Missing Responses to Test Items

We propose a structural equation model, which reduces to a multidimensional latent class item response theory model, for the analysis of binary item responses with nonignorable missingness. The missingness mechanism is driven by 2 sets of latent variables: one describing the propensity to respond and the other referred to the abilities measured by the test items. These latent variables are assumed to have a discrete distribution, so as to reduce the number of parametric assumptions regarding the latent structure of the model. Individual covariates can also be included through a multinomial logistic parameterization for the distribution of the latent variables. Given the discrete nature of this distribution, the proposed model is efficiently estimated by the expectation–maximization algorithm. A simulation study is performed to evaluate the finite-sample properties of the parameter estimates. Moreover, an application is illustrated with data coming from a student entry test for the admission to some university courses.     

Bayesian Analysis of Structural Equation Model With Fixed Covariates

This article extends the LISREL model to incorporate fixed covariates at both the measurement and the structural equations of the model. A Bayesian procedure with conjugate type prior distributions is established. The joint Bayesian estimates of the latent variables and the structural parameters that involve the regression coefficients of the covariates, the variances, covariances and causations among the manifest and latent variables are obtained via the Gibbs sampler algorithm. It is shown that the conditional distributions required in the Gibbs sampler are familiar distributions, hence the algorithm is very efficient. A goodness of fit statistic for assessing the proposed model is presented. An illustrative example with some real data is presented.     

Nonlinear decoupling controller design based on least squares support vector regression

INTRODUCTION Most practical systems are multivariate nonlin- ear systems. In general, the MIMO (multiple inputs and multiple outputs) systems are coupled. This cou- pling affects the effectiveness of a specific loop con- troller on the corresponding output, and in some case, may become serious and cause many difficulties to the control system design. How to decouple the mul- tivariate systems and design practical controllers is one of the major issues in nonlinear control area. In recen…     

A Nonlinear Dynamic Latent Class Structural Equation Model

In this article, we propose a nonlinear dynamic latent class structural equation modeling (NDLC-SEM). It can be used to examine intra-individual processes of observed or latent variables. These processes are decomposed into parts which include individual- and time-specific components. Unobserved heterogeneity of the intra-individual processes are modeled via a latent Markov process that can be predicted by individual- and time-specific variables as random effects. We discuss examples of sub-models which are special cases of the more general NDLC-SEM framework. Furthermore, we provide empirical examples and illustrate how to estimate this model in a Bayesian framework. Finally, we discuss essential properties of the proposed framework, give recommendations for applications, and highlight some general problems in the estimation of parameters in comprehensive frameworks for intensive longitudinal data.     

Inferring Longitudinal Relationships Between Variables: Model Selection Between the Latent Change Score and Autoregressive Cross-Lagged Factor Models

This research focuses on the problem of model selection between the latent change score (LCS) model and the autoregressive cross-lagged (ARCL) model when the goal is to infer the longitudinal relationship between variables. We conducted a large-scale simulation study to (a) investigate the conditions under which these models return statistically (and substantively) different results concerning the presence of bivariate longitudinal relationships, and (b) ascertain the relative performance of an array of model selection procedures when such different results arise. The simulation results show that the primary sources of differences in parameter estimates across models are model parameters related to the slope factor scores in the LCS model (specifically, the correlation between the intercept factor and the slope factor scores) as well as the size of the data (specifically, the number of time points and sample size). Among several model selection procedures, correct selection rates were higher when using model fit indexes (i.e., comparative fit index, root mean square error of approximation) than when using a likelihood ratio test or any of several information criteria (i.e., Akaike’s information criterion, Bayesian information criterion, consistent AIC, and sample-size-adjusted BIC).     

On estimating finite mixtures of multivariate regression and simultaneous equation models

We propose a maximum likelihood framework for estimating finite mixtures of multivariate regression and simultaneous equation models with multiple endogenous variables. The proposed “semi‐parametric” approach posits that the sample of endogenous observations arises from a finite mixture of components (or latent‐classes) of unknown proportions with multiple structural relations implied by the specified model for each latent‐class. We devise an Expectation‐Maximization algorithm in a maximum likelihood framework to simultaneously estimate the class proportions, the class‐specific structural parameters, and posterior probabilities of membership of each observation into each latent‐class. The appropriate number of classes can be chosen using various information‐theoretic heuristics. A data set entailing cross‐sectional observations for a diverse sample of businesses is used to illustrate the proposed approach.     

Assessing Preknowledge Cheating via Innovative Measures: A Multiple-Group Analysis of Jointly Modeling Item Responses,Response Times,and Visual Fixation Counts

Many approaches have been proposed to jointly analyze item responses and response times to understand behavioral differences between normally and aberrantly behaved test-takers. Biometric information, such as data from eye trackers, can be used to better identify these deviant testing behaviors in addition to more conventional data types. Given this context, this study demonstrates the application of a new method for multiple-group analysis that concurrently models item responses, response times, and visual fixation counts collected from an eye-tracker. It is hypothesized that differences in behavioral patterns between normally behaved test-takers and those who have different levels of preknowledge about the test items will manifest in latent characteristics of the different data types. A Bayesian estimation scheme is used to fit the proposed model to experimental data and the results are discussed.     

Relating Latent Change Score and Continuous Time Models

The primary goal of this article is to demonstrate the close relationship between 2 classes of dynamic models in psychological research: latent change score models and continuous time models. The secondary goal is to point out some differences. We begin with a brief review of both approaches, before demonstrating how the 2 methods are mathematically and conceptually related. It will be shown that most commonly used latent change score models are related to continuous time models by the difference equation approximation to the differential equation. One way in which the 2 approaches differ is the treatment of time. Whereas there are theoretical and practical restrictions regarding observation time points and intervals in latent change score models, no such limitations exist in continuous time models. We illustrate our arguments with three simulated data sets using a univariate and bivariate model with equal and unequal time intervals. As a by-product of this comparison, we discuss the use of phantom and definition variables to account for varying time intervals in latent change score models. We end with a reanalysis of the Bradway–McArdle longitudinal study on intellectual abilities (used before by McArdle & Hamagami, 2004) by means of the proportional change score model and the dual change score model in discrete and continuous time.     

A Bayesian Approach to Multilevel Structural Equation Modeling With Continuous and Dichotomous Outcomes

Multilevel Structural equation models are most often estimated from a frequentist framework via maximum likelihood. However, as shown in this article, frequentist results are not always accurate. Alternatively, one can apply a Bayesian approach using Markov chain Monte Carlo estimation methods. This simulation study compared estimation quality using Bayesian and frequentist approaches in the context of a multilevel latent covariate model. Continuous and dichotomous variables were examined because it is not yet known how different types of outcomes—most notably categorical—affect parameter recovery in this modeling context. Within the Bayesian estimation framework, the impact of diffuse, weakly informative, and informative prior distributions were compared. Findings indicated that Bayesian estimation may be used to overcome convergence problems and improve parameter estimate bias. Results highlight the differences in estimation quality between dichotomous and continuous variable models and the importance of prior distribution choice for cluster-level random effects.     

Analyzing Different Types of Moderated Method Effects in Confirmatory Factor Models for Structurally Different Methods

An extension of two confirmatory factor models for multitrait-multimethod measurement designs with structurally different methods to the analysis of latent interaction effects is presented: the nonlinear latent difference (NL-LD) model and the nonlinear correlated trait–correlated method-minus-one (NL-CTC[M – 1]) model. Both models are compared with regard to (a) the psychometric definition of the latent variables, (b) the capabilities of explaining latent method effects, and (c) the analysis of latent interaction effects. Using the latent moderated structural equation approach, we show how moderated method effects can be examined in the NL-CTC(M – 1) model. This fine-grained analysis of method effects is not feasible using the classical NL-LD model. We propose an extended version of the NL-LD model, which recovers the results of the NL-CTC(M – 1) model. The different versions of the nonlinear multimethod models are illustrated using real data from a multirater study. Finally, the advantages and challenges of incorporating latent interaction effects in complex CFA–MTMM models are discussed.     

Modeling Nonlinear Structural Equation Models: A Comparison of the Two-Stage Generalized Additive Models and the Finite Mixture Structural Equation Model

Researchers have devoted some time and effort to developing methods for fitting nonlinear relationships among latent variables. In particular, most of these have focused on correctly modeling interactions between 2 exogenous latent variables, and quadratic relationships between exogenous and endogenous variables. All of these approaches require prespecification of the nonlinearity by the researcher, and are limited to fairly simple nonlinear relationships. Other work has been done using mixture structural equation models (SEMM) in an attempt to fit more complex nonlinear relationships. This study expands on this earlier work by introducing the 2-stage generalized additive model (2SGAM) approach for fitting regression splines in the context of structural equation models. The model is first described and then investigated through the use of simulated data, in which it was compared with the SEMM approach. Results demonstrate that the 2SGAM is an effective tool for fitting a variety of nonlinear relationships between latent variables, and can be easily and accurately extended to models including multiple latent variables. Implications of these results are discussed.     

Inference on Two-Part Latent Variable Analysis Model With Multivariate Longitudinal Data

Semicontinuous variable analysis is a widely appreciated statistical method in such disciplines as social science, medicines, and economics. In detecting underlying structure and representing possible interrelationships, statistical analysis using a two-part model is appropriated. In this paper, we present a general extension of two-part model to the situation where the unobserved factors are included in the two parts to interpret external variability in semicontinuous variable. Auxiliary information on these factors is manifested by continuous responses via measurement model, while the interrelationships among factors are exploited through structural equation model. Moreover, under longitudinal setting, dynamic characteristics of responses between any two occasions are represented by transition model. Procedures for model fitting, parameter estimation, model selection and prediction are developed within the Bayesian paradigm. Markov Chains Monte Carlo method is used to implement posterior analysis. Empirical results including a simulation and a real example are used to illustrate the proposed methodology.     

An Evaluation of Latent Growth Models for Propensity Score Matched Groups

Because random assignment is not possible in observational studies, estimates of treatment effects might be biased due to selection on observable and unobservable variables. To strengthen causal inference in longitudinal observational studies of multiple treatments, we present 4 latent growth models for propensity score matched groups, and evaluate their performance with a Monte Carlo simulation study. We found that the 4 models performed similarly with respect to model fit, bias of parameter estimates, Type I error, and power to test the treatment effect. To demonstrate a multigroup latent growth model with dummy treatment indicators, we estimated the effect of students changing schools during elementary school years on their reading and mathematics achievement, using data from the Early Childhood Longitudinal Study Kindergarten Cohort.     

Bayesian Methods for Analyzing Structural Equation Models With Covariates,Interaction, and Quadratic Latent Variables

The analysis of interaction among latent variables has received much attention. This article introduces a Bayesian approach to analyze a general structural equation model that accommodates the general nonlinear terms of latent variables and covariates. This approach produces a Bayesian estimate that has the same statistical optimal properties as a maximum likelihood estimate. Other advantages over the traditional approaches are discussed. More important, we demonstrate through examples how to use the freely available software WinBUGS to obtain Bayesian results for estimation and model comparison. Simulation studies are conducted to assess the empirical performances of the approach for situations with various sample sizes and prior inputs.     

Mixture Simultaneous Factor Analysis for Capturing Differences in Latent Variables Between Higher Level Units of Multilevel Data

Given multivariate data, many research questions pertain to the covariance structure: whether and how the variables (e.g., personality measures) covary. Exploratory factor analysis (EFA) is often used to look for latent variables that might explain the covariances among variables; for example, the Big Five personality structure. In the case of multilevel data, one might wonder whether or not the same covariance (factor) structure holds for each so-called data block (containing data of 1 higher level unit). For instance, is the Big Five personality structure found in each country or do cross-cultural differences exist? The well-known multigroup EFA framework falls short in answering such questions, especially for numerous groups or blocks. We introduce mixture simultaneous factor analysis (MSFA), performing a mixture model clustering of data blocks, based on their factor structure. A simulation study shows excellent results with respect to parameter recovery and an empirical example is included to illustrate the value of MSFA.