Effect Analysis Using Nonlinear Structural Equation Mixture Modeling

In this article, we present an approach for comprehensive analysis of the effectiveness of interventions based on nonlinear structural equation mixture models (NSEMM). We provide definitions of average and conditional effects and show how they can be computed. We extend the traditional moderated regression approach to include latent continous and discrete (mixture) variables as well as their higher order interactions, quadratic or more general nonlinear relationships. This new approach can be considered a combination of the recently proposed EffectLiteR approach and the NSEMM approach. A key advantage of this synthesis is that it gives applied researchers the opportunity to gain greater insight into the effectiveness of the intervention. For example, it makes it possible to consider structural equation models for situations where the treatment is noneffective for extreme values of a latent covariate but is effective for medium values, as we illustrate using an example from the educational sciences.     

A Nonlinear Structural Equation Mixture Modeling Approach for Nonnormally Distributed Latent Predictor Variables

Structural equation models with interaction and quadratic effects have become a standard tool for testing nonlinear hypotheses in the social sciences. Most of the current approaches assume normally distributed latent predictor variables. In this article, we describe a nonlinear structural equation mixture approach that integrates the strength of parametric approaches (specification of the nonlinear functional relationship) and the flexibility of semiparametric structural equation mixture approaches for approximating the nonnormality of latent predictor variables. In a comparative simulation study, the advantages of the proposed mixture procedure over contemporary approaches [Latent Moderated Structural Equations approach (LMS) and the extended unconstrained approach] are shown for varying degrees of skewness of the latent predictor variables. Whereas the conventional approaches show either biased parameter estimates or standard errors of the nonlinear effects, the proposed mixture approach provides unbiased estimates and standard errors. We present an empirical example from educational research. Guidelines for applications of the approaches and limitations are discussed.     

Estimation of Time-Unstructured Nonlinear Mixed-Effects Mixture Models

Change over time often takes on a nonlinear form. Furthermore, change patterns can be characterized by heterogeneity due to unobserved subpopulations. Nonlinear mixed-effects mixture models provide one way of addressing both of these issues. This study attempts to extend these models to accommodate time-unstructured data. We develop methods to fit these models in both the structural equation modeling framework as well as the Bayesian framework and evaluate their performance. Simulations show that the success of these methods is driven by the separation between latent classes. When classes are well separated, a sample of 200 is sufficient. Otherwise, a sample of 1,000 or more is required before parameters can be accurately recovered. Ignoring individually varying measurement occasions can also lead to substantial bias, particularly in the random-effects parameters. Finally, we demonstrate the application of these techniques to a data set involving the development of reading ability in children.     

A Multidimensional Finite Mixture Structural Equation Model for Nonignorable Missing Responses to Test Items

We propose a structural equation model, which reduces to a multidimensional latent class item response theory model, for the analysis of binary item responses with nonignorable missingness. The missingness mechanism is driven by 2 sets of latent variables: one describing the propensity to respond and the other referred to the abilities measured by the test items. These latent variables are assumed to have a discrete distribution, so as to reduce the number of parametric assumptions regarding the latent structure of the model. Individual covariates can also be included through a multinomial logistic parameterization for the distribution of the latent variables. Given the discrete nature of this distribution, the proposed model is efficiently estimated by the expectation–maximization algorithm. A simulation study is performed to evaluate the finite-sample properties of the parameter estimates. Moreover, an application is illustrated with data coming from a student entry test for the admission to some university courses.     

Detecting Mixtures From Structural Model Differences Using Latent Variable Mixture Modeling: A Comparison of Relative Model Fit Statistics

The accuracy of structural model parameter estimates in latent variable mixture modeling was explored with a 3 (sample size) × 3 (exogenous latent mean difference) × 3 (endogenous latent mean difference) × 3 (correlation between factors) × 3 (mixture proportions) factorial design. In addition, the efficacy of several likelihood-based statistics (Akaike's Information Criterion [AIC], Bayesian Information Ctriterion [BIC], the sample-size adjusted BIC [ssBIC], the consistent AIC [CAIC], the Vuong-Lo-Mendell-Rubin adjusted likelihood ratio test [aVLMR]), classification-based statistics (CLC [classification likelihood information criterion], ICL-BIC [integrated classification likelihood], normalized entropy criterion [NEC], entropy), and distributional statistics (multivariate skew and kurtosis test) were examined to determine which statistics best recover the correct number of components. Results indicate that the structural parameters were recovered, but the model fit statistics were not exceedingly accurate. The ssBIC statistic was the most accurate statistic, and the CLC, ICL-BIC, and aVLMR showed limited utility. However, none of these statistics were accurate for small samples (n = 500).     

Modeling Predictors of Latent Classes in Regression Mixture Models

The purpose of this study is to provide guidance on a process for including latent class predictors in regression mixture models. We first examine the performance of current practice for using the 1-step and 3-step approaches where the direct covariate effect on the outcome is omitted. None of the approaches show adequate estimates of model parameters. Given that Step 1 of the 3-step approach shows adequate results in class enumeration, we suggest using an alternative approach: (a) decide the number of latent classes without predictors of latent classes, and (b) bring the latent class predictors into the model with the inclusion of hypothesized direct covariate effects. Our simulations show that this approach leads to good estimates for all model parameters. The proposed approach is demonstrated by using empirical data to examine the differential effects of family resources on students’ academic achievement outcome. Implications of the study are discussed.     

Fitting Structural Equation Model Trees and Latent Growth Curve Mixture Models in Longitudinal Designs: The Influence of Model Misspecification

When conducting longitudinal research, the investigation of between-individual differences in patterns of within-individual change can provide important insights. In this article, we use simulation methods to investigate the performance of a model-based exploratory data mining technique—structural equation model trees (SEM trees; Brandmaier, Oertzen, McArdle, & Lindenberger, 2013)—as a tool for detecting population heterogeneity. We use a latent-change score model as a data generation model and manipulate the precision of the information provided by a covariate about the true latent profile as well as other factors, including sample size, under the possible influences of model misspecifications. Simulation results show that, compared with latent growth curve mixture models, SEM trees might be very sensitive to model misspecification in estimating the number of classes. This can be attributed to the lower statistical power in identifying classes, resulting from smaller differences of parameters prescribed by the template model between classes.     

Structural Equation Models and Mixture Models With Continuous Nonnormal Skewed Distributions

In this article we describe a structural equation modeling (SEM) framework that allows nonnormal skewed distributions for the continuous observed and latent variables. This framework is based on the multivariate restricted skew t distribution. We demonstrate the advantages of skewed SEM over standard SEM modeling and challenge the notion that structural equation models should be based only on sample means and covariances. The skewed continuous distributions are also very useful in finite mixture modeling as they prevent the formation of spurious classes formed purely to compensate for deviations in the distributions from the standard bell curve distribution. This framework is implemented in Mplus Version 7.2.     

A New Perspective on the Effects of Covariates in Mixture Models

In this simulation study, we explored the effect of introducing covariates to a growth mixture model when covariates were also generated by a mixture model. We varied the association between the latent classes underlying the growth trajectories and the covariates, the degree of separation between the latent classes underlying the covariates, the number of covariates included, and amount of missing data in the growth data. We found that adding covariates to the growth mixture model generally hurt class recovery except where the latent classes underlying the growth trajectories and the covariates were the same or very strongly associated, and there was a large degree of separation between the classes underlying the covariates. We found that when covariates were introduced, entropy might no longer be an accurate indicator of the distinctiveness of the growth trajectory classes.     

On the Performance of Likelihood-Based Difference Tests in Nonlinear Structural Equation Models

This article investigates likelihood-based difference statistics for testing nonlinear effects in structural equation modeling using the latent moderated structural equations (LMS) approach. In addition to the standard difference statistic T_D, 2 robust statistics have been developed in the literature to ensure valid results under the conditions of nonnormality or small sample sizes: the robust T_DR and the “strictly positive” T_DRP. These robust statistics have not been examined in combination with LMS yet. In 2 Monte Carlo studies we investigate the performance of these methods for testing quadratic or interaction effects subject to different sources of nonnormality, nonnormality due to the nonlinear terms, and nonnormality due to the distribution of the predictor variables. The results indicate that T_D is preferable to both T_DR and T_DRP. Under the condition of strong nonlinear effects and nonnormal predictors, T_DR often produced negative differences and T_DRP showed no desirable power.     

Fitting Unstructured Finite Mixture Models in Longitudinal Design: A Recommendation for Model Selection and Estimation of the Number of Classes

In longitudinal design, investigating interindividual differences of intraindividual changes enables researchers to better understand the potential variety of development and growth. Although latent growth curve mixture models have been widely used, unstructured finite mixture models (uFMMs) are also useful as a preliminary tool and are expected to be more robust in identifying classes under the influence of possible model misspecifications, which are very common in actual practice. In this study, large-scale simulations were performed in which various normal uFMMs and nonnormal uFMMs were fit to evaluate their utility and the performance of each model selection procedure for estimating the number of classes in longitudinal designs. Results show that normal uFMMs assuming invariance of variance–covariance structures among classes perform better on average. Among model selection procedures, the Calinski–Harabasz statistic, which has a nonparametric nature, performed better on average than information criteria, including the Bayesian information criterion.     

Revisiting the Model Size Effect in Structural Equation Modeling

Fitting a large structural equation modeling (SEM) model with moderate to small sample sizes results in an inflated Type I error rate for the likelihood ratio test statistic under the chi-square reference distribution, known as the model size effect. In this article, we show that the number of observed variables (p) and the number of free parameters (q) have unique effects on the Type I error rate of the likelihood ratio test statistic. In addition, the effects of p and q cannot be fully explained using degrees of freedom (df). We also evaluated the performance of 4 correctional methods for the model size effect, including Bartlett’s (1950), Swain’s (1975), and Yuan’s (2005) corrected statistics, and Yuan, Tian, and Yanagihara’s (2015) empirically corrected statistic. We found that Yuan et al.’s (2015) empirically corrected statistic generally yields the best performance in controlling the Type I error rate when fitting large SEM models.     

Models and Strategies for Factor Mixture Analysis: An Example Concerning the Structure Underlying Psychological Disorders

The factor mixture model (FMM) uses a hybrid of both categorical and continuous latent variables. The FMM is a good model for the underlying structure of psychopathology because the use of both categorical and continuous latent variables allows the structure to be simultaneously categorical and dimensional. This is useful because both diagnostic class membership and the range of severity within and across diagnostic classes can be modeled concurrently. Although the conceptualization of the FMM has been explained in the literature, the use of the FMM is still not prevalent. One reason is that there is little research about how such models should be applied in practice and, once a well-fitting model is obtained, how it should be interpreted. In this article, the FMM is explored by studying a real data example on conduct disorder. By exploring this example, this article aims to explain the different formulations of the FMM, the various steps in building a FMM, and how to decide between an FMM and alternative models.     

A Structural Equation Modeling Evaluation of the General Model of Instructional Communication

The General Model of Instructional Communication introduced by McCroskey, Valencic, and Richmond (2004) is supported in its original conception by canonical data. This study, however, uses structural equation modeling (SEM) to provide a more detailed analysis. Although the model as originally hypothesized fits the data poorly, analysis of the SEM results suggests adjustments to the original model that substantially improve the model's fit. The revised model accounts for significant portions of the variance in the outcome variables, provides a more detailed explanation of the relationships involved, and has implications for future research. Bootstrapped parameter estimates suggest that the results are replicable.     

Generalized Nonlinear Irreducible Auto-Correlation and Its Applications in Nonlinear Prediction Models Identification

There is still an obstacle to prevent neural network from wider and more effective applications, i.e. , the lack of effective theories of models identification. Based on information theory and its generalization, this paper introduces a universal method to achieve nonlinear models identification. Two key quantities, which are called nonlinear irreducible auto-correlation (NIAC) and generalized nonlinear irreducible auto-correlation (GNIAC), are defined and discussed. NIAC and GNIAC correspond with intrinstic irreducible auto-dependency (IAD) and generalized irreducible autodependency (GLAD) of time series respectively. By investigating the evolving trend of NIAL; and GNIAC, the optimal auto-regressive order of nonlinear auto-regressive models could be determined naturally, Subsequently, an efficient algorithm computing NIAC and GNIAC is discussed. Experiments on simulating data sets and typical nonlinear prediction models indicate remarkable correlation between optimal auto-regressive order and the highest order that NIAC-GNIAC have a remarkable non-zero value, therefore demonstrate the validity of the proposal in this paper.     

正态广义非线性模型参数置信域的曲率表示

本文从几何观点研究正态广义非线性模型参数和子集参数的置信域的曲率表示,由于本文研究的非线性模型中随机误差的协方差阵可以是正定和非负定的,因此,有关结论推广与发展了现有文献中的许多结论。     

A Nonlinear Dynamic Latent Class Structural Equation Model

In this article, we propose a nonlinear dynamic latent class structural equation modeling (NDLC-SEM). It can be used to examine intra-individual processes of observed or latent variables. These processes are decomposed into parts which include individual- and time-specific components. Unobserved heterogeneity of the intra-individual processes are modeled via a latent Markov process that can be predicted by individual- and time-specific variables as random effects. We discuss examples of sub-models which are special cases of the more general NDLC-SEM framework. Furthermore, we provide empirical examples and illustrate how to estimate this model in a Bayesian framework. Finally, we discuss essential properties of the proposed framework, give recommendations for applications, and highlight some general problems in the estimation of parameters in comprehensive frameworks for intensive longitudinal data.     

Bayesian Analysis of Mixture Structural Equation Models With an Unknown Number of Components

Multivariate heterogenous data with latent variables are common in many fields such as biological, medical, behavioral, and social-psychological sciences. Mixture structural equation models are multivariate techniques used to examine heterogeneous interrelationships among latent variables. In the analysis of mixture models, determination of the number of mixture components is always an important and challenging issue. This article aims to develop a full Bayesian approach with the use of reversible jump Markov chain Monte Carlo method to analyze mixture structural equation models with an unknown number of components. The proposed procedure can simultaneously and efficiently select the number of mixture components and conduct parameter estimation. Simulation studies show the satisfactory empirical performance of the method. The proposed method is applied to study risk factors of osteoporotic fractures in older people.     

A Comparison of Label Switching Algorithms in the Context of Growth Mixture Models

Simulation studies involving mixture models inevitably aggregate parameter estimates and other output across numerous replications. A primary issue that arises in these methodological investigations is label switching. The current study compares several label switching corrections that are commonly used when dealing with mixture models. A growth mixture model is used in this simulation study, and the design crosses three manipulated variables—number of latent classes, latent class probabilities, and class separation, yielding a total of 18 conditions. Within each of these conditions, the accuracy of a priori identifiability constraints, a priori training of the algorithm, and four post hoc algorithms developed by Tueller et al.; Cho; Stephens; and Rodriguez and Walker are tested to determine their classification accuracy. Findings reveal that, of all a priori methods, training of the algorithm leads to the most accurate classification under all conditions. In a case where an a priori algorithm is not selected, Rodriguez and Walker’s algorithm is an excellent choice if interested specifically in aggregating class output without consideration as to whether the classes are accurately ordered. Using any of the post hoc algorithms tested yields improvement over baseline accuracy and is most effective under two-class models when class separation is high. This study found that if the class constraint algorithm was used a priori, it should be combined with a post hoc algorithm for accurate classification.     

Model Comparison of Bayesian Semiparametric and Parametric Structural Equation Models

Structural equation models have wide applications. One of the most important issues in analyzing structural equation models is model comparison. This article proposes a Bayesian model comparison statistic, namely the L _ν-measure for both semiparametric and parametric structural equation models. For illustration purposes, we consider a Bayesian semiparametric approach for estimation and model comparison in the context of structural equation models with fixed covariates. A finite dimensional Dirichlet process is used to model the crucial latent variables, and a blocked Gibbs sampler is implemented for estimation. Empirical performance of the L _ν-measure is evaluated through a simulation study. Results obtained indicate that the L _ν-measure, which additionally requires very minor computational effort, gives satisfactory performance. Moreover, the methodologies are demonstrated through an example with a real data set on kidney disease. Finally, the application of the L _ν-measure to Bayesian semiparametric nonlinear structural equation models is outlined.