A Note on the Use of Mixture Models for Individual Prediction

Mixture models capture heterogeneity in data by decomposing the population into latent subgroups, each of which is governed by its own subgroup-specific set of parameters. Despite the flexibility and widespread use of these models, most applications have focused solely on making inferences for whole or subpopulations, rather than individual cases. This article presents a general framework for computing marginal and conditional predicted values for individuals using mixture model results. These predicted values can be used to characterize covariate effects, examine the fit of the model for specific individuals, or forecast future observations from previous ones. Two empirical examples are provided to demonstrate the usefulness of individual predicted values in applications of mixture models. The first example examines the relative timing of initiation of substance use using a multiple event process survival mixture model, whereas the second example evaluates changes in depressive symptoms over adolescence using a growth mixture model.     

Fitting Structural Equation Model Trees and Latent Growth Curve Mixture Models in Longitudinal Designs: The Influence of Model Misspecification

When conducting longitudinal research, the investigation of between-individual differences in patterns of within-individual change can provide important insights. In this article, we use simulation methods to investigate the performance of a model-based exploratory data mining technique—structural equation model trees (SEM trees; Brandmaier, Oertzen, McArdle, & Lindenberger, 2013)—as a tool for detecting population heterogeneity. We use a latent-change score model as a data generation model and manipulate the precision of the information provided by a covariate about the true latent profile as well as other factors, including sample size, under the possible influences of model misspecifications. Simulation results show that, compared with latent growth curve mixture models, SEM trees might be very sensitive to model misspecification in estimating the number of classes. This can be attributed to the lower statistical power in identifying classes, resulting from smaller differences of parameters prescribed by the template model between classes.     

The GRoLTS-Checklist: Guidelines for Reporting on Latent Trajectory Studies

Estimating models within the mixture model framework, like latent growth mixture modeling (LGMM) or latent class growth analysis (LCGA), involves making various decisions throughout the estimation process. This has led to a wide variety in how results of latent trajectory analysis are reported. To overcome this issue, using a 4-round Delphi study, we developed Guidelines for Reporting on Latent Trajectory Studies (GRoLTS). The purpose of GRoLTS is to present criteria that should be included when reporting the results of latent trajectory analysis across research fields. We have gone through a systematic process to identify key components that, according to a panel of experts, are necessary when reporting results for trajectory studies. We applied GRoLTS to 38 papers where LGMM or LCGA was used to study trajectories of posttraumatic stress after a traumatic event.     

Basic books for a fraternity house library

The purpose of this article is to demonstrate how recent methodological developments in the analysis of individual growth can inform important problems in education policy. Specifically, this article focuses on a method referred to as growth mixture modeling. Growth mixture modeling is a relatively new procedure for the analysis of longitudinal data that relaxes many of the assumptions associated with conventional growth curve modeling. In particular, growth mixture modeling tests for the existence of unique growth trajectory classes through a combination of latent class analysis and standard growth curve modeling. Antecedent predictors of the latent classes can be incorporated as well as relations from the latent classes to specific outcomes. This article applies growth mixture modeling to data from the Early Childhood Longitudinal Study-Kindergarten class of 1998-1999. The specific policy question posed in this article focuses on the estimation of latent growth trajectory classes in reading proficiency and the effects of full-day or part-day kindergarten programs on growth within reading trajectory classes. Results identify a 3-class solution corresponding to slow-developing, normal-developing, and fast-developing reading growth in children. The results further show that full-day kindergarten attendance benefits children in the slow-reading development class relative to the normal and fast-reading development class, but the effect is lessened when holding constant socioeconomic status and age of entry into kindergarten. The implications of the method for quantitative education policy analysis are also discussed.     

Detecting Unobserved Heterogeneity in Latent Growth Curve Models

Growth mixture models combine latent growth curve models and finite mixture models to examine the existence of latent classes that follow distinct developmental patterns. Analyses based on these models are becoming quite common in social and behavioral science research because of recent advances in computing, the availability of specialized statistical programs, and the ease of programming. In this article, we show how mixture models can be fit to examine the presence of multiple latent classes by algorithmically grouping or clustering individuals who follow the same estimated growth trajectory based on an evaluation of individual case residuals. The approach is illustrated using empirical longitudinal data along with an easy to use computerized implementation.     

Item Response Theory Models for Performance Decline During Testing

Sometimes, test‐takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to consider such testing behaviors. In this study, a new class of mixture IRT models was developed to account for such testing behavior in dichotomous and polytomous items, by assuming test‐takers were composed of multiple latent classes and by adding a decrement parameter to each latent class to describe performance decline. Parameter recovery, effect of model misspecification, and robustness of the linearity assumption in performance decline were evaluated using simulations. It was found that the parameters in the new models were recovered fairly well by using the freeware WinBUGS; the failure to account for such behavior by fitting standard IRT models resulted in overestimation of difficulty parameters on items located toward the end of the test and overestimation of test reliability; and the linearity assumption in performance decline was rather robust. An empirical example is provided to illustrate the applications and the implications of the new class of models.     

Determining the Number of Latent Classes in Single- and Multiphase Growth Mixture Models

Stage-sequential (or multiphase) growth mixture models are useful for delineating potentially different growth processes across multiple phases over time and for determining whether latent subgroups exist within a population. These models are increasingly important as social behavioral scientists are interested in better understanding change processes across distinctively different phases, such as before and after an intervention. One of the less understood issues related to the use of growth mixture models is how to decide on the optimal number of latent classes. The performance of several traditionally used information criteria for determining the number of classes is examined through a Monte Carlo simulation study in single- and multiphase growth mixture models. For thorough examination, the simulation was carried out in 2 perspectives: the models and the factors. The simulation in terms of the models was carried out to see the overall performance of the information criteria within and across the models, whereas the simulation in terms of the factors was carried out to see the effect of each simulation factor on the performance of the information criteria holding the other factors constant. The findings not only support that sample size adjusted Bayesian Information Criterion would be a good choice under more realistic conditions, such as low class separation, smaller sample size, or missing data, but also increase understanding of the performance of information criteria in single- and multiphase growth mixture models.     

Performance of Factor Mixture Models as a Function of Model Size,Covariate Effects,and Class-Specific Parameters

Abstract

Factor mixture models are designed for the analysis of multivariate data obtained from a population consisting of distinct latent classes. A common factor model is assumed to hold within each of the latent classes. Factor mixture modeling involves obtaining estimates of the model parameters, and may also be used to assign subjects to their most likely latent class. This simulation study investigates aspects of model performance such as parameter coverage and correct class membership assignment and focuses on covariate effects, model size, and class-specific versus class-invariant parameters. When fitting true models, parameter coverage is good for most parameters even for the smallest class separation investigated in this study (0.5 SD between 2 classes). The same holds for convergence rates. Correct class assignment is unsatisfactory for the small class separation without covariates, but improves dramatically with increasing separation, covariate effects, or both. Model performance is not influenced by the differences in model size investigated here. Class-specific parameters may improve some aspects of model performance but negatively affect other aspects.     

Longitudinal Models for Ordinal Data With Many Zeros and Varying Numbers of Response Categories

Ordinal response scales are often used to survey behaviors, including data collected in longitudinal studies. Advanced analytic methods are now widely available for longitudinal data. This study evaluates the performance of 4 methods as applied to ordinal measures that differ by the number of response categories and that include many zeros. The methods considered are hierarchical linear models (HLMs), growth mixture mixed models (GMMMs), latent class growth analysis (LCGA), and 2-part latent growth models (2PLGMs). The methods are evaluated by applying each to empirical response data in which the number of response categories is varied. The methods are applied to each outcome variable, first treating the outcome as continuous and then as ordinal, to compare the performance of the methods given both a different number of response categories and treatment of the variables as continuous versus ordinal. We conclude that although the 2PLGM might be preferred, no method might be ideal.     

The Effect of Scale Referent on Tests of Mean Structure Parameters

Structured means analysis is a very useful approach for testing hypotheses about population means on latent constructs. In such models, a z test is most commonly used for testing the statistical significance of the relevant parameter estimates or of the differences between parameter estimates, where a z value is computed based on the asymptotic standard error estimate associated with the parameter of interest. In the current article, a series of population analyses demonstrate that the z tests for latent mean structure parameters or, more directly, the standard error estimates upon which those z tests are based are, not invariant to how factors are scaled. As such, circumstances exist in which latent mean inference is compromised solely as a result of scaling decisions. This problem is illustrated in the context of between-subjects (i.e., multisample) latent means models and within-subjects latent means models. Recommendations for practice are also offered.     

A Second-Order Conditionally Linear Mixed Effects Model With Observed and Latent Variable Covariates

A conditionally linear mixed effects model is an appropriate framework for investigating nonlinear change in a continuous latent variable that is repeatedly measured over time. The efficacy of the model is that it allows parameters that enter the specified nonlinear time-response function to be stochastic, whereas those parameters that enter in a nonlinear manner are common to all subjects. In this article we describe how a variant of the Michaelis–Menten (M–M) function can be fit within this modeling framework using Mplus 6.0. We demonstrate how observed and latent covariates can be incorporated to help explain individual differences in growth characteristics. Features of the model including an explication of key analytic decision points are illustrated using longitudinal reading data. To aid in making this class of models accessible, annotated Mplus code is provided.     

Obtaining Diagnostic Classification Model Estimates Using Mplus

Diagnostic classification models (aka cognitive or skills diagnosis models) have shown great promise for evaluating mastery on a multidimensional profile of skills as assessed through examinee responses, but continued development and application of these models has been hindered by a lack of readily available software. In this article we demonstrate how diagnostic classification models may be estimated as confirmatory latent class models using Mplus, thus bridging the gap between the technical presentation of these models and their practical use for assessment in research and applied settings. Using a sample English test of three grammatical skills, we describe how diagnostic classification models can be phrased as latent class models within Mplus and how to obtain the syntax and output needed for estimation and interpretation of the model parameters. We also have written a freely available SAS program that can be used to automatically generate the Mplus syntax. We hope this work will ultimately result in greater access to diagnostic classification models throughout the testing community, from researchers to practitioners.     

Exploratory Structural Equation Modeling

This article examines the problem of specification error in 2 models for categorical latent variables; the latent class model and the latent Markov model. Specification error in the latent class model focuses on the impact of incorrectly specifying the number of latent classes of the categorical latent variable on measures of model adequacy as well as sample reallocation to latent classes. The results show that the clarity of remaining latent classes, as measured by the entropy statistic depends on the number of observations in the omitted latent class—but this statistic is not reliable. Specification error in the latent Markov model focuses on the transition probabilities when a longitudinal Guttman process is incorrectly specified. The findings show that specifying a longitudinal Guttman process that is not true in the population impacts other transition probabilities through the covariance matrix of the logit parameters used to calculate those probabilities.     

A Mixture Group Bifactor Model for Binary Responses

The presence of nuisance dimensionality is a potential threat to the accuracy of results for tests calibrated using a measurement model such as a factor analytic model or an item response theory model. This article describes a mixture group bifactor model to account for the nuisance dimensionality due to a testlet structure as well as the dimensionality due to differences in patterns of responses. The model can be used for testing whether or not an item functions differently across latent groups in addition to investigating the differential effect of local dependency among items within a testlet. An example is presented comparing test speededness results from a conventional factor mixture model, which ignores the testlet structure, with results from the mixture group bifactor model. Results suggested the 2 models treated the data somewhat differently. Analysis of the item response patterns indicated that the 2-class mixture bifactor model tended to categorize omissions as indicating speededness. With the mixture group bifactor model, more local dependency was present in the speeded than in the nonspeeded class. Evidence from a simulation study indicated the Bayesian estimation method used in this study for the mixture group bifactor model can successfully recover generated model parameters for 1- to 3-group models for tests containing testlets.     

Nonlinear Growth Mixture Models With Fractional Polynomials: An Illustration With Early Childhood Mathematics Ability

Applications of growth mixture modeling have become widespread in the fields of medicine, public health, and the social sciences for modeling linear and nonlinear patterns of change in longitudinal data with presumed heterogeneity with respect to latent group membership. However, in contrast to linear approaches, there has been relatively less focus on methods for modeling nonlinear change. We introduce a nonlinear mixture modeling approach for estimating change trajectories that rely on the use of fractional polynomials within a growth mixture modeling framework. Fractional polynomials allow for more parsimonious and flexible models in comparison to conventional polynomial models. The procedures are illustrated through the use of math ability scores obtained from 499 children over a period of 3 years, with 4 measurement occasions. Techniques for identifying the best empirically derived growth mixture model solution are also described and illustrated by way of substantive example and a simulation.     

Predictions of Individual Change Recovered With Latent Class or Random Coefficient Growth Models

Popular longitudinal models allow for prediction of growth trajectories in alternative ways. In latent class growth models (LCGMs), person-level covariates predict membership in discrete latent classes that each holistically define an entire trajectory of change (e.g., a high-stable class vs. late-onset class vs. moderate-desisting class). In random coefficient growth models (RCGMs, also known as latent curve models), however, person-level covariates separately predict continuously distributed latent growth factors (e.g., an intercept vs. slope factor). This article first explains how complex and nonlinear interactions between predictors and time are recovered in different ways via LCGM versus RCGM specifications. Then a simulation comparison illustrates that, aside from some modest efficiency differences, such predictor relationships can be recovered approximately equally well by either model—regardless of which model generated the data. Our results also provide an empirical rationale for integrating findings about prediction of individual change across LCGMs and RCGMs in practice.     

Bayesian Analysis of Mixture Structural Equation Models With an Unknown Number of Components

Multivariate heterogenous data with latent variables are common in many fields such as biological, medical, behavioral, and social-psychological sciences. Mixture structural equation models are multivariate techniques used to examine heterogeneous interrelationships among latent variables. In the analysis of mixture models, determination of the number of mixture components is always an important and challenging issue. This article aims to develop a full Bayesian approach with the use of reversible jump Markov chain Monte Carlo method to analyze mixture structural equation models with an unknown number of components. The proposed procedure can simultaneously and efficiently select the number of mixture components and conduct parameter estimation. Simulation studies show the satisfactory empirical performance of the method. The proposed method is applied to study risk factors of osteoporotic fractures in older people.     

On the Estimation of Nonlinear Mixed-Effects Models and Latent Curve Models for Longitudinal Data

Nonlinear models are effective tools for the analysis of longitudinal data. These models provide a flexible means for describing data that follow complex forms of change. Exponential and logistic functions that include a parameter to represent an asymptote, for instance, are useful for describing responses that tend to level off with time. There are forms of nonlinear latent curve models and nonlinear mixed-effects model that are equivalent, and so given the same set of data, growth function, distributional assumptions, and method of estimation, the 2 models yield equivalent results. There are also forms that are strikingly different and can yield different interpretations for a given set of data. This article discusses cases in which nonlinear mixed-effects models and nonlinear latent curve models are equivalent and those in which they are different and clarifies the estimation needs of the different models. Examples based on empirical data help to illustrate these points.     

The Impact of Ignoring Time Series Processes in Linear Growth Mixture Modeling

Growth mixture modeling (GMM) is a useful statistical method for longitudinal studies because it includes features of both latent growth modeling (LGM) and finite mixture modeling. This Monte Carlo simulation study explored the impact of ignoring 3 types of time series processes (i.e., AR(1), MA(1), and ARMA(1,1)) in GMM and manipulated the separation of the latent classes, the strength of the time series process, and whether the errors conformed to the time series process in 1 or 2 latent classes. The results showed that omitting time series processes resulted in more serious bias in parameter estimation as the distance between classes increased. However, when the class distances were small, ignoring time series processes contributed to the selection of the correct number of classes. When the GMM models correctly specified the time series process, only models with an AR(1) time series process produced unbiased parameter estimates in most conditions. It was also found that among design factors manipulated, the distance between classes prominently affected the identification of the number of classes and parameter estimation.     

A New Perspective on the Effects of Covariates in Mixture Models

In this simulation study, we explored the effect of introducing covariates to a growth mixture model when covariates were also generated by a mixture model. We varied the association between the latent classes underlying the growth trajectories and the covariates, the degree of separation between the latent classes underlying the covariates, the number of covariates included, and amount of missing data in the growth data. We found that adding covariates to the growth mixture model generally hurt class recovery except where the latent classes underlying the growth trajectories and the covariates were the same or very strongly associated, and there was a large degree of separation between the classes underlying the covariates. We found that when covariates were introduced, entropy might no longer be an accurate indicator of the distinctiveness of the growth trajectory classes.