Assessment criteria for competency-based education: a study in nursing education

This study examined the effects of type of assessment criteria (performance-based vs. competency-based), the relevance of assessment criteria (relevant criteria vs. all criteria), and their interaction on secondary vocational education students’ performance and assessment skills. Students on three programmes in the domain of nursing and care (N = 93) participated in the study. Results show that students who were given the relevant criteria made more accurate assessments of an expert model, performed better on a test and achieved higher instructional efficiency (defined as the relationship between performance and mental effort) compared to students who were given all criteria. Students who were given performance-based assessment criteria made more accurate assessments of an expert model and scored higher on task performance during practice compared to students who were given competency-based assessment criteria. They invested less mental effort in the assessments, resulting in higher instructional efficiency. An interaction effect for the concreteness of answers shows that the combination of performance-based and relevant criteria leads to superior analysis of worked examples compared to the other combinations of criteria.     

Training for reflective expertise: A four-component instructional design model for complex cognitive skills

This article presents a four-component instructional design model for the training of complex cognitive skills. In the analysis phase, the skill is decomposed into a set of recurrent skills that remain consistent over problem situations and a set of nonrecurrent skills that require variable performance over situations. In the design phase, two components relate to the design of practice; they pertain to the conditions under which practice leads either to rule automation during the performance of recurrent skills or to schema acquisition during the performance of nonrecurrent skills. The other two components relate to the design of information presentation; they pertain to the presentation of information that supports the performance of either recurrent or nonrecurrent skills. The basic prediction of the model is that its application leads to “reflective expertise” and increased performance on transfer tasks. Applications of the model that support this prediction are briefly discussed for the training of fault management in process industry, computer programming, and statistical analysis.     

Relating Latent Class Membership to Continuous Distal Outcomes: Improving the LTB Approach and a Modified Three-Step Implementation

Latent class analysis often aims to relate the classes to continuous external consequences (“distal outcomes”), but estimating such relationships necessitates distributional assumptions. Lanza, Tan, and Bray (2013) suggested circumventing such assumptions with their LTB approach: Linear logistic regression of latent class membership on each distal outcome is first used, after which this estimated relationship is reversed using Bayes’ rule. However, the LTB approach currently has 3 drawbacks, which we address in this article. First, LTB interchanges the assumption of normality for one of homoskedasticity, or, equivalently, of linearity of the logistic regression, leading to bias. Fortunately, we show introducing higher order terms prevents this bias. Second, we improve coverage rates by replacing approximate standard errors with resampling methods. Finally, we introduce a bias-corrected 3-step version of LTB as a practical alternative to standard LTB. The improved LTB methods are validated by a simulation study, and an example application demonstrates their usefulness.     

Institutional Diversity in Higher Education: a Cross-National and Longitudinal Analysis

This paper contributes to the debate on institutional diversity in higher education systems by looking at the phenomenon from a comparative (cross‐national) and longitudinal perspective. Despite the attention to diversity in policy debates, surprisingly, only a limited amount of studies address methodological issues. In addition, the number of empirical studies on institutional diversity is low as well. Data on various Western higher education systems are used to illustrate developments in systems' diversity. Furthermore, these data are put in the context of current national (and supranational) policy debates, particularly the role of governments and markets, on maintaining or increasing diversity.     

Process-Oriented Worked Examples: Improving Transfer Performance Through Enhanced Understanding

The research on worked examples has shown thatfor novices, studying worked examples is oftena more effective and efficient way of learningthan solving conventional problems. Thistheoretical paper argues that addingprocess-oriented information to worked examplescan further enhance transfer performance,especially for complex cognitive skills withmultiple possible solution paths.Process-oriented information refers to theprincipled (``why'') and strategic (``how'')information that experts use when solvingproblems. From a cognitive load perspective,studying the expert's ``why'' and ``how''information can be seen as constituting agermane cognitive load, which can fosterstudents' understanding of the principles of adomain and the rationale behind the selectedoperators, and their knowledge about howexperts select a strategy, respectively. Issueswith regard to the design, implementation, andassessment of effects of process-orientedworked examples are discussed, as well as thequestions they raise for future research.     

Walking the tightrope with an e-portfolio: imbalance between support and autonomy hampers self-directed learning

Teacher coaching is essential to support self-directed learning, but requires a lot of time and energy. This mixed-methods study investigated the effects of using an e-portfolio with a self-coaching protocol and limited teacher coaching on the development of self-directed learning skills and motivation. With regard to self-directed learning, students’ overestimation of performance on learning tasks grew over time, while their ability to formulate points for improvement did not change significantly. With regard to motivation, students’ controlled (i.e. largely extrinsic) motivation increased while their autonomous (i.e. largely intrinsic) motivation decreased. Thematic analysis of interviews demonstrated students needed more support and feedback from their teacher. The use of suboptimal cues for performance assessment and an imperfect balance between autonomy and support hampered self-directed learning and motivation. We recommend providing just-in-time feedback about performance on learning tasks and giving students some autonomy over the choice of learning tasks, to enhance reflection and motivation.     

Updating Latent Class Imputations with External Auxiliary Variables

Latent class models are often used to assign values to categorical variables that cannot be measured directly. This “imputed” latent variable is then used in further analyses with auxiliary variables. The relationship between the imputed latent variable and auxiliary variables can only be correctly estimated if these auxiliary variables are included in the latent class model. Otherwise, point estimates will be biased. We develop a method that correctly estimates the relationship between an imputed latent variable and external auxiliary variables, by updating the latent variable imputations to be conditional on the external auxiliary variables using a combination of multiple imputation of latent classes and the so-called three-step approach. In contrast with existing “one-step” and “three-step” approaches, our method allows the resulting imputations to be analyzed using the familiar methods favored by substantive researchers.     

`Alternative' Universities Revisited: A Study of the Distinctiveness of Universities Established in the Spirit of 1968

In the late 60s and early 70s,several universities were set up in variousEuropean countries with the intention ofproviding an alternative to establishedinstitutions of higher education. The newuniversities were expected, amongst otherthings, to experiment with new forms ofleadership and management internally, giveteaching and learning higher priority, and tobe regional relevant institutions for the areain which they were located. The paper analysesto what extent three such universityestablishments: Aalborg University in Denmark,Maastricht University in the Netherlands andTromsø University in Norway have managed tomaintain and develop their alternative profileduring the last thirty years. The studysuggests that even though the universities insome areas have adapted to environmentalpressure, they have managed to keep theirprofile as innovative and alternative.