Simulating the Use of Disclosed Items in Computerized Adaptive Testing

Regular use of questions previously made available to the public (i.e., disclosed items) may provide one way to meet the requirement for large numbers of questions in a continuous testing environment, that is, an environment in which testing is offered at test taker convenience throughout the year rather than on a few prespecified test dates. First it must be shown that such use has effects on test scores small enough to be acceptable. In this study simulations are used to explore the use of disclosed items under a worst-case scenario which assumes that disclosed items are always answered correctly. Some item pool and test designs were identified in which the use of disclosed items produces effects on test scores that may be viewed as negligible.     

Constructs of writing proficiency in US state and national writing assessments: Exploring variability

Persistent gaps between optimistic state and pessimistic national academic performance assessment results are increasingly leading to calls for unified national standards in the US. Critics argue that these gaps reveal vast differences in how proficiency is conceptualized; however, little is known about how conceptualizations compare among large-scale US assessments. To explore this issue, the present study investigated constructs of writing proficiency implicated in 41 US state and national high school direct writing assessments by analyzing the relationships between prompt-genre demands and assessment scoring criteria. Results of this analysis suggest that national writing assessments differ as a group from state assessments in the extent to which they emphasize genre distinctions and present coherent conceptualizations of writing proficiency. The implications of these assessment variations for college preparedness are discussed.     

The Networked University: The structure,culture, and policy of universities in a changing environment

Tertiary Education and Management - The universities in Europe are finding themselves in a turbulent environment. They are exposed to global and European developments. This article links changes in...     

Exploring cultural differences in critical thinking: Is it about my thinking style or the language I speak?

Critical thinking is deemed as an ideal in academic settings, but cultural differences in critical thinking performance between Asian and Western students have been reported in the international education literature. We examined explanations for the observed differences in critical thinking between Asian and New Zealand (NZ) European students, and tested hypotheses derived from research in international education and cultural psychology. The results showed that NZ European students performed better on two objective measures of critical thinking skills than Asian students. English proficiency, but not dialectical thinking style, could at least partially if not fully explain these differences. This finding holds with both self-report (Study 1) and objectively measured (Study 2a) English proficiency. The results also indicated that Asian students tended to rely more on dialectical thinking to solve critical thinking problems than their Western counterparts. In a follow-up data analysis, students' critical thinking was found to predict their academic performance after controlling for the effects of English proficiency and general intellectual ability, but the relationship does not vary as a function of students' cultural backgrounds or cultural adoption (Study 2b). Altogether, these findings contribute to our understanding of the influence of culture on critical thinking in international education.