The problem of semantic openness and constructed response

During the last three decades the constructed response format has gradually gained entry in large‐scale assessments of reading‐comprehension. In their 1991 Reading Literacy Study The International Association for the Evaluation of Educational Achievement (IEA) included constructed response items on an exploratory basis. Ten years later, in Progress in International Reading Literacy Study (PIRLS) 2001, the constructed response format is ascribed special significance as bearer of central insights to the definition of reading literacy. This article focuses on the significance of the scoring guides and the relation between these guides on the one hand, and the text and the items on the other hand. A discussion of this relation as it is to be found in PIRLS 2001 is performed, showing both examples of success and more problematic aspects in the operationalisation of the intentions expressed in the theoretical framework for the test. Handling the problem of semantic openness is essential in representing depth of understanding and represents a field of possibilities for further research and development.     

Adolescent Civic and Political Engagement: Associations Between Domain-Specific Judgments and Behavior

Judgments and justifications for different forms of civic involvement and their associations with organized and civic behavior were examined in 312 middle-class primarily White adolescents ( M  = 17.01 years). Adolescents applied moral, conventional, and personal criteria to distinguish involvement in community service, standard political, social movement, and social gathering activities. Males judged standard political involvement to be more obligatory and important than did females, who judged community service to be more obligatory and important than did males. For each form of civic involvement, greater involvement was associated with more positive judgments and fewer personal justifications. Structural equation modeling indicated that adolescents' judgments about specific types of civic involvement were associated with similar forms of civic behaviors.     

Assessing cohesion in children’s writing: Development of a checklist

Cohesion in writing is achieved through the use of linguistic devices that tie ideas together across a text, and is an important element in the development of coherent writing. Research shows that inter- and intra-developmental differences may appear in how children learn to use these devices, but cohesion is commonly overlooked in the evaluation and instruction of writing. In this study, we developed a checklist to assess cohesion in the writing of children in Grades 4–7, with the purpose of informing instructional practices. Following the procedure outlined by Crocker and Algina (1986), we developed and evaluated a checklist designed to assess the types of cohesive devices present in the writing of children. The checklist items showed fair to good discrimination between high and low scoring writers as demonstrated by a classical item analysis. We also found good interrater reliability, and evidence for discriminative validity. As internal consistency was weak, however, further research is needed to refine the instrument. Implications for the assessment of cohesion and future research are discussed.     

The importance of word and world knowledge for the successful strategic processing of multiple texts online

This article is based on part of a case study looking into how sixth form students search for goal related information online for an open‐ended task. Qualitative data was gathered through think‐aloud protocols; analysis was informed by Afflerbach and Cho's ( 2009 ) Hypertext reading strategies. From the perspective of multiple documents literacy and the Documents Model of reading comprehension, this case study suggests that language competence and general knowledge play a significant role in the successful construction of meaning from multiple texts in an online environment.     

Aligning formative and summative assessments: A collaborative action research challenging teacher conceptions

Assessment innovations require explicitly challenging teachers’ assessment conceptions. In changing towards outcome-based curricula, aligning formative to new summative assessments is a challenge. This study, conducted in Dutch Agricultural Vocational Education and its new outcome-based summative assessments, aims to provide concrete insights into what teacher conceptions hinder the development of aligned formative assessment practices. In a structured collaborative action research, practitioners, researchers and consultants analyse teachers’ formative practices, identify underlying current conceptions and their misalignment to the new summative assessment system. An iterative process resulted in an overview of current conceptions versus required conceptions, showing required conceptual changes that are prerequisite for teachers to change towards formative assessment practices that are aligned to the new outcome-based summative assessment system.