Assessing Key Competences across the Curriculum — and Europe

The development of key competences for lifelong learning has been an important policy imperative for EU Member States. The European Reference Framework of key competences (2006) built on previous developments by the OECD, UNESCO and Member States themselves. It defined key competences as knowledge, skills and attitudes applied appropriately to contexts. Now most Member States have incorporated key competences, or similarly broad learning outcomes, into their school curriculum frameworks. This is a necessary but insufficient step towards implementation; for the effective development of learners' key competences, assessment must also change. This article focuses on the challenge of assessing cross-curricular key competences in primary and secondary education. It is based on a major study for the European Commission (Gordon, et al., 2009), which drew on information gathered and validated with the help of experts in each of the 27 EU Member States. The study's typology of assessment provides a basis for reviewing some recent developments in Member States. Present challenges and innovative responses are addressed, including ‘unpacking’ key competences, ‘mapping’ them to contexts and ‘accessment’ of their full scope and range. Policy developments are considered in the context of the author's work with the European Commission's Thematic Working Group on the assessment of key competences. The article concludes with considerations for policy and practice.     

The Importance of Making the Well-Being of Children in Poverty a Priority

Hurricane Katrina exposed to the world the side of America that is often ignored or forgotten—the side of America where people live in poverty and struggle to meet their most basic needs. This article focuses primarily on children in Mississippi and highlights the effect that poverty has on children’s well-being at an early age and future academic success. It also provides evidence for the importance of funding high-quality pre-k programs and parental training to ensure they begin the process of preparing their children for success, not only in Mississippi but in the other states that are leaving their children behind. Finally, with the reauthorization of No Child Left Behind in 2007, recommendations are made for refocusing the premise of the law from accountability and high stakes testing to meeting the needs of all children so they can truly be successful in school.     

Assessing and Predicting Small-Group Literacy Instruction in Early Childhood Classrooms

Research Findings: The present study assessed the extent to which early childhood educators utilized small-group literacy instruction and explored factors potentially associated with the use of this evidence-based practice. The classroom activities of 83 early childhood educators were observed in the fall and spring, and videos were coded to calculate time spent in small-group literacy instruction. Educators completed questionnaires indicating classroom adult:child ratios, literacy beliefs, and feelings of self-efficacy. Classroom Assessment Scoring System scores for classroom organization and instructional support measured the quality of classroom management and instructional interactions, respectively. On average, educators provided 11.4 min (SD = 10.6) of small-group literacy instruction a day. It is notable that many educators provided little or no small-group literacy instruction. Negative binomial regression analyses indicated that educators with better classroom management, higher quality instructional interactions, and lower adult:child ratios were more likely to use small-group literacy instruction. Educators’ beliefs and feelings of self-efficacy were not associated with the use of small-group literacy instruction. Practice or Policy: Educators may be better able to provide small-group literacy instruction in contexts affording low adult:child ratios and high levels of classroom management and instructional support, all of which are malleable factors that can be changed via policy or professional development.     

Preschool teachers’ literal and inferential questions and children's responses during whole-class shared reading

This study examined the extent to which preschool teachers used literal and inferential questions during classroom-based shared reading. Specific foci included (a) investigating the association among the level of literal or inferential language in the text, teachers’ text-related questions, and children's responses using sequential analysis, and (b) examining the relation between teachers’ inferential questioning and children's vocabulary outcomes. Participants included 25 preschool teachers and 159 four-year-old children. Teachers videotaped their whole-class shared reading of an informational narrative text. Teachers and children's extratextual talk was analyzed and children completed standardized vocabulary assessments in fall and spring of the academic year. When reading this informational narrative text, teachers posed, on average, slightly more inferential questions than literal questions. Significant sequential associations were observed between the level of teachers’ questions and child responses, with inferential questions consistently eliciting inferential child responses. Few characteristics of teachers’ questions were associated with children's vocabulary outcomes. Results suggest that preschool teachers can use inferential questioning to encourage children to participate in conversation at complex, inferential levels; informational texts appear to provide a successful context for this inferential discourse. Implications for teachers and allied professionals are discussed.     

A standardized tool for assessing the quality of classroom-based shared reading: Systematic Assessment of Book Reading (SABR)

Participation in shared-reading experiences is associated with children's language and literacy outcomes, yet few standardized assessments of shared-reading quality exist. The purpose of this study was to describe the psychometric characteristics of the Systematic Assessment of Book Reading (SABR), an observational tool designed to characterize the quality of classroom-based shared-reading sessions in early childhood settings. Participants included 105 preschool teachers. The quality of teachers’ videotaped, whole-class shared-reading sessions was examined using the SABR. Reliability levels for each of the SABRs five constructs were examined, as well as delayed alternate-form reliability and inter-rater reliability. The tools’ factor structure and construct validity were also assessed. Findings provide initial validation and preliminary evidence that the SABR is a reliable and valid tool. Potential uses for early childhood researchers, teachers, and allied professionals are described.     

Evaluation of best practices in the design of online evidence-based practice instructional modules

Objectives:

The research determined to what extent best practices are being followed by freely available online modules aimed at teaching critical thinking and evidence-based practices (EBPs) in health sciences fields.

Methods:

In phase I, an evaluation rubric was created after reviewing the literature. Individual rubric questions were assigned point values and grouped into sections, and the sections weighted. Phase II involved searching Internet platforms to locate online EBP modules, which were screened to determine if they met predetermined criteria for inclusion. Phase III comprised a first evaluation, in which two authors assessed each module, followed by a second evaluation of the top-scoring modules by five representatives from different health sciences units.

Results:

The rubric''s 28 questions were categorized into 4 sections: content, design, interactivity, and usability. After retrieving 170 online modules and closely screening 91, 42 were in the first evaluation and 8 modules were in the second evaluation. Modules in the first evaluation earned, on average, 59% of available points; modules in the second earned an average of 68%. Both evaluations had a moderate level of inter-rater reliability.

Conclusions:

The rubric was effective and reliable in evaluating the modules. Most modules followed best practices for content and usability but not for design and interactivity.

Implications:

By systematically collecting and evaluating instructional modules, the authors found many potentially useful elements for module creation. Also, by reviewing the limitations of the evaluated modules, the authors were able to anticipate and plan ways to overcome potential issues in module design.     

Subscribing to Governmental Rationality: HBO and the AIDS Epidemic

Between 1987 and 2013, HBO produced or distributed over twenty HIV/AIDS programs. These films trace a cultural shift from an early focus on AIDS as a public health issue to be dealt with through individual “safe-sex” practices and ethical citizenship to a later focus on AIDS as a global pandemic where the explicit strategy becomes a reliance on non-state actors to combat AIDS. This article argues that HBO's HIV/AIDS films are embedded within a cultural approach to AIDS that relies on governmental logics and neoliberal solutions – not direct action, but directing action.     

Assessment of an iPad Loan Program in an Academic Medical Library: A Case Study

An academic medical library expanded its iPad loan service to multiple campus libraries and conducted an assessment of the service. iPads loaded with medical and educational apps were loaned for two-week checkouts from five library campus locations. Device circulation statistics were tracked and users were invited to complete an online survey about their experience. Data were gathered and analyzed for 11 months. The assessment informed the library on how best to adapt the service, including what resources to add to the iPads, and the decision to move devices to campuses with more frequent usage.     

When Assessment Validation Neglects Any Strand of Validity Evidence: An Instructive Example from PISA

The Standards for Educational and Psychological Testing identify several strands of validity evidence that may be needed as support for particular interpretations and uses of assessments. Yet assessment validation often does not seem guided by these Standards, with validations lacking a particular strand even when it appears relevant to an assessment. Consequently, the degree to which validity evidence supports the proposed interpretation and use of the assessment may be compromised. Guided by the Standards, this article presents an independent validation of OECD's PISA assessment of mathematical self-efficacy (MSE) as an instructive example of this issue. OECD identifies MSE as one of a number of “factors” explaining student performance in mathematics, thereby serving the “policy orientation” of PISA. However, this independent validation identifies significant shortcomings in the strands of validity evidence available to support this interpretation and use of the assessment. The article therefore demonstrates how the Standards can guide the planning of a validation to ensure it generates the validity evidence relevant to an interpretive argument, particularly for an international large-scale assessment such as PISA. The implication is that assessment validation could yet benefit from the Standards as what Zumbo calls “a global force for testing”.