Criterion Bias in Examine Centered Standard Setting: Some Thought Experiments

How can a thought experiment be used to examine issues in the selection and use of criteria in standard setting? How does the selection of a criterion affect the decisions which are made about examinees?     

Correction to: The summer learning effect in writing in New Zealand

Reading and Writing - The original publication of the article contained an error.     

The differentiation of adaptive behaviours: evidence from high and low performers

Background: Professionals who use measures of adaptive behaviour when working with special populations may assume that adaptive behaviour is a consistent and linear construct at various ability levels and thus believe the construct of adaptive behaviour is the same for high and low performers. That is, highly adaptive people simply are assumed to have a higher level of adaptive behaviour than their less adaptive peers (i.e. individuals with special need, including intellectual disability). This study examines the viability of this assumption and poses an alternative hypothesis: adaptive behaviour is qualitatively different for high and low performers. Methods: Portions of the Adaptive Behaviour Assessment System-II’s standardisation sample were used to examine the structure of adaptive behaviour in high and low performers. Results. Results of factor analysis indicated that the amount of variance attributable to a general factor of adaptive behaviour declines at lower levels of adaptive ability, indicating that adaptive behaviours are not organised in the same manner across the spectrum of adaptive ability. Conclusions: Additionally, knowledge of an individual’s adaptive skills, not merely their general adaptive composite, seemingly is especially important when working with special needs children and youth who display deficits in adaptive behaviour.     

An investigation into excellent tertiary teaching: Emphasising reflective practice

This study is an attempt to understand betterthe complex nature of tertiary teaching byidentifying and investigating the attributes ofa group of excellent teachers in sciencedepartments of the University. In working withthis group of teachers we examined what theysay about their teaching and what theydo in their teaching practice. Ourfindings, as well as confirming much of theexisting literature at primary, secondary andtertiary levels, emphasise the strong linkbetween the teaching practice and researchcommitment of our excellent science teachers;as well as the key roles played byinterpersonal relationships and the `person' ofthe teacher. We propose that purposefulreflective practice integrates the manydimensions of teaching for this group ofexcellent science teachers. We present atheoretical model that can be used to assistnovice or less experienced university academicsin their development and understanding ofteaching excellence at the tertiary level.     

Examining the Impact of Pedagogy on Student Application of Learning: Acquiring,Sharing, and Using Knowledge for Organizational Decision Making

In this pilot research we examine the impact of two leadership development training programs on the ability of students to acquire knowledge, share knowledge, and apply knowledge for organizational decision making. One program emphasized concepts and case‐based application based on a technical learning paradigm. The other program used a game‐based computer simulation, Virtual Leader, grounded in an experiential or situated learning paradigm. After training, students from both programs engaged in a complex in‐basket exercise to examine the quality of their leadership and managerial abilities. In this exercise, participants from each training intervention worked with their trained cohort to accomplish a day of managerial work. Participants were observed and their individual and collective actions and decisions on behalf of the organization were evaluated. Using qualitative research we compared the organizational decisions associated with each group to determine which pedagogical technique resulted in the most effective application of student learning. While technical learning pedagogy was associated with greater information acquisition, the game‐based computer simulation (an experiential, social‐interaction oriented pedagogy) was associated with better decision quality and more shared cognition. Evidence suggests that students taught with the game‐based computer simulation collectively demonstrated a greater ability to apply what they learned.     

The summer learning effect in writing in New Zealand

Reading and Writing - The summer learning effect has been identified as a major barrier in creating equitable outcomes in the United States, especially in reading and mathematics. Less is known...     

Threats to the Valid Use of Assessments

Validity is the most important quality of an assessment, but its evaluation is often neglected. The step‐by‐step approach suggested here provides structured guidance to validators of educational assessments. Assessment is depicted as a chain of eight linked stages: administration, scoring, aggregation, generalization, extrapolation, evaluation, decision and impact. Evaluating validity requires careful consideration of threats to validity associated with each link. Several threats are described and exemplified for each link. These sets of threats are intended to be illustrative rather than comprehensive. The chain model suggests that validity is limited by the weakest link, and that efforts to make other links particularly strong may be wasteful or even harmful. The chain model and list of threats is also shown to be valuable when planning assessments.