Non-iterative Conditional Pairwise Estimation for the Rating Scale Model

We investigate two non-iterative estimation procedures for Rasch models, the pair-wise estimation procedure (PAIR) and the Eigenvector method (EVM), and identify theoretical issues with EVM for rating scale model (RSM) threshold estimation. We develop a new procedure to resolve these issues—the conditional pairwise adjacent thresholds procedure (CPAT)—and test the methods using a large number of simulated datasets to compare the estimates against known generating parameters. We find support for our hypotheses, in particular that EVM threshold estimates suffer from theoretical issues which lead to biased estimates and that CPAT represents a means of resolving these issues. These findings are both statistically significant (p < .001) and of a large effect size. We conclude that CPAT deserves serious consideration as a conditional, computationally efficient approach to Rasch parameter estimation for the RSM. CPAT has particular potential for use in contexts where computational load may be an issue, such as systems with multiple online algorithms and large test banks with sparse data designs.     

The need for a manifesto for educational programme evaluation

This paper explores the progress of educational programme evaluation over three decades through the lens of a group of evaluators primarily from the UK and the US who met periodically from 1972 to 2004 to review the state of the art of educational programme evaluation—what it could and could not do—in relation to the complexity of programme initiatives and the policy and political contexts of the times. These meetings came to be known as the Cambridge conferences as they were always held at a university college in Cambridge. They were sponsored in the main by the Nuffield Foundation and, in 2004, by the ESRC. The nucleus of original group membership was retained over the years for continuity with additional members joining as the specific focus of the conference changed and new ideas were sought. There have been six conferences. This paper first locates the contextual origin of and reason for the first conference and the manifesto that was written from it. Secondly it documents the revisiting of that manifesto at the sixth conference leading to the construction of a ‘new’ manifesto that reflects changes required in evaluation methodology in the socio/political context of the first decade of the twenty‐first century.     

Progress in the inductive strategy-use of children from different ethnic backgrounds: a study employing dynamic testing

This study investigated potential differences in inductive behavioural and verbal strategy-use between children (aged 6–8 years) from indigenous and non-indigenous backgrounds. This was effected by the use of an electronic device that could present a series of tasks, offer scaffolded assistance and record children’s responses. Children from non-indigenous ethnic backgrounds, starting at a lower level, profited as much from dynamic testing as did indigenous children but were unable to progress to the standard of this latter group. Irrespective of ethnic group, dynamic testing resulted in greater accuracy, fewer corrections, and reduced trial-and-error behaviour than repeated practice. Improvements in strategy-use were noted at both the group and individual level. After dynamic training, children from both ethnic groups showed a superior capacity for inductive reasoning although indigenous children subsequently used more inductive strategies. The study revealed individual differences between and within different ethnic groups and variability in the sorts of help required and subsequent strategy progression paths.     

Motivation in the Junior Years: International perspectives on children's attitudes,expectations and behaviour and their relationship to educational achievement

This paper reports findings from a large-scale international investigation of a number of factors that are considered to impact upon educational motivation and achievement. Following on from an earlier investigation of adolescent attitudes, the present study involved a detailed survey of nearly 3,000 children, aged 9-10 from districts in England, Russia and the USA, together with teacher reports and the employment of a test of basic mathematical computation. The Russian sample scored significantly more highly on the computation test and showed no large tail of underachievers, as was the case with the other groups. Findings from the survey indicate that many of the differences found in the earlier adolescent study are equally true for younger children. The Russian children were less likely to express satisfaction with their abilities or workrates, were more positive towards school, more likely to see education as intrinsically valuable and tended to spend significantly more time on homework tasks. Data obtained also suggest that the Russian sample experienced classrooms with far less disruption and stronger prosocial peer influences than did the English and American children. Teacher understandings of what is considered to be acceptable behaviour appeared to differ, however. The paper notes that the Western samples overestimated their teachers' views of their ability while the Russian children provided underestimates. Possible reasons for, and implications of, these differential teacher messages are discussed. The paper concludes by examining the implications of the findings from the study for increasing motivation and achievement in countries with very different sociocultural contexts.     

Using Adjustments to Support the Learning and Assessment Needs of Students with Disabilities: Macau and Mainland China Teachers’ Report

Adjustments are considered necessary for students with disabilities to be fully included in classroom instruction, classroom assessment and external accountability tests. The 67 item Checklist of Learning and Assessment Adjustments for Students (CLAAS), translated for the Chinese community, was used by 74 teachers from Macau and Mainland China to document their application of adjustments for 319 students with special educational needs across these three settings. Results indicated consistently large gaps between adjustment use in classrooms compared with national tests, with the allowable adjustments for public testing reportedly used very little. Findings also provided evidence for the content validity of the checklist for teachers of students with disabilities in China and its utility in documenting applied adjustments. This study also indicates the potential for CLAAS to provide teachers across China with a comprehensive list of adjustments, to reflect on and review adjustment decision-making and assessment protocols for all students.     

Perceptions of Zimbabwean trainee/educational psychologists regarding the training on their support roles and responsibilities in inclusive education

The study used focus group interviews at three administrative offices (provinces) that house trainee/educational psychologists in order to explore their experiences on how they learn about their support roles and responsibilities regarding the implementation of inclusive education. 13 trainee/educational psychologists from these provinces volunteered to participate in the study. The study used a qualitative design based on a phenomenological perspective and inductive thematic content was used to analyse data. The results indicate that trainee/educational psychologists had known their support roles through master's degree programmes, a single 2016 workshop, personally guided reading and collaborative work with workmates. Their views indicated inadequate training and supervision, and negative feelings towards internship after master's programme, payment of supervisors, continuing professional development points, lack of degree programmes in Master of Science in educational psychology, and location of conferences. The results provide important information about educational psychology in Zimbabwe with important implications for training and policy making.     

Observations and ratings of preschool children's social behavior: Issues of representativeness and validity

Data were gathered from videotaped recordings of two preschool children engaged in unstructured free play over 12 days each. Observers coded behavior from the videotapes and completed a behavior rating scale for each child after every two observation sessions. Teachers also completed two behavior rating scales per child. Results indicated that at least three 30‐min observation sessions were required to reliably represent a child's overall behavior. Moderate correlations were obtained when observations were compared with teachers' and observers' own ratings, indicating the behavior rating scale did an adequate job of reflecting actual observed behavior. The implications of these results for researchers and practitioners are discussed. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 13–26, 2005.     

Effects of narrator gender on conceptual learning

Audiovisual materials for nursing students typically show a female nurse demon-strating activities as they are described (and sometimes directed) by a male narrator. Of obvious concern is the effect of such sex stereotyping on female students. Further, do students (male and female) learn as well from instructional video-tapes narrated by an equally competent female narrator? The investigator sought to control all variables but gender of narrator in this study of conceptual learning from videotapes.