Multi-informant assessment of treatment integrity in the classroom

Assessing the degree to which interventions are implemented in school settings is critical to making decisions about student outcomes. School psychologists may not be available to regularly conduct observations of intervention implementation, however, their data may be used alongside other methods for multi-informant assessment. Teacher self-report is a commonly used and feasible assessment method. Students have been trained to implement interventions with their peers in instances where traditional adult interventionists were unavailable. This exploratory study investigated the accuracy with which classroom teachers and middle and high school students assessed implementation of the Good Behavior Game and the impact of performance feedback on their accuracy. Results indicated that most students and teachers were able to provide accurate assessments of treatment integrity compared to researcher direct observation; however, some required performance feedback to do so. These findings suggest that multi-informant assessment may be a feasible and accurate way for school psychologists to collect formative treatment-integrity data in the classroom. Limitations and future directions are discussed.     

The American University in Bulgaria as an Entrepreneurial University

Entrepreneurship in an educational institution is not strictly commercial. It is also defined in terms of educational objectives. The author, who is the Provost and Dean of Faculty at the American University of Bulgaria at Blagoevgrad, describes the setting up of this university in 1990‐1991 as a case study in educational entrepreneurship. This American‐style liberal arts university has become very successful through offering a curriculum that is unique to the Bulgarian higher education environment and employing faculty and staff who have a very strong professional and personal commitment to the institution and its mission. The university operates according to democratic principles of shared governance with an emphasis upon Total Quality Management and state‐of‐the‐art facilities in such areas as Internet access, computerization, and library automation. The university has made a successful adaptation to the Bulgarian cultural, linguistic, and material environment, and has won the respect of the traditional Bulgarian academic establishment. Success in this case is illustrative of entrepreneurship defined as taking an exciting idea and making it work in spite of difficulties.     

Reassessing RCTs as the ‘gold standard’: synergy not separatism in evaluation designs

ABSTRACT

Randomised controlled trials (RCTs) are increasingly used to evaluate educational interventions in the UK. However, RCTs remain controversial for some elements of the research community. This paper argues that the widespread use of the term ‘gold standard’ to describe RCTs is problematic, as it implies that other research methods are inferior. The usefulness of RCTs can be greatly enhanced when used in conjunction with implementation-specific measures (e.g. observation tools, attitude/engagement surveys and interviews). The proposal is advanced through case studies of two evaluations. One relates to the development of science subject leader skills and expertise at primary school level and the other to co-operative learning of primary maths. Both evaluations randomised schools to the intervention or the business-as-usual control, and compared impact using subject knowledge tests. Integral to each study was a process evaluation which looked at evidence from classroom practice along with feedback from the teachers and pupils themselves. We contend that this enabled much more holistic and richly interpretative pieces of research. The paper concludes that privilege for particular paradigms should be set aside when designing effective evaluations of educational interventions, and that it is insufficient to ask ‘what works?’ without also asking ‘why?’, ‘where?’ and ‘how?’.     

Interactive learning and technology in the US science and mathematics reform movement

This article presents an overview of the science/mathematics reform movement in the secondary/elementary schools and higher education institutions of the United States. It describes the research and views of educational practitioners regarding the need for change, as well as the particular changes which appear to be required. Emphasis is placed on the roles of interactive learning and technology in meeting reform goals.
Details of a recently completed curricular innovation project in science and mathematics are provided. Funded by the National Science Foundation, the project brought five faculty in the natural sciences together with a learning theorist at Florida Community College at Jacksonville, a large, multi-campus, public institution. The group developed and taught two basic integrated science/mathematics courses in which cooperative and discovery learning, supported by multimedia technology and distance learning, were major components. Details of results are provided as they relate to meeting the goals of the reform movement.     

Rural adolescents' reading motivation,achievement and behavior across transition to high school

The authors examined 1,781 rural students' reading motivation and behavior across the transition from middle to high school. Using expectancy-value theory, they investigated how motivational variables predicted changes in reading behavior and achievement across the transition in terms of their expectancies, values, and out-of-school reading behaviors. A repeated measures analysis of variance indicated significant increases in vocabulary, intrinsic value, and out-of-school reading, whereas significant decreases were found in attainment value. Hierarchical regression analysis indicated students' subjective expectancy for success was a significant predictor of increases in both comprehension and vocabulary scores. Students' utility value interacted with intrinsic value in predicting reading comprehension scores. In terms of change in students' reading behavior, their perceptions of intrinsic value and utility value were significant predictors. Gender interacted significantly with expectancies in predicting behaviors. Findings have implications for instructional support, particularly as it relates to reading motivation across the transition from middle to high school.