Assessing effectiveness and efficiency of academic interventions in school psychology journals: 1995–2005

This article reviews research in the four major school psychology journals: Journal of School Psychology, Psychology in the Schools, School Psychology Quarterly, and School Psychology Review. The function of the review was to provide school psychologists with a summary of academic interventions published through years 1995–2005, synthesize the commonalities of empirically based interventions, and report on the extent to which each article provides the reader the opportunity to understand the effects of the intervention with regard to the amount of instructional time required to implement it. Results of the review suggest that reading is most heavily investigated followed by math and, to a much lesser degree, written expression. Moreover, studies use a variety of designs including single subject and group designs. Finally, it is clear that a limited number of studies evaluate the effectiveness of an intervention with regard to the amount of instructional time needed to implement the intervention. In light of these findings and in addition to the two major functions of the review, recommendations for practice and future research are presented. © 2009 Wiley Periodicals, Inc.     

Evaluating teaching effectiveness and teaching improvement: A language for institutional policies and academic development practices

Demands for institutional accountability in higher education have been increasing and have led to greater attention to the evaluation of teaching, the assumption being that improved teaching will result in enhanced learning. In our work as academic developers, we are increasingly helping academic managers make explicit teaching policies and practices that seem fair and equitable. To help us in this work, we have developed a framework for evaluating the practice of teaching. What is unique about this framework is the language it provides to differentiate aspects of teaching. For instance, it provides a basis for differentiating and linking criteria to standards, i.e. the level of achievement desired or expected. Standards are critical if the evaluation of teaching is to be seen as fair and equitable, yet they are often unexamined in other representations of the evaluation of teaching. Although the original intent of our efforts was to provide a framework for academic managers, we have come to find it useful in our own work as university teachers and as academic developers. Examples of all three uses are provided in the paper.     

Evaluating leadership development in an academic program

An evaluation of the Royal Military College of Canada's Aboriginal Leadership Opportunity Year leadership practicum was conducted in 2009. This novel approach used several human performance technology (HPT) models to frame the evaluation and identify the dimensions and subdimensions of merit. This article explains the theoretical framework of the evaluation, how and why different HPT models complemented the evaluation process, the challenges faced in executing the evaluation, and the teams' findings on using this approach.