Using Statistical Control Charts to Analyze Data from Student Evaluations of Teaching

In this paper, a method for analyzing data from student evaluations of teaching is presented. The first step of the process requires development of a regression model for teacher's summary rating as a function of student's expected grade. Then, two‐sigma control charts for individual evaluation scores (section averages) and residuals from the regression model are used to identify both excellent and poor outcomes. The performance of an individual whose scores are out of control on both charts cannot be explained by expected grade and therefore is worthy of note.     

Too Much,Too Young? An Analysis of the Key Stage 3 National Literacy Strategy in Practice

This article was first drafted after I worked for 14 weeks last year in a school that was piloting the National Literacy Strategy at Key Stage 3. I now work in another school delivering the full published Strategy to Year 7. In this article, I explore the contradictions inherent in the Strategy in attempting to develop the English and literacy skills of Key Stage 3 pupils. Ultimately, my argument is that the educational benefits of this teaching to objectives is at odds with some of the deeper aims of the Strategy and of English teaching, and that the constant assessment involved puts too much pressure on our youngsters at an age when they should be concentrating on social development as people.     

Pedagogical Considerations for Examining Rater Variability in Rater‐Mediated Assessments: A Three‐Model Framework

Rater‐mediated assessments are a common methodology for measuring persons, investigating rater behavior, and/or defining latent constructs. The purpose of this article is to provide a pedagogical framework for examining rater variability in the context of rater‐mediated assessments using three distinct models. The first model is the observation model, which includes ecological/environmental considerations for the evaluation system. The second model is the measurement model, which includes the transformation of observed, rater response data to linear measures using a measurement model with specific requirements of rater‐invariant measurement in order to examine raters’ construct‐relevant variability stemming from the evaluative system. The third model is the interaction model, which includes an interaction parameter to allow for the investigation into raters’ systematic, construct‐irrelevant variability stemming from the evaluative system. Implications for measurement outcomes and validity are discussed.     

(Residual) Public Music Radio in the Streaming Era: Listening for Diversity and Frequency on CBC Music

The aim of this article is to assess whether and how the CBC’s music radio programming reflects the corporation’s mandate of showcasing a diversity of music and culture. I argue that a program logic that privileges an international corporate music industry strategy persists (particularly during the peak morning and afternoon drive time programs) and limits the capacity for public radio to imagine and project alternative musical trajectories. My aspiration is to imagine CBC Music’s over-the-air radio as a residual broadcast service, one that presents novel opportunities at a time when digital and online streaming music is dominant.     

When Diversity Training Goes Wrong: A Case Study Analysis of the University of Delaware Residential Education Program

In an increasingly global and interconnected world, it is necessary for corporations and educational systems to develop mechanisms for community members to enhance multicultural competencies related to diversity including race, ethnicity, gender and gender identity, sexual orientation, age, religion, and the like. Some people internalize anger, fear, contempt, and guilt about these issues. As a result, people express their feelings in unhealthy and unproductive ways in school and in the workplace. The solution often is to provide diversity training or sensitivity training. This case study analysis utilizes Kaufman's systemic thinking model to examine what went wrong when one university attempted to implement a yearlong intensive diversity training program that brought national media attention and a potential lawsuit against the university, ultimately resulting in a dramatic shift in the university's out‐of‐classroom experiential learning policies.     

A Model for Peer Review in Instructional Design

Although many professions practice some type of formal peer review, similar support for increasing the quality and efficiency of instructional design products is largely informal. Most designers develop solutions in professional eommunilies-of-practice, but formal design methodologies ordained by many corporations and instructional design schools do not account for the strong influence these communities have on design decisions. This paper describes an instructional design review process that is modeled after a widely accepted practice among software developers in which peers offer feedback through “structured walkthroughs.” The instructional design review helps the practitioner develop stronger designs more quickly. provides a means to scaffold the novice designer in the vagaries of the workplace, and improves organizational memory. An artifact of a design review as well as guidelines and success factors are presented. The paper provides a summary of a formal peer review structure that has been developed and tested over the past three years at a major corporation.