Assessing and tracking students’ problem solving performances in anchored learning environments

The purpose of this randomized experiment was to compare the performance of high-, average-, and low-achieving middle school students who were assessed with parallel versions of a computer-based test (CBT) or a paper-pencil test (PPT). Tests delivered in interactive, immersive environments like the CBT may have the advantage of providing teachers with diagnostic tools that can lead to instruction tailored to the needs of students at different achievement levels. To test the feasibility of CBT, students were randomly assigned to the CBT or PPT test conditions to measure what they had learned from an instructional method called enhanced anchored math instruction. Both assessment methods showed that students benefited from instruction and differentiated students by achievement status. The navigation maps generated from the CBT revealed that the low-achieving students were able to navigate the test, spent about the same amount of time solving the subproblems as the more advanced students, and made use of the learning scaffolds.

Keeping their attention: Classroom practices associated with behavioral engagement in first grade mathematics classes in China and the United States

This study investigated variation in students’ behavioral engagement across mathematics classes in China and the United States. Student behavioral engagement was examined along with two aspects of the classroom (group size and teacher instructions given about classroom behavior). Video observational data were collected and coded over 1051 time intervals in 35-minute mathematics sessions in Chinese classrooms (n = 8) and comparable American classrooms (n = 7). Latent growth analyses revealed that overall, behavioral engagement declined over time, although the drop-off was dramatically sharper in American classrooms relative to Chinese classrooms. In addition, larger group size and the timing of teacher instructions (given before versus after the behavior) were significantly associated with increased engagement. This study revealed compelling cultural differences as well as patterns in student and teacher behaviors associated with students engaging in on-task behaviors in the classroom. Implications for ways to promote effective classroom behavior are discussed.     

A combined social action, mixed methods approach to vocational guidance efficacy research

This article proposes a social action, mixed methods approach to verifying the efficacy of vocational guidance programs. Research strategies are discussed in the context of how the processes and purposes of efficacy research have been conceptualized and studied in vocational psychology. Examples of how to implement this approach in future efficacy research are provided.     

Learning to Teach About Ideas and Evidence in Science: The Student Teacher as Change Agent

A collaborative curriculum development project was set up to address the lack of good examples of teaching about ideas and evidence and the nature of science encountered by student teachers training to teach in the age range 11–16 in schools in England. Student and teacher-mentor pairs devised, taught and evaluated novel lessons and approaches. The project design required increasing levels of critique through cycles of teaching, evaluation and revision of lessons. Data were gathered from interviews and students’ reports to assess the impact of the project on student teachers and to what extent any influences survived when they gained their first teaching posts. A significant outcome was the perception of teaching shifting from the delivery of standard lessons in prescribed ways to endeavours demanding creativity and decision-making. Although school-based factors limited newly qualified teachers’ chances to use new lessons and approaches and therefore act as change-agents in schools, the ability to critique curriculum materials and the recognition of the need to create space for professional dialogue were durable gains.     

Explaining attendance through the brand community triad: Integrating network theory and team identification

In this study, the authors empirically test a model of sport behaviour that integrates both team identification and a network theory approach to understand attendance at intercollegiate ice hockey games. Grounded within the brand community triad, ego network data were collected among attendees to measure the fan-to-fan connections that constitute the horizontal relationships of brand community participants. Additionally, a multidimensional team identification measure was used to illustrate the vertical relationship between individual and team. Both measures were included in a structural equation model to test how both fan-to-fan and fan-team relationships explain attendance. The results from the model support the salience of both dimensions of the brand community triad, suggesting that understanding sport fan behaviour necessitates including both psychological and structural elements of behaviour. Future suggestions for extending the study of sport fans through structural networks are discussed.     

Impressions of ICOTS II

The following short contributions are from people who attended the Second International Conference on Teaching Statistics held in Victoria, August 1986     

The development, validation, and applicability of The Personnel Evaluation Standards

Michigan State UniversityAir Force Human Resources Laboratory     

A review of research on teachers’ use of student data: from the perspective of school leadership

Despite the increased worldwide acknowledgment of the importance of teachers’ use of formative and/or summative assessment data to improve teaching and learning, empirical research on its impacts on student learning is sparse. Even more so is the lack of studies on the best ways for school leaders to develop teachers’ capacity. Teachers generally have low efficacy in using student data to inform their day-to-day instructions. Teachers lack the basic skills to understand, interpret, and analyze data, develop instructional strategies based on data, and implement research-based instructional strategies in classrooms to address the weaknesses reflected from data analysis results. Any gap in this chain of instructional actions would lead to ineffective teaching and learning in classrooms. This study synthesizes research located from on-line databases on teachers’ data use conducted in the last 14 years and examines the nature, impacts, and shapers of teachers’ use of student formative and/or summative assessment data to improve teaching and learning. This review provides a much-needed guide to school leaders and policy makers in the USA, as well to other jurisdictions that want to make evidence-based decisions in the hopes of improving student learning and teachers’ capacity in data use.