An analysis of the effectiveness of feedback to students on assessed work

This paper presents the views of students, from a range of schools and disciplines, on the effectiveness of current assessment feedback practices at Flinders University. We also report on a workshop on feedback with teachers. Overall, individual written comments were found to be the most useful form of feedback. However, there was significant variation with the level of satisfaction with feedback and the relative usefulness of different forms of feedback across the different schools and disciplines. This research suggests both the need to improve the effectiveness of such feedback and to tailor the forms of feedback offered to students according to the distinctive teaching and learning environments in different schools and disciplines. To that end, innovation and further research on feedback are justified, and some suggestions are offered.     

Enhancing preschool children's vocabulary: Effects of teacher talk before,during and after shared reading

This observational study analyzed patterns of teacher extratextual talk as it occurs before, during, and after reading books to children, and the frequency and duration of teacher questioning by type (label, define, associate) on preschoolers’ receptive and expressive vocabulary knowledge. Over the course of 18 weeks, 13 teachers and 100 children participated in ninety 20-min small-group sessions of teacher-guided shared reading instruction. Teachers’ reading instruction was examined through videotaped observations using the Multi-Option Observation System for Experimental Studies (MOOSES™; Tapp, Wehby, & Ellis, 1995). Two findings, in particular, yielded relevant educational and theoretical implications. First, time spent after reading was significantly related to expressive vocabulary. However, question timing did not seem to matter in terms of receptive vocabulary outcomes. Second, duration of teacher association questioning was significantly related to receptive vocabulary outcomes while both frequency and duration of teacher vocabulary-related association-level questioning were related to expressive vocabulary. For receptive vocabulary, both vocabulary- and comprehension-related association-level questioning mattered. These findings complement the body of work demonstrating that engaging children in interactive shared reading that elicits their active participation is related to meaningful gains in children's language and literacy growth. Limitations of the study and directions for future research are discussed.     

Urban Youth's Perspectives on Flash Mobs

Flash mobs are new, emerging, and evolving social phenomena that have recently been associated with youth violence in the US cities. The current study explores how youth understand flash mobs through focus groups conducted in Kansas City, Missouri (a site of violent youth flash mobs). Results indicate that youth have varying familiarity with flash mobs and define them in different ways; that youth perceive youth boredom to be the most frequent cause of problems with flash mobs; that youth connect ongoing social disorder with the violence associated with flash mobs; and that while social media are facilitators of flash mobs, flash mobs have their roots in youth activities that have been going on for generations (e.g., hanging out in groups and cruising). Results illustrate the importance of conducting formative research with youth, particularly about emergent phenomena, when developing interventions and communication campaigns aimed at reducing youth violence.     

Gender DIF in Reading and Mathematics Tests With Mixed Item Formats

This was a study of differential item functioning (DIF) for grades 4, 7, and 10 reading and mathematics items from state criterion-referenced tests. The tests were composed of multiple-choice and constructed-response items. Gender DIF was investigated using POLYSIBTEST and a Rasch procedure. The Rasch procedure flagged more items for DIF than did the simultaneous item bias procedure—particularly multiple-choice items. For both reading and mathematics tests, multiple-choice items generally favored males while constructed-response items generally favored females. Content analyses showed that flagged reading items typically measured text interpretations or implied meanings; males tended to benefit from items that asked them to identify reasonable interpretations and analyses of informational text. Most items that favored females asked students to make their own interpretations and analyses, of both literary and informational text, supported by text-based evidence. Content analysis of mathematics items showed that items favoring males measured geometry, probability, and algebra. Mathematics items favoring females measured statistical interpretations, multistep problem solving, and mathematical reasoning.     

Teachers’ Concepts of Spatial Scale: An international comparison

Metric scale is an important concept taught as part of science curricula across different countries. This study explored metric and relative (body-length) scale concepts of inservice (N?=?92) and preservice (N?=?134) teachers from Austria, and Taiwan, and their concepts were compared with those of teachers from the USA. Participants completed three assessments: the Scale Anchoring Objects (SAO), Scale of Objects Questionnaire (SOQ), and a subsample of participants were interviewed with the Learning Scale Interview. A Rasch analysis was conducted with the SAO and SOQ and results showed that the Rasch model held for these assessments, indicating that there is an underlying common dimension to understanding scale. Further analyses showed that accuracy of knowledge of scale measured by the SAO and SOQ was not related to professional experience. There were significant differences in teachers’ accuracy of scale concepts by nationality. This was true for both metric and body-length SAO assessments. Post hoc comparisons showed that the Austrian and Taiwanese participants were significantly more accurate than the US sample on the SAO and SOQ. The Austrian participants scored significantly higher than the US and the Taiwanese participants. The results of the interviews showed that the Taiwanese experienced teacher participants were more likely to report learning size and scale through in-school experiences than the Austrian or the US participants. US teachers reported learning size and scale most often through participating in hobbies and sports, Taiwanese teachers reported learning scale through sports and reading, and Austrian teachers most often noted that they learned about scale through travel.     

Researching learning outcomes: building confidence in our conclusions

The ESRC Teaching and Learning Research Programme is expected to produce knowledge of high social scientific quality and practical pedagogic value. It faces, in a particularly acute form, the issue of how confidence in its conclusions can be built. This article begins with some conceptual clarification of the notion of a ‘warrant’ for research findings and distinguishes between warrants in social research and warrants for educational policy and practice. It then, in the specific context of research on learning outcomes, proposes an integrated model that recognizes the importance of, and relationships among, criteria associated with research design and empirical work, theoretical coherence, relationship with other research, and user affirmation. It concludes by emphasizing the need for continuing debate about, and development of, the roles and relationships of ‘researchers’ and ‘users’.