Measuring Longitudinal Gains in Student Learning: A Comparison of Rasch Scoring and Summative Scoring Approaches

This study pioneers a Rasch scoring approach and compares it to a conventional summative approach for measuring longitudinal gains in student learning. In this methodological note, our proposed methodology is demonstrated using an example of rating scales in a student survey as part of a higher education outcome assessment. Such assessments have become increasingly important worldwide for purposes of institutional accreditation and accountability to stakeholders. Data were collected from a longitudinal study by tracking self-reported learning outcomes of individual students in the same cohort who completed the student learning experience questionnaire (SLEQ) in their first and final years. Rasch model was employed for item calibration and latent trait estimation, together with a scaling procedure of concurrent calibration incorporating a randomly equivalent group design and a single group design to measure the gains in self-reported learning outcomes as yielded by repeated measures. The extent to which Rasch scoring compared to the conventional summative scoring method in its sensitivity to change was quantified by a statistical index namely relative performance (RP). Findings indicated greater ability to capture learning outcomes gains from Rasch scoring over the conventional summative scoring method, with RP values ranging from 3 to 17% in the cognitive, social, and value domains of the SLEQ. The Rasch scoring approach and the scaling procedure presented in the study can be readily generalised to studies using rating scales to measure change in student learning in the higher education context. The methodological innovations and contributions of this study are discussed.     

Finnish and Russian teachers supporting the development of social skills

We argue that a key aspect of inclusive pedagogy is the interaction between the learners, their teachers and the environment. For effective interaction, learners need to develop social competence. This study explores how teachers support the development of the key social skills in schools in Finland and in Russia. The data were collected by questionnaires and observations, and analysed by theory-guided content analysis. While all teachers supported the development of social skills, their pedagogical choices reflected their personal interaction style. The teachers who favoured informal interactions engaged in real-life situations with learners, whereas those favouring formal interactions chose separate activities for practising social skills. The study highlights aspects that deserve more attention in developing teacher education programmes for inclusion.     

Turning Crisis into Opportunity: Nature of Science and Scientific Inquiry as Illustrated in the Scientific Research on Severe Acute Respiratory Syndrome

Interviews with key scientists who had conducted research on Severe Acute Respiratory Syndrome (SARS), together with analysis of media reports, documentaries and other literature published during and after the SARS epidemic, revealed many interesting aspects of the nature of science (NOS) and scientific inquiry in contemporary scientific research in the rapidly growing field of molecular biology. The story of SARS illustrates vividly some NOS features advocated in the school science curriculum, including the tentative nature of scientific knowledge, theory-laden observation and interpretation, multiplicity of approaches adopted in scientific inquiry, the inter-relationship between science and technology, and the nexus of science, politics, social and cultural practices. The story also provided some insights into a number of NOS features less emphasised in the school curriculum—for example, the need to combine and coordinate expertise in a number of scientific fields, the intense competition between research groups (suspended during the SARS crisis), the significance of affective issues relating to intellectual honesty and the courage to challenge authority, the pressure of funding issues on the conduct of research and the ‘peace of mind’ of researchers, These less emphasised elements provided empirical evidence that NOS knowledge, like scientific knowledge itself, changes over time. They reflected the need for teachers and curriculum planners to revisit and reconsider whether the features of NOS currently included in the school science curriculum are fully reflective of the practice of science in the 21st century. In this paper, we also report on how we made use of extracts from the news reports and documentaries on SARS, together with episodes from the scientists’ interviews, to develop a multimedia instructional package for explicitly teaching the prominent features of NOS and scientific inquiry identified in the SARS research.

Bimbo or boffin? Women in science: an analysis of media representations and how female scientists negotiate cultural contradictions

This paper examines the gendered representations of scientists in the UK media. Our analysis reveals the asymmetrical ways in which men and women working in science, engineering and technology are portrayed, in particular through the emphasis on women's appearance and a focus on their exceptional status. It also highlights the way female scientists may be used to "sex up" the discipline in the context of increasing concern about the (un)popularity of science. This media analysis is contextualized by drawing on data from 86 scientists examining how women themselves experience press and television coverage and address the cultural contradictions surrounding their role. The research highlights the challenges facing women working in these fields and the dilemmas for those seeking to develop a "human" face for science and promote a positive image for women.     

A Delphi investigation into future trends in e-learning in Israel

The purpose of this study is to investigate the views and opinions of e-learning experts regarding future trends in the e-learning arena. The Delphi technique was chosen as a method of study. This technique is an efficient and effective group communication process designed to systematically elicit judgments from experts in their selected area of expertise. The 35 experts who participated in this study were asked to rate 16 statements according to what they think will probably happen (probability) and what they would like to see happen (desirability). Findings show that participants believe that the use of new technologies will change current educational theories and methodologies and will have impact on instructor skills, effort, feedback, and interaction as well as on the process of learning assessment. Concerning the future of e-learning, participants view a future tendency toward the provision of full online degrees, yet they are skeptical, stating that the e-learning setting will not completely replace the frontal educational setting. Regarding the impact of social and mobile technologies on e-learning, experts seem to view the role of social and mobile technologies as facilitators in the transfer and sharing of information in e-learning settings.     

QuickSmart: a basic academic skills intervention for middle school students with learning difficulties

QuickSmart is a basic academic skills intervention designed for persistently low-achieving students in the middle years of schooling that aims to improve the automaticity of basic skills to improve higher-order processes, such as problem solving and comprehension, as measured on standardized tests. The QuickSmart instructional program consists of three structured, teacher- or teacher aide-directed, 30-minute, small-group lessons each week for approximately 26 weeks. In this study, 42 middle school students experiencing learning difficulties (LD) completed the QuickSmart reading program, and a further 42 students with LD took part in the QuickSmart mathematics program. To investigate the effects of the intervention, comparisons were made between the reading and mathematics progress of the intervention group and a group of 10 high-achieving and 10 average-achieving peers. The results indicated that although the standardized reading comprehension and mathematics scores of QuickSmart students remained below those of comparison students, they improved significantly from pretest to posttest. In contrast, the standardized scores of comparison students were not significantly different from pretest to posttest. On measures of response speed and accuracy gathered using the Cognitive Aptitude Assessment System (CAAS), QuickSmart students were able to narrow the gap between their performance and that of their high- and average-achieving peers. Implications are drawn regarding the importance of interventions that emphasize the automaticity of basic academic skills for students with learning difficulties.     

Golfers do not respond to changes in shaft mass properties in a mechanically predictable way

A common belief in the golf community is that a lighter shaft allows the golfer to swing the club faster. From a mechanical point of view, reducing the mass of the shaft would result in a faster swing. However, a golfer is not a purely mechanical system, and so it is simplistic to assume that identical loads will be applied when swinging different clubs. Therefore, the purpose of this study was to test the hypothesis that golfers behave similar to a mechanical model when swinging clubs of varying mass. A torque driven model estimated the effects caused by the addition of 22?g to the shaft. Twelve golfers hit balls with a standard driver as well as a driver fitted with the same 22?g increase in mass. Club kinematics were collected with a high-speed motion capture system. The model predicted a 1.7?% lower club head speed for the club with additional mass. One subject showed a similar reduction (1.4?%), but one subject showed an increase in club head speed by 3.0?%. Ten subjects did not show any significant differences. These results suggest that golfers do not respond to changes in club mass in a mechanically predictable way.     

Governing education through data: Scotland,England and the European education policy space

This paper draws on interview data from national policy makers in England, Scotland and the European Commission to illustrate differences in the referencing of ‘Europe’ in education policy‐making in England and Scotland in order to highlight the emergent complexity of post‐devolution policy‐making in education through a focus on relations and interactions with Europe, as expressed in the negotiation and development of performance data systems. We suggest that policy‐makers in England reference global influences, rather than Europe, while policy‐makers in Scotland reference Europe in order to project a new positioning of Scotland in closer alignment with Europe. Europeanisation in education thus produces differing policy responses from closely aligned, indeed, in the case of England and Scotland, contiguous policy spaces. Thus the paper seeks to contribute to the literature on ‘travelling’ education policy and its ‘local’ mediation and to connect the development of devolution and the changing policy space of education in Europe.     

A crisis of professional identity: How primary teachers are coming to terms with changing views of literacy

As definitions of literacy become reconceptualised, so too do constructions of the primary teacher's identity. This study analyses the discourses that emerged from interviews with a group of Australian primary teachers who talked about their reactions to teaching media. Teachers who embraced this area of learning had a more futures-oriented view of their identity. However, there were still teachers who retained a more traditionalist perception of their role, including some who viewed teaching media as an unnecessary burden. These contrasting perspectives suggest that a crisis in identity will remain unless the boundaries that separate conventional literacies from new literacies can be challenged.