The Impact of Research on Policy: A Case of Qualifications Reform

The relationship between research and policymaking has been discussed repeatedly. However, the debate tends to be in general, abstract terms or from a macroeconomic perspective with any examples described in a fairly cursory way. Despite the inherent complexity of the research-policy interface, analyses tend to homogenise ‘research’ and ‘policy’ as coherent entities with discussions often focusing on products (research and policies) rather than on the relationships between producers (researchers and policymakers). Here, we take one piece of research on qualifications that has influenced policy rhetoric over the last 5 years. We trace the career of the research from its production in the late 1990s in order to understand the conditions of its dormancy, re-emergence and use over the ensuing years. The paper serves to document the case, which is important in its own right, but also proposes a typology of ways in which research gets adopted and adapted into policy.     

Moving beyond the predictable failure of Ed-Tech initiatives

ABSTRACT

The development of Information and Communication Technology has created waves of excitement about its power to fix educational problems and improve learning results, prompting a succession of policy efforts to integrate digital technology into education. Educators, schools and corporations are increasingly driving these initiatives. This article makes the argument that a narrow vision of digital technology, which both ignores the complexity of education and wastes valuable public resources, is becoming an obstacle to significant improvement and transformation in education. Utilising our research and experience in the field of educational technology, this paper problematises the common elision of ‘technology’ and ‘digital technology’. From this basis, we then critically reflect on various common approaches to introducing digital technology in education under the guise of promoting equality and digital inclusion. These include national government-led programmes, more recent trends for local school-led initiatives, and the role of non-formal education initiatives led by corporations/foundations. Amidst the varying surface-level ‘failure’ and/or ‘success’ of these approaches, we point to limited underpinning ‘information and knowledge society’ logics in framing the application of digital technology to education. As such we conclude by considering the educational challenges for future Ed-Tech initiatives.     

Emergence,flexibility, and stabilization of language in a physics classroom

Learning physics is a complex phenomenon. In this article, we use concepts from the theory of nonlinear systems to study the development of language in classroom science in an experimental unit on chaos theory in a German 10th‐grade physics classroom. In ongoing activity, the explanations students developed for phenomena emerged through interactive stabilization and material constraints on the interpretive flexibility of material (artifacts) and discursive representations (talk). Interpretive flexibility both enables novel understandings and differences between private and common public use of these representations. © 2003 Wiley Periodicals, Inc. J Res Sci Teach 40: 869–897, 2003     

What makes for effective feedback: staff and student perspectives

Since the early 2010s the literature has shifted to view feedback as a process that students do where they make sense of information about work they have done, and use it to improve the quality of their subsequent work. In this view, effective feedback needs to demonstrate effects. However, it is unclear if educators and students share this understanding of feedback. This paper reports a qualitative investigation of what educators and students think the purpose of feedback is, and what they think makes feedback effective. We administered a survey on feedback that was completed by 406 staff and 4514 students from two Australian universities. Inductive thematic analysis was conducted on data from a sample of 323 staff with assessment responsibilities and 400 students. Staff and students largely thought the purpose of feedback was improvement. With respect to what makes feedback effective, staff mostly discussed feedback design matters like timing, modalities and connected tasks. In contrast, students mostly wrote that high-quality feedback comments make feedback effective – especially comments that are usable, detailed, considerate of affect and personalised to the student’s own work. This study may assist researchers, educators and academic developers in refocusing their efforts in improving feedback.     

Hemispheric object naming and interhemispheric transfer functions in reading disordered subjects

This study measured unilateral, tachistoscopic naming reaction times of normal and reading disordered children to objects representing two levels of picture vocabulary age. Results of an ANCOVA procedure on the latency data showed main effects for group and stimuli, but not visual field. The latency results suggested parallel, central picture naming operations for each group, with the reading disordered children evidencing significantly longer naming reaction times to each level of stimuli. Arc Sine transformed error data were submitted to an analysis of co-variance procedure and showed a significant stimuli x group interaction. Post hoc tests showed accelerated error rates following right hemispheric stimulation, suggesting anomalous interhemispheric transfer of visual images in the present group of reading disordered children. In addition, left hemispheric stimulations produced significantly more naming errors for the reading disordered subjects as compared to the normal children. Such findings may suggest that a group of higher-ordered processing operations may accompany reading disorders.     

Why lecturers still matter: the impact of lecturer-student exchange on student engagement and intention to leave university prematurely

This research examines the impact of lecturer-student exchange (student-LMX) on engagement, course satisfaction, achievement, and intention to leave university prematurely for 363 students in one Australian university. Survey and grade point average (GPA) data were collected from domestic undergraduate first- and second-year students and analysed using structural equation modelling. The results indicated that student’s levels of engagement and course satisfaction fully mediated the relationship between student-LMX and intention to leave university, when demographic and socio-economic factors were controlled for. In an era when low student engagement and attrition is often attributed to individual demographic factors, and lecturers are under increasing threat of being replaced by technology, this research offers compelling evidence regarding the role of lecturer-student relationships in enhancing tertiary student outcomes.     

Going to action? A literature review on educational proposals in formal Environmental Education

The current state of the planet’s environmental deterioration calls for formal educational contexts to implement effective environmental proposals which nurture action competence. The aim of this paper is to examine the educational proposals in formal contexts that have been published in the two research journals of greatest impact on Environmental Education during the period 2008–2013, and to analyse how they contribute to the development of action competence. Special attention is paid to research (i) based on real participation by students; (ii) promotes reflection on the complexity of environmental issues; (iii) facilitates critical thinking; (iv) encourages autonomous and responsible decision-making and (v) involves communities. Our results show that these approaches can help improve the development of action-focused environmental education and bring to light a series of challenges for future research.     

Current Concerns in Validity Theory

We are at the end of the first century of work on models of educational and psychological measurement and into a new millennium. This certainly seems like an appropriate time for looking backward and looking forward in assessment. Furthermore, a new edition of the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 1999) has been published, and the previous editions of the Standards have served as benchmarks in the development of measurement theory.
This backward glance will be just that, a glance. After a brief historical review focusing mainly on construct validity, the current state of validity theory will be summarized, with an emphasis on the role of arguments in validation. Then how an argument-based approach might be applied will be examined in regards to two issues in validity theory: the distinction between performance-based and theory-based interpretations, and the role of consequences in validation.