What can evidence-use in practice learn from evidence-use in policy?

Abstract

Background: This paper approaches evidence-informed practice from the perspective of evidence-informed policy-making. Using the findings of a recent study of evidence-use by educational policy-makers to raise questions about evidence-use by educational practitioners, it seeks to explore what such a study might tell us about how to understand and improve evidence-use by educational practitioners.

Purpose: The paper aims, therefore, to identify potential connections, shared insights and common issues between evidence-use in policy and evidence-use in practice. It does this by focusing on two specific areas: the nature of the evidence (i.e. what evidence is used) and the nature of the use (i.e. how evidence is used). The paper outlines what was found about each of these aspects of evidence-use in policy, and then considers what questions and issues these findings might raise for evidence-use in educational practice.

Sample: The empirical study on which this paper is based was an in-depth study of the use of evidence within educational policy development in Australia. It focused on the development of three specific education policies within one Australian state education department and involved interviews with 25 policy-makers who were actively involved in the development of these policies.

Design and methods: The policy-based study involved the following data collection processes: (i) in-depth semi-structured interviews with 25 policy-makers who were involved in the development of the selected policies; (ii) documentary analysis of policy documents, background research reports and other relevant papers relating to the selected policies; (iii) unstructured observation (where possible) of meetings and events connected with the development of the selected policies; and (iv) feedback from 40 wider policy staff who took part in a verification workshop to discuss the project’s emerging findings.

Findings: Drawing on the findings from the original policy study, two areas of potential connection to evidence-use in practice are explored. First, in relation to ‘varieties of evidence and uses’, the negotiation of diverse evidence types and the potential for using evidence in multiple and varied ways appear to be features of evidence-use that are common to educational policy-makers as well as educational practitioners. Secondly, in relation to ‘narrowness of evidence sources’, there is potential for both policy-makers and practitioners to use a narrow (rather than broad) selection of evidence, due to a tendency to work with certain evidence types as a starting point (e.g. performance data) and a tendency to draw on certain evidence sources more frequently (e.g. well-known, familiar research sources).

Conclusions: This paper emphasises: (i) the need for more integrated (or joined-up) understandings of evidence-use across contexts of practice and contexts of policy; (ii) the importance of continued efforts to understand and represent evidence-use more effectively within educational practices; and (iii) the value of paying careful attention to the quality and qualities of evidence-use within and across the different settings of educational practice and policy.     

Elements affecting the development of professional learning communities in schools

This article focuses on the development of professional learning communities (PLCs), which are communities within schools, composed of voluntary participating teachers facilitated by school principals with a specific task to accomplish as part of a larger innovation project. Four PLCs were observed during 3 years by using questionnaires and participatory research. The questionnaires revealed that PLCs differed in their group characteristics, collective learning processes and outcomes. Through participatory research, we explored seven elements affecting the development of PLCs, namely, task perceptions, group composition, tensions between roles, beliefs about alignment, reflective dialogues, socialisation and ownership. Beliefs about alignment, ownership and socialisation had sufficient impact on the development of the PLCs. A case study including two contrasting PLCs indicated interrelations between task perceptions and ownership by members and between ownership and socialisation activities. Regarding implications, this research suggests to explicitly create and facilitate reflective dialogues and ownership over time for PLCs to flourish.     

Inspecting a picture before reading affects attentional processing but not comprehension

Abstract

This study investigated whether presenting a picture before reading can encourage situation-model construction. We compared two conditions (n?= 30) which differed in whether a picture of the initial situation described in a narrative text was presented before reading (i.e. pictorial-support condition) or not (i.e. no-picture condition). Situation-model construction was measured using both process- and product-oriented measures. Eye-tracking data indicated online resource allocation to the different levels of text representation: surface, textbase, and situation model. Literal text questions and inference questions were used as an offline indication of textbase and situation-model processing, respectively. The results showed that a picture presented before reading led to a redistribution of processing resources during reading, evidenced by a shift from textbase to situation-model processing. This attentional shift did not translate into higher comprehension scores. The results were interpreted in line with multimedia learning theories suggesting pictures can serve as a mental scaffold for situation-model construction.     

Infant Attention Is Dynamically Modulated With Changing Arousal Levels

Traditional accounts of developing attention and cognition emphasize static individual differences in information encoding; however, work from Aston‐Jones et al. suggests that looking behavior may be dynamically influenced by autonomic arousal. To test this model, a 20‐min testing battery constituting mixed photos and cartoon clips was shown to 53 typical 12‐month‐olds. Look duration was recorded to index attention, and continuous changes in arousal were tracked by measuring heart rate, electrodermal activity, and movement levels. Across three analyses, we found that continuous changes in arousal tracked simultaneous changes in attention measures, as predicted by the Aston‐Jones model. It was also found that changes in arousal tended to precede (occur before) subsequent changes in attention. Implications of these findings are discussed.     

The COVID-19 epidemic in Brazil: how statistics education may contribute to unravel the reality behind the charts

Educational Studies in Mathematics - The world is now facing the most severe health, social, and economic event of the last hundred years, which has made the need to acquire statistical thinking to...     

Constructing Scientific Explanations: a System of Analysis for Students’ Explanations

Research in Science Education - This article describes a system of analysis aimed at characterizing students’ scientific explanations. Science education literature and reform documents have...     

Same,Similar, or Something Completely Different? Calibrating Student Surveys and Classroom Observations of Teaching Quality Onto a Common Metric

Using item response theory, this study explores whether student survey and classroom observation items can be calibrated onto a common metric of teaching quality. The data comprises 269 lessons of 141 teachers that were scored on the International Comparative Analysis of Learning and Teaching (ICALT) observation instrument and the My Teacher student survey. Using Rasch model concurrent calibration, items from both instruments were calibrated onto a common one‐dimensional metric of teaching quality. Most items were found to fit the model. Challenges pertain mainly to items measuring teaching students learning strategies and differentiation. Explanations for these difficulties are discussed.     

Pre-analytical mysteries: A case of severe hypervitaminosis D and mild hypercalcaemia

We describe a case of severe hypervitaminosis D and mild hypercalcaemia in a 68-year-old woman who presented with fatigue and weight loss. Her 25-hydroxy vitamin D (25OHD) was > 400 nmol/L (50-150) and corrected serum calcium was 2.83 mmol/L (2.1-2.6). Her intact parathyroid hormone (PTH) was 4.9 pmol/L (2.0-9.5). Further investigation revealed an IgM kappa paraprotein, and a bone marrow aspirate confirmed a diagnosis of lymphoplasmacytic lymphoma/Waldenstrom’s macroglobulinemia (LPL/WM). As the vitamin D level was discordant with the patient’s other results and presentation, the presence of an assay interferent was suspected. A 1-in-2 dilution of the sample returned a 25OHD result of 84 nmol/L in keeping with the presence of an interferent. Testing for rheumatoid factor was negative. The sample was treated with an antibody blocking reagent (Scantibodies) and results were not consistent with heterophile antibody interference. The sample was then analysed using liquid chromatography tandem mass spectrometry (LC-MS/MS), which returned a 25OHD result of 82 nmol/L. Testing on an alternative immunoassay platform produced a 25OHD result of 75 nmol/L. Reapeted testing on the original platform following reduction of the monoclonal paraprotein with chemotherapy, returned a result of 64 nmol/L. The patient’s mild hypercalcaemia persisted following resolution of the monoclonal paraprotein, in keeping with a diagnosis of primary hyperparathyroidism. This case highlights the potential for paraproteins to cause assay interference, and the importance of considering interference when results are incongruous with the clinical presentation.     

Social media monitoring: Responsive governance in the shadow of surveillance?

Social media monitoring is gradually becoming a common practice in public organizations in the Netherlands. The main purposes of social media monitoring are strategic control and responsiveness. Social media monitoring poses normative questions in terms of transparency, accountability and privacy. We investigate practices of social media monitoring in four Dutch public organizations. Policy departments seem to be more strongly orientated towards monitoring, whereas organizations involved in policy implementation seem to be more inclined to progress to webcare. The paper argues for more transparency on social media monitoring.