Comprehension processes and outcomes with refutation and expository texts and their contribution to learning

The study compared the comprehension processes and outcomes obtained with refutation and expository text and their association with learning outcomes. After a knowledge pretest, undergraduate students read an extended expository text or a corresponding refutation text that addressed three potential misconceptions about the scientific concept of energy. Think-aloud, cued recall, and posttest data indicated that the positive impact of refutation text was more associated with comprehension outcomes than processes. Refutation text did not influence comprehension processes but facilitated valid inference generation in recall and minimized the negative effects of distortions on learning. The findings suggest the timing of the refutation text effect to be later, after reading, and its nature to be that of neutralizing the influence of any misconceptions on learning from text instead of changing them.     

Knowledge transfer in the context of refutation texts

In this study, we examined the conditions under which readers are able to transfer revised knowledge as a result of reading refutation texts (i.e. texts that explicitly state and refute a misconception). Across three experiments, participants read refutation texts that addressed socioscientific and nonsocioscientific issues as well as transfer texts that were designed to reactivate the misconceptions addressed in refutation texts. In Experiments 1 and 2, the results indicate that reading a refutation text reduces interference from the misconception as participants read the transfer texts in close temporal distance, even when the misconception is reactivated. In Experiment 3, the results indicate that participants reading refutation texts could not transfer revised knowledge when the temporal distance between refutation texts and transfer texts increased. Students’ performance on pretest and posttest questionnaires also suggest that reading the refutation texts facilitated knowledge revision prior to transfer. We discuss the findings in the context of the Knowledge Revision Components Framework.     

Refutation texts and argumentation for conceptual change: A winning or a redundant combination?

Effective instruction for conceptual change should aim to reduce the interference of irrelevant knowledge structures, as well as to improve sense-making of counterintuitive scientific notions. Refutation texts are designed to support such processes, yet evidence for its effect on individual conceptual change of robust, complex misconceptions has not been equivocal. In the present work, we examine whether effects of refutation text reading on conceptual change in biological evolution can be augmented with subsequent peer argumentation activities. Hundred undergraduates read a refutation text followed by either peer argumentation on erroneous worked-out solutions or by standard, individual problem solving. Control group subjects read an expository text followed by individual problem solving. Results showed strong effects for the refutation text. Surprisingly, subsequent peer argumentation did not further improve learning gains after refutation text reading. Dialogue protocols analyses showed that gaining dyads were more likely to be symmetrical and to discuss core conceptual principles.     

Learning from refutation texts about scientific topics with analogical and causal explanations

Previous research has suggested that refutation texts are effective in facilitating learning and revision of misconceptions and that explanations are an essential component in their efficacy. In this study, we investigated the extent to which reading refutation texts featuring an analogy as an explanatory tool rather than a causal explanation results in different encoding processes during reading, belief in misconceptions, and confidence in beliefs. Using a think-aloud methodology, we found that a higher proportion of text-based inferences was associated with analogy texts than with non-analogy texts, and a higher proportion of knowledge-based inferences was associated with non-analogy than with analogy texts. Contrary to our hypotheses, no significant differences were found in belief in misconceptions and confidence outcomes between the text conditions. We discuss the implications of these findings in light of previous research suggesting that analogies improve learning outcomes.     

Effects of two combined methods on the teaching of basic astronomy concepts

The authors mainly aimed to investigate the following question: Are there any significant effects of the first combined method of a conceptual change approach with refutation text, worksheets, and activities with respect to the second combined method of a conceptual change approach with conceptual texts, presentations, and activities on students' misconceptions and achievement on a 3-tier posttest score measuring Grade 7 basic astronomy concepts when independent variables are controlled? There was a statistically significant effect of the first combined method with respect to the second method at the medium effect size on both misconception scores and achievement scores. This finding clearly demonstrates that use of the first combined method, which included refutation texts with worksheets, eliminated the students' misconceptions and increased their achievement. The second combined method also increased the students' achievement, but almost 40% of their misconceptions remained.     

A plausible connection: Models examining the relations between evaluation,plausibility, and the refutation text effect

Students are often asked to make evaluations of scientific explanations, which may involve judgments about the plausibility of competing alternatives. We examined undergraduate students' critical evaluations and plausibility perceptions of climate change when reading two different types of text: expository and refutation. Our findings show that greater critical evaluation and higher plausibility related to more knowledge after reading, but only with the refutation text. Furthermore, we found that greater plausibility had a stronger effect on knowledge after reading the refutation text, whereas greater background knowledge had a stronger effect on knowledge after reading the expository text. We also examined changes in students' plausibility and knowledge. There was significant changes in plausibility and knowledge with the refutation text, but no significant change in either variable with the expository text. These results suggest that evaluations and judgments about plausibility may be factors contributing to the refutation effect and knowledge reconstruction.     

Refutations in science texts lead to hypercorrection of misconceptions held with high confidence

Misconceptions about science are often not corrected during study when they are held with high confidence. However, when corrective feedback co-activates a misconception together with the correct conception, this feedback may surprise the learner and draw attention, especially when the misconceptions are held with high confidence. Therefore, high-confidence misconceptions might be more likely to be corrected than low-confidence misconceptions. The present study investigates whether this hypercorrection effect occurs when students read science texts. Effects of two text formats were compared: Standard texts that presented factual information, and refutation texts that explicitly addressed misconceptions and refuted them before presenting factual information. Eighth grade adolescents (N = 114) took a pre-reading test that included 16 common misconceptions about science concepts, rated their confidence in correctness of their response to the pre-reading questions, read 16 texts about the science concepts, and finally took a post-test which included both true/false and open-ended test questions. Analyses of post-test responses show that reading refutation texts causes hypercorrection: Learners more often corrected high-confidence misconceptions after reading refutation texts than after reading standard texts, whereas low-confidence misconceptions did not benefit from reading refutation texts. These outcomes suggest that people are more surprised when they find out a confidently held misconception is incorrect, which may encourage them to pay more attention to the feedback and the refutation. Moreover, correction of high-confidence misconceptions was more apparent on the true/false test responses than on the open-ended test, suggesting that additional interventions may be needed to improve learners' accommodation of the correct information.     

The catcher in the lie: The role of emotions and epistemic judgments in changing students’ misconceptions and attitudes in a post-truth era

We extend previous theoretical and empirical work by examining the role that emotions and epistemic judgments play when learning from different refutation plus persuasive and expository plus persuasive texts. We examined how variations in messages designed to change misconceptions and attitudes about genetically modified foods (GMFs) might differentially impact the extent to which individuals engage in epistemic judgments; the emotions individuals experience during learning; and, how epistemic judgments and emotions might facilitate or constrain conceptual and attitudinal change. One hundred twenty-five undergraduate university students were randomly assigned to one of four text conditions: refutation plus positive persuasive text, refutation plus negative persuasive text, expository plus positive persuasive text, or expository plus negative persuasive text. Students were asked to think and emote out loud during learning to capture epistemic judgments and emotions as they occurred in real time. After the learning session, students also self-reported the emotions they experienced during learning. Results revealed that students who were given positive persuasive texts experienced more positive emotions (both intensity and frequency) during learning, whereas those who were given negative persuasive texts experienced more negative emotions (frequency) during learning. Students who were given positive persuasive texts engaged in more epistemic judgments and changed more misconceptions about GMFs compared to students in the other three text conditions. Finally, epistemic judgments were significant positive predictors of conceptual and attitudinal change, and both positive emotions and negative emotions predicted attitudinal change. Implications for theories of conceptual and attitudinal change are discussed.     

Using conceptual change theory to help preservice teachers understand dyslexia

Recently, many states passed laws requiring pre- and in-service teachers to receive professional development in dyslexia awareness. Even though misconceptions regarding dyslexia are widespread, there is a paucity of research on how to effectively remove misconceptions and replace them with accurate knowledge. The purpose of this study was to determine whether a researcher-created refutation text grounded in conceptual change theory could produce significant conceptual change in preservice teacher knowledge of dyslexia when compared with a control text about dyslexia (Dyslexia Basics, International Dyslexia Association; IDA, 2018). A sample of preservice teachers (n = 97) was randomly assigned to either the Dyslexia Basics text (n = 48) or the refutation text (n = 49). A one-way repeated ANOVA was used to identify if growth rates from pretest to posttest were differential across conditions. Results suggest that while both texts affect conceptions, the refutation text outperformed the Dyslexia Basics text (n = 97), η2 = 0.33. Effects were maintained at a delayed posttest (n = 75), η2 = 0.175. Interaction effects suggested that the amount of reading coursework did not moderate conceptual change. Implications for facilitating conceptual change of dyslexia will be discussed.     

Reader and text factors in reading comprehension processes

The effects of epistemic beliefs and text structure on cognitive processes during comprehension of scientific texts were investigated. On‐line processes were measured using think‐aloud (Experiment 1) and reading time (Experiment 2) methodologies. Measures of off‐line comprehension, prior knowledge and epistemic beliefs were obtained. Results indicated that readers adjust their processing as a function of the interaction between epistemic beliefs and text structure. Readers with misconceptions and more sophisticated epistemic beliefs engage in conceptual change processes, but only when reading refutation texts. Results also showed that memory for text is not affected by differences in epistemic beliefs or text structure. These findings contribute to our understanding of the relations among factors associated with text comprehension and have implications for theories of conceptual change.     

Is it the Earth that turns or the Sun that goes behind the mountains? Students’ misconceptions about the day/night cycle after reading a science text

ABSTRACT

The present research tested the hypothesis that the reading of science text can create new misconceptions in students with incongruent prior knowledge, and that these new misconceptions will be similar to the fragmented and synthetic conceptions obtained in prior developmental research. Ninety-nine third- and fifth-grade children read and recalled one of two texts that provided scientific or phenomenal explanations of the day/night cycle. All the participants gave explanations of the phenomenon in question prior to reading one of the texts and after they read it. The results showed that the participants who provided explanations of the day/night cycle at pretest incongruent with the scientific explanation recalled less information and generated more invalid inferences. An analysis of the participants’ posttest explanations indicated that these readers formed new misconceptions similar to the fragmented and synthetic conceptions obtained in developmental research. The implications of the above for text comprehension and science education research are discussed.     

Confidence in prior knowledge,self-efficacy,interest and prior knowledge: Influences on conceptual change

This study explored how confidence in prior knowledge, self-efficacy, interest, and prior knowledge interact in conceptual change learning. One hundred and sixteen college students completed an assessment of confidence in prior knowledge, self-efficacy, interest, prior scientific understanding, and prior misconceptions before reading a refutation text on seasonal change. Students’ misconceptions and scientific understanding of seasonal change was then assessed before and after reading a refutation text, and again at a two week delayed posttest. Three profiles of students emerged based on their confidence in prior knowledge, self-efficacy, interest, prior scientific understanding, and prior misconceptions. The profiles included: (1) Low (low confidence, self-efficacy, interest, and prior scientific understanding and high prior misconceptions), (2) mixed (high confidence, self-efficacy, and interest, but low prior scientific understanding and high prior misconceptions), and (3) high (high confidence, self-efficacy, interest, and prior scientific understanding and low prior misconceptions). Results indicated that the mixed profile appeared to be most productive for conceptual change and that learner characteristics most productive for conceptual change learning may differ from those most productive in other learning situations.     

REFUTATION TEXT IN SCIENCE EDUCATION: A REVIEW OF TWO DECADES OF RESEARCH

As people attempt to make sense of the world, they develop personal knowledge structures. These structures often contain misconceptions—inaccurate or incomplete information—that are highly resistant to change because existing knowledge networks must be restructured to accommodate counterintuitive information in a process known as conceptual change. Since textbooks are the dominant resource for science instruction in most classrooms, text-based methods of facilitating conceptual change need to be examined. Since the mid-1980 s, researchers have investigated the conceptual change potential of refutation text, a text structure that includes elements of argumentation and that has been described as one of the most effective text-based means for modifying readers’ misconceptions. In this paper, twenty years of refutation text research in science and reading education is reviewed and then a secondary analysis of those results is conducted to explore developmental aspects of the efficacy of refutation text. Although a developmental relationship was not revealed, two decades of research indicate that reading refutation text rather than traditional expository text is more likely to result in conceptual change.     

How generalization inferences are constructed in expository text comprehension

Three questions regarding adult readers’ processing of generalization inferences (conceptually broad statements that subsume several specific statements) are investigated. College students (N = 193) read expository texts containing target statements that were consistent, inconsistent, or off-topic in relation to a generalization implied by one paragraph. Reading times were faster for consistent than inconsistent statements and faster for inconsistent than off-topic statements, indicating adult readers construct generalization inferences online during initial reading of a text and that the inference they construct is relatively narrow in scope. This pattern of faster reading time for consistent sentences occurred under different reading goals, suggesting generalization inferences are a pervasive component of expository text comprehension.     

Refutation texts enhance spontaneous transfer of knowledge

In this study, we investigated whether refutation texts (i.e., texts that explicitly state and refute a misconception) facilitate spontaneous transfer of revised knowledge to new situations. In Experiments 1 and 2, students read refutation, transfer, and non-refutation texts. Transfer texts were either preceded by refutation (Experiment 1) or non-refutation texts (Experiment 2). In both experiments, comprehension of the transfer texts required activation and use of the correct belief. Each text contained a target sentence that was consistent with the correct belief. In both experiments, reading times of the target sentences were collected and compared to provide an implicit measure of transfer. Additionally, a transfer problem test was also administered after reading the texts to assess transfer in a more explicit way. The results revealed that refutation texts are more effective in facilitating revision and spontaneous transfer of revised knowledge than non-refutation texts. These results add to the growing body of evidence for the applicability of using refutation texts in revising misconceptions.     

What predicts adult readers’ understanding of STEM texts?

The current study examined the relations among key variables that underlie reading comprehension of expository science texts in a diverse population of adult native English readers. Using Mechanical Turk to sample a range of adult readers, the study also examined the effect of text presentation on readers’ comprehension and knowledge structure established after reading. In Study 1, ratings of situational interest, select reading background variables, and select measures of readers’ knowledge structure accounted for significant variance in comprehension. In Study 2, the knowledge structure metrics of primacy, recency, and node degree as well as several text ratings were found to be comparable across text presentation formats. Participants who read the text sentence-by-sentence obtained higher scores on measures of comprehension and provided higher ratings of situational interest than those who received the whole paragraph text at once. Knowledge structure measures for the sentence-by-sentence and paragraph formats were similar (68% overlap). We discuss implications for future research examining factors that underlie the successful comprehension of science texts.     

Students’ genre expectations and the effects of text cohesion on reading comprehension

This study raises the question what makes school texts comprehensible by analyzing whether students’ genre expectations about literary or expository texts moderate the impact of different forms of text cohesion on reading comprehension, even when the texts are similar regarding their genre. 754 students (Grade 9) from comprehensive schools read one of four text versions with similar content, but different degrees of local and global text cohesion. The four more or less cohesive texts were introduced as literary texts (part of a story) or as expository texts (newspaper article), although the different genres were only purported and the texts contained both literary and expository passages. Reading comprehension was assessed with multiple-choice-items, semi-open, and open-ended questions. Results demonstrate that global cohesion was profitable for reading comprehension with expository expectations, but not with literary ones. Local text cohesion and both forms of cohesion in combination did not interact with students’ genre expectations and had no main effect on comprehension. When students reading skills and prior knowledge were considered, the interaction was still apparent. Moreover, students with lower levels of reading skills tended to profit especially from texts with global cohesion, whereas the readers with higher reading skills achieved equal means in reading comprehension irrespective of the degree of global text cohesion. The findings are discussed with respect to theoretical aspects of text–reader-interactions, cognitive and emotional components of genre expectations, and the composition and instruction of comprehensible school texts.     

Refutation texts: Implying the refutation of a scientific misconception can facilitate knowledge revision

Refutation texts facilitate knowledge revision by placing science misconceptions in the foreground. However, in some situations, repeating incorrect information can work against the desired goal of correcting misconceptions, or can spread misinformation to new audiences. Thus, our goal was to examine whether merely implying the existence of a misconception, without explicitly stating the incorrect information, is sufficient to facilitate knowledge revision from a text. Undergraduate participants who expressed a common physics misconception read one of three passages about the issue, including a correct explanation of the situation. The passages differed in whether the refutation of the misconception was explicitly stated, implied by a warning phrase, or not referred to at all. We found that participants were less likely to express the misconception when they were questioned about the topic after reading the passage with the explicit refutation or with the warning phrase. Furthermore, the current results indicate that refutations of misconceptions can influence knowledge revision in ways that extended beyond the details of the original learning episode, even when they are only implied by a warning phrase. However, it remains unclear whether implied refutations of misconceptions can endure across a delay in time. These findings have potential implications for optimizing science texts to effectively address misconceptions.     

Do drawing tasks improve monitoring and control during learning from text?

In two experiments it was investigated how drawing as a monitoring task affects self-regulated learning and cognitive load. To this end, participants (Exp. 1: N = 73, Exp. 2: N = 69) were randomly assigned to one of two conditions. In the experimental condition, students were asked to read an expository text on the formation of polar lights consisting of five paragraphs, whereby, after each paragraph, they had to create a drawing of the text's content. In the control condition, students read the same text, but performed no drawing task. In both conditions, students had to give judgments of learning (JoLs) after each paragraph and after reading the whole text as well as rate their cognitive load. Then, they were asked to select paragraphs for restudy. In Experiment 1, participants continued with an assessment of their learning outcomes immediately after their restudy selection, whereas in Experiment 2 they were first given the opportunity to actually restudy the selected paragraphs before working on the posttest. Results of both experiments indicate that JoLs rather than cognitive load predicted posttest performance. Moreover, students in the drawing condition compared with the control condition exhibited more accurate (relative) monitoring in Experiment 1 in that their JoLs were more strongly related to performance. Moreover, JoLs predicted students' restudy decisions in both experiments; however, this effect was by-and-large independent of whether they had to draw. Overall, results hint towards the potential of drawing to support metacognitive monitoring.     

Processing of expository and narrative texts by low- and high-comprehending children

The present study investigated comprehension processes and strategy use of second-grade low- and high-comprehending readers when reading expository and narrative texts for comprehension. Results from think-aloud protocols indicated that text genre affected the way the readers processed the texts. When reading narrative texts they made more text-based and knowledge-based inferences, and when reading expository texts they made more comments and asked more questions, but also made a higher number of invalid knowledge-based inferences. Furthermore, low- and high-comprehending readers did not differ in the patterns of text-processing strategies used: all readers used a variety of comprehension strategies, ranging from literal repetitions to elaborate knowledge-based inferences. There was one exception: for expository texts, low-comprehending readers generated a higher number of inaccurate elaborative and predictive inferences. Finally, the results confirmed and extended prior research by showing that low-comprehending readers can be classified either as readers who construct a limited mental representation that mainly reflects the literal meaning of the text (struggling paraphrasers), or as readers who attempt to enrich their mental representation by generating elaborative and predictive inferences (struggling elaborators). A similar dichotomy was observed for high-comprehending readers.