Null Effects of Perceptual Disfluency on Learning Outcomes in a Text-Based Educational Context: a Meta-analysis

Recent research in a text-based educational context has demonstrated a seemingly paradoxical disfluency effect in reading, namely that learning with hard-to-read (disfluent) materials helps learners recall more details than learning with easy-to-read (fluent) materials. Many follow-up studies using a variety of participants, learning materials, and experimental designs have been conducted to verify the effects of disfluency manipulation on recall, transfer, judgments of learning, and learning time. However, a number of them have failed to replicate this effect and the mixed findings bring into question the generality of the disfluency effect with respect to learning. In this meta-analysis, we tested the overall effect of perceptual disfluency on learning with texts, as well as moderators of this effect, based on 25 empirical articles involving 3135 participants. Results showed that overall, there was no effect of perceptual disfluency on recall (d?=???0.01) or transfer (d?=?0.03), but perceptual disfluency did reduce participants’ judgments of learning (d?=???0.43) and increase learning time (d?=?0.52). Tests of moderation focused on the most commonly studied dependent measure, namely recall. There was no evidence that characteristics of the participants, learning material, or experimental design moderated the effect of perceptual disfluency on recall. In general, though perceptual disfluency can be used as an effective metacognitive cue to reduce judgments of learning and increase learning time, there is not enough evidence to show that it either stimulates analytic processing or increases extraneous cognitive load.     

Effects of disfluency and test expectancy on learning with text

Do students learn better with texts that are Open image in new window (i.e., disfluent)? Previous research yielded discrepant findings concerning this question. To clarify these discrepancies, the present study aimed at identifying a boundary condition that determines when disfluent text is, and is not, beneficial to learning. This boundary condition is knowledge about whether a test will follow (high test expectancy) versus not (low test expectancy). Participants with high test expectancy may already engage in effortful processing, so that making text harder-to-read (disfluent) might not change their processing mode any further. Thus, particularly when no test is expected, disfluency is supposed to exert its beneficial effect. This assumption was tested in a 2?×?2 design (N?=?97) with text legibility (fluent vs. disfluent) and test expectancy (low vs. high) as factors, and learning outcomes (retention, transfer) and learning times as main dependent variables. Results revealed that high test expectancy led to better learning outcomes (for retention and transfer), but disfluent text did not. Unlike expected, there was no interaction between the two factors. Moreover, both high test expectancy and disfluency led to longer learning times, resulting in a lower efficiency when learning with disfluent compared to fluent text. Hence, the present results further question the stability and generalizability of a positive disfluency effect on learning, because only high test expectancy – but not disfluency - stimulated better learning through more effortful processing the way it was supposed to.     

Context modulation of learned attention deployment

In three experiments, we investigated the contextual control of attention in human discrimination learning. In each experiment, participants initially received discrimination training in which the cues from Dimension A were relevant in Context 1 but irrelevant in Context 2, whereas the cues from Dimension B were irrelevant in Context 1 but relevant in Context 2. In Experiment 1, the same cues from each dimension were used in Contexts 1 and 2, whereas in Experiments 2 and 3, the cues from each dimension were changed across contexts. In each experiment, participants were subsequently shifted to a transfer discrimination involving novel cues from either dimension, to assess the contextual control of attention. In Experiment 1, measures of eye gaze during the transfer discrimination revealed that Dimension A received more attention than Dimension B in Context 1, whereas the reverse occurred in Context 2. Corresponding results indicating the contextual control of attention were found in Experiments 2 and 3, in which we used the speed of learning (associability) as an indirect marker of learned attentional changes. Implications of our results for current theories of learning and attention are discussed.     

The effect of encoding conditions on learning in the prototype distortion task

The prototype distortion task demonstrates that it is possible to learn about a category of physically similar stimuli through mere observation. However, there have been few attempts to test whether different encoding conditions affect learning in this task. This study compared prototypicality gradients produced under incidental learning conditions in which participants performed a visual search task, with those produced under intentional learning conditions in which participants were required to memorize the stimuli. Experiment 1 showed that similar prototypicality gradients could be obtained for category endorsement and familiarity ratings, but also found (weaker) prototypicality gradients in the absence of exposure. In Experiments 2 and 3, memorization was found to strengthen prototypicality gradients in familiarity ratings in comparison to visual search, but there were no group differences in participants’ ability to discriminate between novel and presented exemplars. Although the Search groups in Experiments 2 and 3 produced prototypicality gradients, they were no different in magnitude to those produced in the absence of stimulus exposure in Experiment 1, suggesting that incidental learning during visual search was not conducive to producing prototypicality gradients. This study suggests that learning in the prototype distortion task is not implicit in the sense of resulting automatically from exposure, is affected by the nature of encoding, and should be considered in light of potential learning-at-test effects.     

Instructor fluency leads to higher confidence in learning,but not better learning

Students’ judgements of their own learning often exceed their knowledge on a given topic. One source of this pervasive overconfidence is fluency, the perceived ease with which information is acquired. Though effects of fluency on metacognitive judgments have been explored by manipulating relatively simple stimuli such as font style, few studies have explored the effects of fluency on more complex forms of learning encountered in educational settings, such as learning from lectures. The present study manipulated the fluency of a 31-min video-recorded lecture, and measured its effects on both perceived and actual learning. In the fluent condition, the instructor used non-verbal gestures, voice dynamics, mobility about the space, and appropriate pauses. In the disfluent condition, the same instructor read directly from notes, hunched over a podium, rarely made eye contact, used few non-verbal gestures, spoke in monotone pitch, and took irregular and awkward pauses. Though participants rated the fluent instructor significantly higher than the disfluent instructor on measures of teaching effectiveness and estimated that they had learned more of the material, actual learning between the two groups did not differ as assessed by a memory test over the lecture contents given immediately (Experiment 1) or after a 1-day delay (Experiment 2). This counterintuitive result reveals an “illusion of learning” due to fluency in lecture-based learning, a very common form of instruction.     

Metacognition and the spacing effect: the role of repetition, feedback, and instruction on judgments of learning for massed and spaced rehearsal

Although memory performance benefits from the spacing of information at encoding, judgments of learning (JOLs) are often not sensitive to the benefits of spacing. The present research examines how practice, feedback, and instruction influence JOLs for spaced and massed items. In Experiment 1, in which JOLs were made after the presentation of each item and participants were given multiple study-test cycles, JOLs were strongly influenced by the repetition of the items, but there was little difference in JOLs for massed versus spaced items. A similar effect was shown in Experiments 2 and 3, in which participants scored their own recall performance and were given feedback, although participants did learn to assign higher JOLs to spaced items with task experience. In Experiment 4, after participants were given direct instruction about the benefits of spacing, they showed a greater difference for JOLs of spaced vs massed items, but their JOLs still underestimated their recall for spaced items. Although spacing effects are very robust and have important implications for memory and education, people often underestimate the benefits of spaced repetition when learning, possibly due to the reliance on processing fluency during study and attending to repetition, and not taking into account the beneficial aspects of study schedule.     

Further boundary conditions for the effects of perceptual disfluency on judgments of learning

The experience of fluency while learning might bias students’ metacognitive judgments of learning (JOLs) and impair the efficacy of their study behaviors. In the present experiments, we examined whether perceptual fluency affects JOLs (1) when people only experience one level of fluency, (2) when item relatedness is also available as a cue, and (3) across study-test trials. Participants studied a list of paired associates over two study-test trials and made JOLs for each item after studying it. We varied the perceptual fluency of the memory materials by making the font easy (fluent) or difficult (disfluent) to read. We also varied whether we manipulated the perceptual fluency of the items between-participants or within-participants and whether other memory factors—item relatedness and study time—were available for participants to use to inform their JOLs. We were only able to obtain effects of perceptual fluency on JOLs when we manipulated fluency within-participants and eliminated item relatedness as a cue for JOLs. The present results indicate that some effects of perceptual fluency on JOLs are not robust and might only occur under limited—and somewhat contrived—conditions. Therefore, these effects might be unlikely to bias students’ JOLs in actual learning situations.     

What moderates the accuracy of ease of learning judgments?

When people begin to study new material, they may first judge how difficult it will be to learn. Surprisingly, these ease of learning (EOL) judgments have received little attention by metacognitive researchers so far. The aim of this study was to systematically investigate how well EOL judgments can predict actual learning, and what factors may moderate their relative accuracy. In three experiments, undergraduate psychology students made EOL judgments on, then studied, and were tested on, lists of word-pairs (e.g., sun – warm). In Experiment 1, the Goodman-Kruskal gamma (G) correlations showed that EOL judgments were accurate (G = .74) when items varied enough in difficulty to allow for proper discrimination between them, but were less accurate (G = .21) when variation was smaller. Furthermore, in Experiment 1 and 3, we showed that the relative accuracy was reliably higher when the EOL judgments were correlated with a binary criterion (i.e., if an item was recalled or not on a test), compared with a trials-to-learn criterion (i.e., how many study and test trials were needed to recall an item). In addition, Experiments 2 and 3 indicate other factors to be non-influential for EOL accuracy, such as the task used to measure the EOL judgments, and whether items were judged sequentially (i.e., one item at a time in isolation from the other items) or simultaneously (i.e., each item was judged while having access to all other items). To conclude, EOL judgments can be highly accurate (G = .74) and may thus be of strategic importance for learning. Further avenues for research are discussed.     

Student perception of assessment practices: towards ‘no loser’ classrooms for all students in the ethnic minority schools in Hong Kong

As part of a wide-scale education reform, Hong Kong schools have been focusing on the creation of ‘no loser’ classrooms that support learning for all students (Education Commission 2000). This article examined both groups of ethnic minority and Chinese students’ perception of assessment practices and the extent to which classroom practice is consistent with preferred assessment practices. The 11 items of assessment practices list, developed by Brown et al. (2009a), were used to investigate the perceptions of 1,518 student respondents from 15 primary and secondary schools, in which a large number of ethnic minority students were accommodated. A confirmatory factor analysis showed that the respondents in the group from secondary schools viewed teacher-dominated assessment as the most important assessment practice in the model examined (Brown et al. Learning and Instruction, 19(2), 97–111, 2009b) whereas those in the primary group considered teacher-student interactive assessment as the most important practice. Also, three perceptions of assessment practices of ethnic minority students were confirmed: teacher-dominated, student-centred and teacher-student interactive. Amongst them, the most preferred one was the teacher-student interaction assessment practice. Finally, the implications of the creation of a no loser classroom for all students are discussed.     

Stimulus preexposure speeds or slows subsequent acquisition of associative learning depending on learning test procedures and response measure

Prior exposure to a conditioned stimulus (CS) typically results in latent inhibition—slower acquisition of associative learning about that stimulus in subsequent training. Here, we found that CS preexposure had different effects on the appetitive conditioning of rats with a sucrose unconditioned stimulus (US) depending on training test procedures, the similarity of preexposure and training procedures, and the choice of response measure. Preexposure to a visual or an auditory stimulus produced facilitation of acquisition of food-cup-directed responding when both of those cues were (separately) paired with sucrose delivery in the training test (Experiments 1 and 3). By contrast, the same preexposure procedure resulted in latent inhibition of food-cup learning if the second stimulus in the test phase was of the same modality as the preexposed stimulus (Experiment 2). In Experiment 3, latent inhibition was enhanced if both phases included a single CS or both phases included both auditory and visual CSs, compared to treatments in which only one CS was presented in one phase but two CSs were presented in the other phase. In Experiment 4, preexposure of an auditory cue slowed subsequent learning about it if the context was salient but enhanced learning if the context was of weaker salience. Finally, a measure of general activity revealed latent inhibition after preexposure in all conditions in all 4 experiments. We discuss the results within several classes of latent inhibition theories, none of which provides a comprehensive account.     

Generalizing screen inferiority - does the medium,screen versus paper,affect performance even with brief tasks?

Screen inferiority in performance and metacognitive processes has been repeatedly found with text learning. Common explanations for screen inferiority relate to technological and physiological disadvantages associated with extensive reading on screen. However, recent studies point to lesser recruitment of mental effort on screen than on paper. Learning tasks involving a heavy reading burden confound technological and physiological media differences with potential media effects on recruitment of mental effort. The present study focused on media effects on effort recruitment. We examined whether screen inferiority remains even with a brief task that nevertheless requires effort recruitment. In two experiments, participants faced three short math problems that require systematic processing to solve correctly. We examined media effect on solving these problems, and the potential of disturbed perceptual fluency (i.e., disfluent versus fluent fonts) to induce effort investment. Overall, there were no performance differences between the media. However, when collecting confidence ratings, disfluency improved performance on screen and hindered it on paper. Only on paper confidence ratings were sensitive to performance differences associated with fluency, and resolution was better with the disfluent font than with the fluent font. Correspondingly, another sample reported on their preference of media for solving the problems. They expressed a clear reluctance to working on screen despite the task being brief. This preference is suggestive of reliable meta-metacognitive judgments reflecting the general lower quality of metacognitive processes on screen. The findings call for considering medium and presentation format effects on metacognitive processing when designing computerized environments, even for brief tasks.     

Removing but not adding elements of a context affects generalization of instrumental responses

Three experiments with rats investigated whether adding or removing elements of a context affects generalization of instrumental behavior. Each of the experiments used a free operant procedure. In Experiments 1 and 2, rats were trained to press a lever for food in a distinctive context. Then, transfer of lever pressing was tested in a context created either by adding an element to the context of initial acquisition or by removing one of the acquisition context’s elements. In Experiment 3, a similar generalization test was conducted after rats received acquisition and extinction within the same context. For Experiments 1 and 2, we observed that removing elements from the acquisition context disrupted acquisition performance, whereas the addition of elements to the context did not. Experiment 3 revealed that removing elements from but not adding elements to the original context improved extinction performance. Our results are consistent with an elemental view of context representation.     

The Value of Applied Research: Retrieval Practice Improves Classroom Learning and Recommendations from a Teacher, a Principal, and a Scientist

Over the course of a 5-year applied research project with more than 1,400 middle school students, evidence from a number of studies revealed that retrieval practice in authentic classroom settings improves long-term learning (Agarwal et al. 2009; McDaniel et al., Journal of Educational Psychology 103:399–414, 2011; McDaniel et al. 2012; Roediger et al., Journal of Experimental Psychology: Applied 17:382–395, 2011a). Retrieval practice, or the use of quizzes and exams to engage and enhance retrieval processes, has been widely established as an effective strategy for facilitating learning in laboratory settings (e.g., Roediger et al. 2011c). In this article, we review recent findings from applied research that demonstrate that retrieval practice enhances long-term classroom learning, delayed quizzes are particularly potent for retention, quizzes benefit students’ transfer to novel quiz items, and quizzes with feedback improve students’ learning and metacognitive awareness. In addition to generating evidence to support retrieval-based learning, these applied research studies also enhanced the professional development of the teachers, administrators, and scientists involved in the project. In this article, it is our hope that by sharing what we have learned from a variety of perspectives, applied scientific research in K-12 classrooms will continue to be explored and generated at local, state, and national levels, improving student learning and educational decision-making.     

Evaluating women's homemaking and volunteer work experiences for college credit

This project developed methods and materials to assist colleges in evaluating the competencies which women acquire from their nonmarket (volunteer work and homemaking) experiences. Competencies were identified through interviews and questionnaires of women's activities. Next an informal task analysis of each activity was conducted to develop a list of the competencies involved, the I Can lists. A twelve step counseling process, based on the use of the I Can lists, is described. The paper also discusses methods of dealing with faculty and administrative concerns about this type of experiential learning evaluation.The author wishes to thank Marlaine Lockheed and Abigal Harris for their assistance in this research.Paper presented at the conference on Continuing Education Programs for Women—Issues and Trends, Columbus, Ohio, May 12, 1978.     

Whose story is this? Discrepancy triggers readers’ attention to source information in short narratives

Three experiments investigated the role of source information (i.e., who said what) in readers’ comprehension of short informational texts. Based on the Discrepancy-Induced Source Comprehension assumption (Braasch, Rouet, Vibert, & Britt, 2012), we hypothesized that readers would be more likely to make use of source information when summarizing stories that included discrepant statements. Readers would also memorize source information more accurately. Experiments 1 and 2 found that American and French college students were more likely to refer to source information when they summarized news reports containing discrepant assertions. A detailed content analysis of the summaries also indicated that students use hedging and several other tactics to resolve contradictions. Experiment 3 replicated Braasch et al.’s finding that sources of discrepant stories were more likely to be recalled than sources of consistent stories. Experiment 3 also extended these findings using longer texts and a different reading task. Altogether the data support the Documents Model framework of multiple source comprehension.     

The effect of mindfulness on extinction and behavioral resurgence

In the present experiments, we investigated the effects of mindfulness on behavioral extinction and resurgence. Participants received instrumental training; either they received FI training (Experiment 1), or they were trained to emit high rates and low rates of response via exposure to a multiple VR yoked-VI schedule prior to exposure to a multiple FI FI schedule in order to alter their rates of responding learned during Experiment 2. Participants were then exposed to either a focused- (mindfulness) or an unfocused-attention induction task. All participants were finally exposed to an extinction schedule in order to determine whether a mindfulness induction task presented immediately prior to extinction training affected extinction (Experiment 1) and behavioral resurgence (Experiment 2). During the extinction phase, the rates of responding were higher in the control group than in the mindfulness group, indicating that the mindfulness group was more sensitive to the contingencies and, thus, their prior performance extinguished more readily (Experiment 1). Moreover, rates of response in the extinction components less precisely reflected previous training in the mindfulness group, suggesting less resurgence of past behaviors after the mindfulness induction (Experiment 2).     

Pedagogies of practice and opportunities to learn about classroom mathematics discussions

In this paper, we argue that to prepare pre-service teachers for doing complex work of teaching like leading classroom mathematics discussions requires an implementation of different pedagogies of teacher education in deliberate ways. In supporting our argument, we use two frameworks: one curricular and one pedagogical. The curricular framework is based on the work of Hammerness et al. (Preparing teachers for a changing world. What teachers should learn and be able to do. San Francisco, Jossey-Bass Educational Series, pp 358–388, 2005) outlining four main goals of teacher learning: a vision of practice, knowledge of students and content, dispositions for using this knowledge, and a repertoire of practices and tools. The pedagogical framework is based on the work of Grossman et al. (Teach Teach Theory Pract 15(2):273–289, 2009a; Teach Coll Record 111(9):2055–2100, 2009b) outlining three pedagogies of practice: representations, decompositions, and approximations of practice. We use the curricular framework to examine the opportunities for teacher learning that were afforded by these three different pedagogies of practice in a unit on leading classroom mathematics discussion in a secondary mathematics methods course. We use evidence from our analysis to show how the coordination of those pedagogies of practice is better than any one of them in addressing important goals for teacher learning about classroom discussions.     

Supporting Students’ Learning and Socioscientific Reasoning About Climate Change—the Effect of Computer-Based Concept Mapping Scaffolds

Climate change is one of the most challenging problems facing today’s global society (e.g., IPCC 2013). While climate change is a widely covered topic in the media, and abundant information is made available through the internet, the causes and consequences of climate change in its full complexity are difficult for individuals, especially non-scientists, to grasp. Science education is a field which can play a crucial role in fostering meaningful education of students to become climate literate citizens (e.g., NOAA 2009; Schreiner et al., 41, 3–50, 2005). If students are, at some point, to participate in societal discussions about the sustainable development of our planet, their learning with respect to such issues needs to be supported. This includes the ability to think critically, to cope with complex scientific evidence, which is often subject to ongoing inquiry, and to reach informed decisions on the basis of factual information as well as values-based considerations. The study presented in this paper focused on efforts to advance students in (1) their conceptual understanding about climate change and (2) their socioscientific reasoning and decision making regarding socioscientific issues in general. Although there is evidence that “knowledge” does not guarantee pro-environmental behavior (e.g. Schreiner et al., 41, 3–50, 2005; Skamp et al., 97(2), 191–217, 2013), conceptual, interdisciplinary understanding of climate change is an important prerequisite to change individuals’ attitudes towards climate change and thus to eventually foster climate literate citizens (e.g., Clark et al. 2013). In order to foster conceptual understanding and socioscientific reasoning, a computer-based learning environment with an embedded concept mapping tool was utilized to support senior high school students’ learning about climate change and possible solution strategies. The evaluation of the effect of different concept mapping scaffolds focused on the quality of student-generated concept maps, as well as on students’ test performance with respect to conceptual knowledge as well as socioscientific reasoning and socioscientific decision making.     

The transfer of social exclusion and inclusion functions through derived stimulus relations

Previous studies have found that social exclusion can cause distress to those excluded. One method used to study social exclusion is through a virtual ball-toss game known as Cyberball. In this game, participants may be excluded from or included in the ball-toss game and typically report lower feelings of self-esteem, control, belonging, and meaningful existence following exclusion. Experiments 1 and 2 sought to explore the transfer of feelings of exclusion and inclusion through stimulus equivalence classes. In both experiments, participants were trained to form two three-member equivalence classes (e.g., A1–B1, B1–C1; A2–B2, B2–C2) and were tested with novel stimulus combinations (A1–C1, C1–A1, A2–C2, C2–A2). Thereafter, participants were exposed to the Cyberball exclusion and inclusion games. In these games, one stimulus (C1) from one equivalence class was assigned as the Cyberball inclusion game name, whereas one stimulus (C2) from the other equivalence class was assigned as the Cyberball exclusion game name. In Experiment 2, participants were only exposed to the Cyberball exclusion game. During a subsequent transfer test, participants were asked to rate how included in or excluded from they thought they would be in other online games, corresponding to members of both equivalence classes. Participant reported that they felt they would be excluded from online games if the games were members of the same equivalence class as C2. In contrast, participants reported that they felt they would be included in online games if the games were members of the same equivalence class as C1. Results indicated the transfer of feelings of inclusion (Experiment 1) and feelings of exclusion (Experiments 1 and 2) through equivalence classes.