Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis

The signaling principle recommends emphasizing relevant aspects of a multimedia message by means of signals (e.g., color coding). We determined the effectiveness of signals that highlight correspondences between text and pictures as well as possible boundary conditions by means of a meta-analysis. To this end, 58 potentially relevant articles were identified in a comprehensive search. After rating the studies based on inclusion criteria and correcting for biases, 27 studies were included in the meta-analysis yielding 45 pairwise comparisons with N = 2464 participants. Domain-specific prior knowledge, pacing of the materials, pictorial format, mapping requirements, and distinctiveness of signals were coded as moderators. For transfer and comprehension performance a positive small-to-medium effect size (r = .17, 95% CI [0.11, 0.22]) favoring signaled multimedia material was found, which was moderated by prior knowledge. The findings support the effectiveness of the signaling principle in particular for learners with low prior knowledge.     

Learning by explaining orally or in written form? Text complexity matters

In this experiment, we examined whether linguistic text complexity affects effects of explaining modality on students’ learning. Students (N = 115) read a high-complex and a low-complex text. Additionally, they generated a written or an oral explanation to a fictious peer. A control group of students retrieved the content. For the low-complex text, we found no significant differences between conditions. For the high-complex text, oral explaining yielded better comprehension than writing explanations. The retrieval condition showed the lowest performance. Mediation analyses revealed that the effect of explaining modality while learning from the high-complex text was mediated by the personal references and the comprehensiveness of the generated explanations. Our findings suggest that the effect of explaining modality emerges when students are required to learn from difficult texts. Furthermore, they show that oral explaining is effective as, likely due to increases of social presence, it triggers distinct generative processes during explaining.     

Fostering multiple text comprehension: How metacognitive strategies and motivation moderate the text-belief consistency effect

Learners often have difficulties comprehending multiple texts about controversial scientific issues. In particular, learners with strong prior beliefs tend to construct a one-sided mental representation that is biased towards belief-consistent information (text-belief consistency effect). In the present study we examined the effectiveness of information of three metacognitive strategies tailored to strengthen the comprehension of belief-inconsistent information during multiple text comprehension. According to theories of self-regulated learning, knowledge about relevant metacognitive strategies improves comprehension only when learners are also motivated to use these strategies. These hypotheses were investigated in an experiment in which 85 participants read one belief-consistent and one belief-inconsistent text about a controversial scientific issue. Participants either received information about three metacognitive strategies or no additional information. In addition, participants’ motivation was manipulated by providing them with either negative or positive performance feedback or no feedback. As predicted, a text-belief consistency effect was found, which was eliminated by strengthening the situation model for the belief-inconsistent text only when learners received information about relevant metacognitive strategies and were motivated to use these strategies after positive performance feedback.     

Same topic,different genre: Elementary school children's mental representations of information embedded in narrative and expository texts

Using a sentence recognition task, we investigated whether elementary school children's (N = 92; M_age = 9.3 years, SD = 1.1 years) memory of the text surface, the textbase, and the situation model differed depending on whether the same information was embedded in an expository or a narrative text. Previous research with children that used narrative and expository texts dealing with different topics indicated beneficial effects narrative over expository texts regarding various indicators of processing on the levels of the textbase and the situation model. In contrast, our results did not indicate differences between narrative and expository texts for any of the levels of representation. Thus, the role of text topic in studies investigating the effect of genre on text comprehension should be investigated further.     

The interaction between textual structures and prior knowledge: Hypotheses, data and simulations

Our purpose was to compare the effect of two types of textual semantic coherence — causal and teleological — on the organization of the mental representation elaborated after reading by learners with different levels of prior knowledge. Beginners, Intermediates and Advanced in computer domain read either the causal or the teleological version of a text describing three functions of a text editor, then performed a cued recall and a recognition task. We assumed that Advanced learners build a mental representation of the domain organized in a hierarchical goal/sub-goals structure, whereas Beginners and Intermediates have a mental representation organized in a causal path. If this is so, the results should indicate a significant interaction between prior knowledge and the semantic coherence of the texts: for the Advanced learners, recall and recognition of the teleological text should be better, whereas for the Beginners and Intermediates, the reverse was expected. As we assumed, results indicated that a teleological organization of textual information facilitated the comprehension of Advanced participants while a temporal-causal organization facilitated the comprehension of Beginner and Intermediate participants. The Construction-Integration model of Kintsch (1988, 1998) was used to, simulate the recall results and to reproduce the effect of prior knowledge on the retrieval of textual information.     

A closer look at split visual attention in system- and self-paced instruction in multimedia learning

Two experiments examined visual attention distribution in learning from text and pictures. Participants watched a 16-step multimedia instruction on the formation of lightning. In Experiment 1 (N = 90) the instruction was system-paced (fast, medium, slow pace), while it was self-paced in Experiment 2 (N = 31). In both experiments the text modality was varied (written, spoken). During learning, the participants’ eye movements were recorded. Results from both experiments revealed that learners spent more time studying the visualizations with spoken text than those with written text. In written text conditions learners consistently started reading before alternating between text and visualization; moreover, they spent more time reading the text than inspecting the visualizations. While in Experiment 1 additional time that was made available in conditions with a slow or medium instruction pace was spent inspecting visualizations, in Experiment 2 longer learning times resulted from reading the text more intensively. With respect to learning outcomes (retention, transfer, and visual memory) Experiment 1 revealed an effect of text modality for visual memory only. In Experiment 2 no modality effects were found. Instruction pace was hardly related to learning outcomes. Overall, the results confirm prior findings suggesting that the distribution of visual attention in multimedia learning is largely guided by the text.     

How to understand what you don't believe: Metacognitive training prevents belief-biases in multiple text comprehension

Prior beliefs often bias the comprehension of multiple science-related texts such that belief-consistent texts are better comprehended compared to belief-inconsistent texts (text-belief consistency effect). Two experiments were conducted to investigate whether a metacognitive strategy training focusing on belief-biasing validation processes can reduce the text-belief consistency effect in multiple text comprehension. Participants in the control condition received the PQ4R training as a well-situated and effective reading skill training that increases receptive elaborative processing. In Experiment 1 (n = 39) and Experiment 2 (n = 53) participants receiving a metacognitive strategy training achieved a similar level of comprehension of belief-consistent and belief-inconsistent texts, whereas a text-belief consistency effect was found in the PQ4R condition. These results indicate that a training focusing on belief-biasing validation processes prepare readers for the challenges to comprehend belief-relevant multiple texts, whereas strategies that foster receptive processing of information are not sufficient in the context of controversially discussed topics.     

Effects of type of exploratory strategy and prior knowledge on middle school students’ learning of chemical formulas from a 3D role-playing game

The purpose of this study was to examine the effects of the type of exploratory strategy and level of prior knowledge on middle school students’ performance and motivation in learning chemical formulas via a 3D role-playing game (RPG). Two types of exploratory strategies—RPG exploratory with worked-example and RPG exploratory without worked-example—and two levels of prior knowledge—high prior knowledge and low prior knowledge—were examined in the study. The 5E Instructional Model was employed as a learning framework in the RPG game design of The Alchemist’s Fort. One hundred and fifteen eighth-grade students from a Taiwanese school voluntarily participated in the 3-week experiment. The results indicate that (1) significant worked-example effect was revealed on knowledge comprehension and marginal worked-example effect occurred on knowledge application; (2) regardless of the type of exploratory strategy employed, learners showed mild positive motivation toward learning chemistry via a 3D RPG game; (3) higher prior-knowledge learners outperformed their lower prior-knowledge peers on performance measures; and (4) high prior-knowledge learners showed a higher degree of motivation in self-efficacy and science learning value than did the low prior-knowledge learners; however, lower prior-knowledge learners revealed higher learning environment stimulation than did their high prior-knowledge peers.     

Learning by drawing: When is it worth the time and effort?

Two experiments compared the effects of learning by drawing to studying instructor-provided visuals on learning outcomes, learning time, and cognitive load. College students studied a text on the human circulatory system and completed comprehension and transfer tests. In Experiment 1 (N = 107), students studied the text with provided visuals (provided visuals) or generated their own drawings from the text with text-based support (verbally-supported drawing) or without support (unsupported drawing). Results showed that while the verbally-supported drawing condition spent significantly more time and experienced significantly higher cognitive load than the provided visuals condition, there were no differences across the three conditions in learning outcomes. In Experiment 2 (N = 85), students studied the text with provided visuals (provided visuals) or generated drawings from the text with provided visuals as feedback (visually-supported drawing). Results showed that the visually-supported drawing condition spent significantly more time and experienced significantly higher cognitive load than the provided visuals condition but also performed significantly better than the provided visuals condition on the comprehension test. These findings suggest generating drawings prior to studying provided visuals is worth the time and effort.     

The relation of knowledge of textual integration devices to expository text comprehension under different assessment conditions

In this study we propose a theoretical construct (called rhetorical competence) that represents the ability of readers to detect, understand, and use the linguistic cues or discourse markers that texts contain. We measure one of the three postulated components of rhetorical competence (knowledge of textual integration markers), assessing whether readers correctly interpret these markers while reading. The influence of this skill on reading competence is examined in a correlational study of 185 sixth-grade pupils (aged 11–12 years) using different assessment materials (a standardized test and an academic text) and reading conditions (habitual and aided). Multiple regression analyses of the data indicate that knowledge of textual integration devices makes a significant independent contribution to expository text comprehension under most assessment conditions when the effects of working memory, prior knowledge, and word recognition skills are controlled.     

Effects of incorporating retrieval into learning tasks: The complexity of the tasks matters

In an experiment with N = 192 university students, we examined whether the effects of incorporating retrieval into learning tasks depend on the learning tasks' complexity. The learning tasks consisted of adjunct questions that were provided together with expository texts relating to the domain of chemistry. We varied (a) whether the adjunct questions required the learners to summarize (low complexity) or generate inferences on the basis of provided information (high complexity) and (b) whether the adjunct questions were implemented in a closed-book style that required learners to engage in retrieval or in an open-book style that did not require learners to engage in retrieval while responding to the questions. Afterwards, all learners took either an immediate or a delayed criterion test. We found that the effect of incorporating retrieval depended on the complexity of the adjunct questions; the net benefit of incorporating retrieval was higher for the low complexity ones.     

Supporting learning from text: A meta-analysis on the timing and content of effective feedback

The aim of the present meta-analysis was to examine the effects of feedback on learning from text in conventional readers (ranging from primary school students to university students). Combining 104 contrasts of conditions of reading texts with and without feedback, including 6,124 participants, using the random effects model resulted in a positive effect of feedback on learning from text (g+ = 0.35). Moderator analyses showed that feedback is particularly effective if provided directly after reading, but less so when provided during reading. If feedback is provided directly after reading, elaborate feedback and knowledge-of-correct-response feedback were more effective than knowledge-of-response feedback. If feedback is provided during reading, no differences are found between the effects of different types of feedback. Additionally, computer-delivered feedback is more beneficial for learning from text than non-computer-delivered feedback. Implications for optimizing conditions to support learning from text are discussed.     

The impact of elaborated feedback on text comprehension within a computer-based assessment

We investigated what impact elaborated feedback has on sixth graders' deep-level comprehension of texts within a computer-based assessment. Experiment 1 (N = 566) focused on the contents of computer-provided elaborated feedback (i.e. inference-prompts, error explanations, or monitoring-prompt) using a control-group design. Results showed that none of the feedback treatments had an effect on performance. This appeared to result from participants' low commitment to processing the feedback. Experiment 2 (N = 251) focused on the feedback presentation type by varying computer-mediated and person-mediated inference-prompts within a control-group design. Results showed that only the person-mediated inference-prompts had significant effects on performance with respect to the correction of initially false answers to comprehension questions and the performance on subsequent test questions. Findings of both experiments indicate the impact of inference-prompts on text comprehension within performance assessments, highlighting the need to explicitly account for motivational issues in feedback interventions on higher-order reading processes.     

The function of annotations in the comprehension of scientific texts: Cognitive load effects and the impact of verbal ability

Students participated in a study (n=98) investigating the effectiveness of three types of annotations on three learning outcome measures. The annotations were designed to support the cognitive processes in the comprehension of scientific texts, with a function to aid either the process of selecting relevant information, organizing the information in memory, or integrating information with prior knowledge. Learning outcomes were measured by assessing student recall of facts, comprehension of the text, and mental model construction. Results show that different types of annotations facilitate different learning outcomes. In addition, we found that, compared to having only one type of annotation available, multiple types of annotations resulted in a higher cognitive load that resulted in lower performance, especially in tests of higher-level processing. This effect was stronger for low-verbal-ability learners, who showed lower peformance in treatments with multiple types of annotations than high-verbal-ability learners.     

A tale of two tests: The role of topic and general academic knowledge in traditional versus contemporary scenario-based reading

We compared high school students’ performance in a traditional comprehension assessment requiring them to identify key information and draw inferences from single texts, and a scenario-based assessment (SBA) requiring them to integrate, evaluate and apply information across multiple sources. Both assessments focused on a non-academic topic. Performance on the two assessments were moderately correlated (r = 0.57), but the SBA was more difficult (Study 1; n = 342). The two assessments similarly depended on basic reading skills but diverged in the relation to academic knowledge and (non-academic) topic knowledge (Study 2; n = 1107). Academic knowledge was highly predictive of traditional comprehension, but less so for SBA. Topic knowledge was more predictive of SBA than traditional comprehension. Thus, the two assessments tap into similar constructs related to comprehension; however, the level of topic knowledge is more important for performance on scenario-based, multiple-source reading tasks, whereas academic knowledge is more important for traditional reading comprehension tasks.     

Predictors of reading literacy

Two reading literacy/text comprehension tests with different demands (on-line comprehension vs. memory-based comprehension) were administered to 6,104 15-year-old students from all German states and school types. The combined and specific effects of proximal and distal variables from small-scale psychological research as well as from large-scale educational studies on each text comprehension measure were investigated. Metacognitive knowledge, decoding speed, and the number of books at home (as an indicator for family background) were found to have specific and large effects on on-line comprehension and accounted for 46 percent of the variance with the highest effects for metacognition. Metacognitive knowledge was also highly predictive when the effects of specific prior knowledge and thematic interest on memory-based text comprehension were estimated simultaneously. In addition, students who showed relative strength in building up a coherent representation of specific texts (memory-based text comprehension) were characterised by high amounts of prior knowledge and thematic interest thereby underlining the importance of these student characteristics for learning.     

Learning from expository texts: Effects of the interaction of prior knowledge and text structure on responses to different question types

The objective of this study was to verify the effects of the interaction between text structures and prior knowledge on memory and learning from expository texts. It examined the effects of two levels of prior knowledge and two types of mixed structures on a post-reading questionnaire. A total of 119 French-speaking, sixth-grade subjects were selected on the basis of a multiple-choice questionnaire. This questionnaire served to distinguish two groups, one possessing a high level of prior knowledge about the topic covered in the text (HP group), and another having a low level of prior knowledge (LP group). The children’s reading ability was evaluated by a cloze test that also served to eliminate children with reading comprehension difficulties from the experimental groups. The subjects in each group were arbitrarily assigned to subgroups. One group read an experimental passage, “The effects of acid rain on maple and pine”, which was organized in a collection inserted in cause/effect structure (SI). The other group read the same information, but which was organized in a comparison inserted in cause/effect structure (S2). The post-reading measure consisted of 24 questions that varied according to three criteria. The statistical analysis revealed that the effects of text structure were dependent on the level of prior knowledge and on the type of questions and confirmed that prior knowledge had a determining influence on knowledge acquisition.     

Teaching With Televised Stories: A Story-Focused Narrative Preview Supports Learning in Young Children

Researchers examined the effects of previewing on preschoolers’ comprehension of narrative and educational content in a television program. Children (3–5 years, N = 107) watched an educational math episode in one of three conditions: no-preview control, education-focused expository preview, or story-focused narrative preview. A main effect of previewing was found, controlling for age, character familiarity, prior knowledge, and visual attention. Specifically, the narrative preview enhanced both narrative comprehension (including central, incidental, and inferential content) and educational comprehension (including direct learning and transfer), compared to a no-preview control. Conversely, the expository preview had no effect on comprehension. Findings are interpreted with respect to story schema and relevant cognitive theories of learning from media. Implications for educational media production are discussed.     

The influence of consequence value and text difficulty on affect,attention, and learning while reading instructional texts

The present study investigated how consequence value influences affect, attention, and learning while reading instructional texts, and if text difficulty moderates these effects. Participants studied four instructional texts on research methods in a 2 × 2 consequence value (high vs. low) × text difficulty (easy vs. difficult) within-subjects experiment. Consequence value was manipulated by assigning two of the four texts as having high value and the other two as having low value with respect to a performance goal on a subsequent test, while text difficulty was manipulated via experimenter-created easy and difficult versions of the texts. We hypothesized that consequence value would induce mild anxiety, which would focus attention and facilitate learning, and that text difficulty would moderate the influence of consequence value. Partially consistent with the predictions, high consequence value led to lower valence, higher arousal, longer reading times, and positively predicted knowledge transfer. Arousal mediated the relationship between consequence value and knowledge transfer, but only when the texts were difficult, thereby suggesting moderated mediation.