Observational learning from animated models: Effects of modality and reflection on transfer

Animated models use animations and explanations to teach how a problem is solved and why particular problem-solving methods are chosen. Often spoken explanations are proposed to accompany animations in order to prevent overloading the visual channel (i.e., the modality effect). In this study we adopt the hypothesis that the inferior performance of written text compared to spoken text is due to the fact that written text receives less attention and, consequently, less effortful processing. In a 2 × 2 factorial experiment (N = 96) with the factors modality (written, spoken) and reflection (reflection prompts, no reflection prompts) the hypothesis is tested that prompted reflection requires learners to explicitly attend to written explanations and carefully process them, thus yielding higher transfer performance, whereas for spoken explanations prompted reflection would have no effect on transfer performance. The results indeed showed the hypothesized interaction between modality and reflection prompts. They suggest that the modality effect can be compensated for when learners explicitly attend to the information and effortfully process it. This has implications for learning situations in which spoken explanations are no option, such as education for the hearing-impaired.     

The merits of representational pictures in educational assessment: Evidence for cognitive and motivational effects in a time-on-task analysis

Adding representational pictures (RPs) to text-based items has been shown to improve students’ test performance. Focusing on potential explanations for this multimedia effect in testing, we propose two functions of RPs in testing, namely, (1) a cognitive facilitation function and (2) a motivational function. We found empirical support for both functions in this computer-based classroom experiment with N = 410 fifth and sixth graders. All students answered 36 manipulated science items that either contained (text-picture) or did not contain (text-only) an RP that visualized the text information in the item stem. Each student worked on both item types, following a rotated within-subject design. We measured students’ (a) solution success, (b) time on task (TOT), and identified (c) rapid-guessing behavior (RGB). We used generalized and linear mixed-effects models to investigate RPs’ impact on these outcome parameters and considered students’ level of test engagement and item positions as covariates. The results indicate that (1) RPs improved all students’ performance across item positions in a comparable manner (multimedia effect in testing). (2) RPs have the potential to accelerate item processing (cognitive facilitation function). (3) The presence of RPs reduced students’ RGB rates to a meaningful extent (motivational function). Overall, our data indicate that RPs may promote more reliable test scores, supporting a more valid interpretation of students’ achievement levels.     

Decorative pictures and emotional design in multimedia learning

Recent studies have shown that the positive emotional design of learning environments might foster learning performance. In contrast, the seductive detail effect postulates that additional, learning irrelevant details inhibit learning. This research focusses on the implementation of decorative pictures as a prime for emotions and context-relatedness. This study examines four groups of decorative pictures which might be conducive for learning. Eighty-two students were randomly assigned to one cell of a 2 (emotionally positive vs. emotionally negative pictures) × 2 (school context vs. leisure context pictures) between-subjects, factorial design. The dimensions of pleasure, arousal, and dominance are examined as possible mediators. Results show that either positively valenced pictures or learning pictures foster retention and transfer performance. Pleasure is identified as mediator of the effect between valence of pictures and learning performance. A further analysis shows differences for arousal and dominance for both factors. These results are interpreted with concepts like motivated attention and other arousal theories.     

Interactive and non-interactive pictures in multimedia learning environments: Effects on learning outcomes and learning efficiency

New technologies enable flexible combinations of text and interactive or non-interactive pictures. The aim of the present study was to investigate (a) whether adding pictures to texts is generally beneficial for learning or whether it can also have detrimental effects, (b) how interactivity of pictures affects learning, (c) whether the visualization format of pictures affects the structure of the learner's mental model, and (d) whether the visualization format modifies the effects of interactivity. One hundred university students were randomly assigned to five groups. In four groups, a text about the different daytimes and days on the earth was combined with interactive or non-interactive pictures of different visualization formats. In the fifth group, the text was presented without pictures. According to the results, adding pictures to text was neither beneficial nor harmful for learning. In terms of learning efficiency, however, learning from text only was more successful than learning from text and pictures. Interactivity was beneficial for one learning task, but not for the other task. The visualization format affected participants’ interaction with pictures, but not the learning outcomes; however this effect was not influenced by interactivity. Implications for multimedia design and for further research are pointed out.     

The effect of redundant text in multimedia instruction

The purpose of this study was to examine the redundancy effects obtained when spoken information was duplicated in writing during the learning of a multimedia document. Documents consisting of diagrams and spoken information on the development of memory models were presented to three groups of students. In the first group, no written text was presented. In the second, written sentences redundant with the spoken information were progressively presented on the screen while in the third group, these written sentences were presented together. The results show that whatever the type of text presentation (sequential or static), the duplication of information in the written mode led to a substantial impairment in subsequent retention and transfer tests as well as in a task in which the memorization of diagrams was evaluated. This last result supports the hypothesis that the visual channel is overloaded as the cognitive theory of multimedia learning suggests.     

Effect of on-screen text on multimedia learning with native and foreign-accented narration

This study examined the impact of redundant on-screen text on learning from an animated PowerPoint presentation, narrated either by a native or a foreign-accented narrator, with no text, summary text, or full text. Participants completed retention and transfer tests and rated the cognitive load induced by the narration and the PowerPoint materials. With a native narrator, participants performed better on transfer with no text than summary text (redundancy effect). The foreign-accented narration was perceived to be more difficult to understand. Transfer performance was worse for accented than native narration with no text, replicating a voice effect. With a foreign-accented narrator, participants performed better on retention with full text than summary text. Full text facilitated decoding of the accented narration at the word level, but it did not facilitate deep processing for knowledge transfer. The results are discussed in the context of cognitive load and the cognitive theory of multimedia learning.     

Prerequisite knowledge and time of testing in learning with animations and static pictures: Evidence for the expertise reversal effect

An animation can have an informational advantage over a static picture by depicting dynamic features. The aim of this study was to investigate whether the provision of prerequisite knowledge can help learners infer dynamic features from a static picture. It was assumed that this supposedly more active processing with a static picture would result in longer lasting knowledge representations. A 2 × 2 × 2 between-subjects design with visualization format (static picture vs. animation), prerequisite knowledge (provided vs. not provided), and time of testing (immediate vs. one week later) was used (N = 260). The results of a transfer test showed that learners with low prerequisite knowledge benefited from the animation, but this was not the case for learners with high prerequisite knowledge. Time of testing had no influence. In line with the expertise reversal effect, prerequisite knowledge not only fostered learning with the static picture but also hindered learning with the animation.     

Identifying processes underlying the multimedia effect in testing: An eye-movement analysis

Test items become easier when a representational picture visualizes the text item stem; this is referred to as the multimedia effect in testing. To uncover the processes underlying this effect and to understand how pictures affect students' item-solving behavior, we recorded the eye movements of sixty-two schoolchildren solving multiple-choice (MC) science items either with or without a representational picture. Results show that the time students spent fixating the picture was compensated for by less time spent reading the corresponding text. In text-picture items, students also spent less time fixating incorrect answer options; a behavior that was associated with better test scores in general. Detailed gaze likelihood analyses revealed that the picture received particular attention right after item onset and in the later phase of item solving. Hence, comparable to learning, pictures in tests seemingly boost students' performance because they may serve as mental scaffolds, supporting comprehension and decision making.     

Drawing pictures during learning from scientific text: testing the generative drawing effect and the prognostic drawing effect

Does using a learner-generated drawing strategy (i.e., drawing pictures during reading) foster students' engagement in generative learning during reading? In two experiments, 8th-grade students (Exp. 1: N = 48; Exp. 2: N = 164) read a scientific text explaining the biological process of influenza and then took two learning outcome tests. In Experiment 1, students who were asked to draw pictures during reading (learner-generated drawing group), scored higher than students who only read (control group) on a multiple-choice comprehension test (d = 0.85) and on a drawing test (d = 1.15). In Experiment 2, students in the learner-generated drawing group scored significantly higher than the control group on both a multiple-choice comprehension test (d = 0.52) and on a drawing test (d = 1.89), but students who received author-generated pictures in addition to drawing or author-generated pictures only did not. Additionally, the drawing-accuracy scores during reading correlated with comprehension test scores (r = .623, r = .470) and drawing scores (r = .620, r = .615) in each experiment, respectively. These results provide further evidence for the generative drawing effect and the prognostic drawing effect, thereby confirming the benefits of the learner-generated drawing strategy.     

Signals foster multimedia learning by supporting integration of highlighted text and diagram elements

Two experiments investigated how signals foster learning from text and diagrams by examining the relationship between visual attention and learning outcomes. In Experiment 1 (N = 55) students learned about the circulatory heart system from a multimedia lesson either with or without signals highlighting text–diagram correspondences. Results showed that students learning with signals attended to signaled (but not to non-signaled) information more frequently and earlier during learning; these changes in visual attention could explain better performance in answering text–diagram-integration questions. Experiment 2 (N = 78) replicated these findings with respect to early attention on signaled diagram elements and learning outcomes; in addition, a third condition was investigated, where signals highlighted diagram elements that did not match the text. Results showed that mismatched signals guided attention only initially, whereas later on students attended more to information that corresponded to the text. Mismatched signals had no effect on learning outcomes. Taken together, the results suggest that signals aid learning by highlighting specific text–diagram correspondences and not by amplifying diagram processing more generally.     

How repeated studying and testing affects multimedia learning: Evidence for adaptation to task demands

Two biases can occur in multimedia learning: overconfidence and over-reliance on text processing. The present research sought to identify these biases and to investigate whether they can be reduced, and hence learning fostered, when studying and testing are repeated. In 2 experiments (Exp.1: N = 79, Exp.2: N = 52), students learned either with text only or with text and pictures (multimedia) about how the toilet flush works, gave judgments-of-learning (JOLs), were tested on the learning contents; afterwards this study-test cycle was repeated. Results from both experiments revealed stronger overconfidence due to multimedia in both study-test cycles (JOLs higher than learning outcomes). Eye movement data showed a relative increase in attention on the picture versus text from cycle 1 to cycle 2; this relative increase in attention was related to better learning outcomes. Repeated studying and testing thus helped to reduce over-reliance on text processing in multimedia learning, fostering performance.     

Emotional design in multimedia learning: Effects of shape and color on affect and learning

We examine design factors that may evoke positive emotions in learners and investigate the effects of these positive emotions on learning. Recent research showed that the emotional design of multimedia learning material can induce positive emotions in learners that in turn facilitate comprehension and transfer. We sought to replicate these results with a different population and different mood induction procedure and examine individual emotions, and to decompose the effects of the design elements of color and shape. Study 1 showed that well-designed materials induced positive emotions and facilitated comprehension, though transfer performance was not affected by emotional design. Study 2 found that round face-like shapes both alone and in conjunction with warm color induced positive emotions. Warm colors alone, however, did not affect learners' emotions. Comprehension was facilitated by warm colors and round face-like shapes, independently as well as together. Transfer was facilitated by round face-like shapes when used with neutral colors.     

Facilitators or suppressors: Effects of experimentally induced emotions on multimedia learning

The present study investigated the influence of experimentally induced emotions (positive, neutral, negative) on learning with multimedia instruction with N = 75 university students. In order to provide sound explanations about how emotional state might impact learning, measures of motivation, cognitive load, and attentional processes (eye tracking) were integrated. Results showed that while emotions did not influence retention, emotions did influence outcomes of the comprehension and transfer test. Specifically, a facilitating effect of an induced negative emotional state on learning outcomes was observed, which could be attributed to a more focused and detailed information processing. In contrast, an induced positive emotional state had a suppressing effect on learning outcomes since learners were distracted from the learning materials by their emotions. Motivational measures were not influenced by learners' different emotional states, but overall, controlled motivation increased and autonomous motivation decreased during learning. In sum, the learners' emotional state should be considered in learning research as an important predictor for learning success.     

Learning from multimedia presentations: Facilitation function of animations and spatial abilities

Animations may facilitate learning by providing external support for visual–spatial mental processing. Facilitation is challenged by findings that demonstrate involvement of spatial abilities in learning from animations, because this involvement indicates active internal visual–spatial processing. In the present study, learners attended to a system-paced multimedia presentation in which a verbal–auditory explanation was concurrently synchronized either with animation, with static core pictures, or with enriched static pictures that showed additional intermediate steps and arrows indicating motion. Results demonstrated better learning success with animations and with enriched static pictures than with static pictures. Spatial abilities were not substantively related to learning success with animations or with static pictures, but they played a crucial role for learning success with enriched static pictures. It is concluded that active visual–spatial processing was recruited with enriched static pictures. With animations, learning was truly facilitated by external support for visual–spatial mental processing.     

Effects of response prompts and diagram comprehension ability on text and diagram learning in a college biology course

Embedded response prompts are an effective method to support multimedia learning. Response prompts are directives situated within instructional material. Responding to these prompts affects learners' cognitive operations. Different types of prompts affect learning differently due to variations in stimulated cognitive operations. This study compared three types of experimental response prompts; prompts to self-explain the contents of a page, prompts to attend to diagrams and text-diagram relations, and prompts to self-explanation text-diagram relations; and two control conditions. Three tasks that measure verbal text knowledge, diagram knowledge, or knowledge of text-diagram relations assessed learning. The effects of diagram comprehension ability were also considered. A 5 X 3 mixed model ANCOVA revealed an interaction between prompting conditions and posttest tasks. Diagram comprehension ability was associated with task performance but did not interact with conditions.     

Students’ choice of animated pedagogical agents in science learning: A test of the similarity-attraction hypothesis on gender and ethnicity

College students learned about science with a multimedia program. One group (choice or C) chose to learn with or without an animated pedagogical agent (APA) representing a male or female of five different ethnicities. Another group (no-choice or NC) was assigned an APA by the system. All participants in C group chose to learn with APAs and students of color chose significantly more same-ethnicity APAs than White American students. A significant interaction between choice and ethnic similarity factors revealed that group C produced lower retention, transfer, and program ratings when learning with same-ethnicity rather than different-ethnicity APAs. Results support an interference hypothesis for students who choose to learn with same-ethnicity APAs.     

Extending the theoretical foundations of multimedia learning: Activation,integration, and validation occur when processing illustrated texts

BackgroundText illustrated by pictures (i.e., multimedia material) is often used to improve learning outcomes. To support learning, it is essential to understand and specify the ongoing cognitive processes when processing illustrated texts.AimsWe focus on three cognitive processes identified when processing non-illustrated texts: activation, integration, and validation. In three experiments, we investigated whether the three processes occur during the processing of illustrated texts and whether the processes differ between illustrated and non-illustrated texts.SamplesExperiment 1 had 170 participants, Experiment 2 had 221 participants, and Experiment 3 had 132 participants.MethodAll experiments used an adapted version of the contradiction paradigm. In Experiments 1 and 2, participants read texts that contained information that was consistent vs. inconsistent with a later sentence (target sentence). It was additionally varied whether a picture illustrated the consistent vs. inconsistent information. In Experiment 3, only the pictures were consistent or inconsistent with the target sentence. We measured reading times for the target sentence and the following sentence (spillover sentence).ResultsIn all three experiments, reading times were significantly longer in the inconsistent than in the consistent conditions. This prolongation of reading times was not affected by the picture in Experiments 1 and 2.ConclusionOur results indicate that activation, integration, and validation processes are similar when processing non-illustrated and illustrated texts (Experiments 1 and 2) and also occur when information is presented across text and picture (Experiment 3). We discuss the implications for the theoretical foundations of multimedia learning.     

Effects of multimedia annotations on incidental vocabulary learning and reading comprehension of advanced learners of english as a foreign language

The study investigates immediate and delayed effects of different hypermedia glosses on incidental vocabulary learning and reading comprehension of advanced foreign language learners. Sixty-nine freshman TEFL students studying at a Turkish university were randomly assigned to three types of annotations: (a) definitions of words, (b) definitions coupled with associated pictures, and (c) definitions coupled with associated short videos. Subjects were asked to read an annotated text with the intention of comprehension. The data were collected through a vocabulary pre-test, a vocabulary post-test, a delayed vocabulary test as well as a reading comprehension test. In order to measure incidental vocabulary learning, subjects were not told that they were going to be given vocabulary tests. Results showed that the groups that had access to definitions along with both types of visuals had significantly higher vocabulary scores on both immediate and delayed post-tests than the definition only group. However, no differences were observed on the reading comprehension test. Finally, the qualitative data revealed that hypermedia reading had positive impact on participants’ attitudes towards foreign language reading and vocabulary learning.

Effects of repeated testing on short- and long-term memory performance across different test formats

This study examined whether practice testing with short-answer (SA) items benefits learning over time compared to practice testing with multiple-choice (MC) items, and rereading the material. More specifically, the aim was to test the hypotheses of retrieval effort and transfer appropriate processing by comparing retention tests with respect to practice testing format. To adequately compare SA and MC items, the MC items were corrected for random guessing. With a within-group design, 54 students (mean age = 16 years) first read a short text, and took four practice tests containing all three formats (SA, MC and statements to read) with feedback provided after each part. The results showed that both MC and SA formats improved short- and long-term memory compared to rereading. More importantly, practice testing with SA items is more beneficial for learning and long-term retention, providing support for retrieval effort hypothesis. Using corrections for guessing and educational implications are discussed.