Decorative pictures and emotional design in multimedia learning

Recent studies have shown that the positive emotional design of learning environments might foster learning performance. In contrast, the seductive detail effect postulates that additional, learning irrelevant details inhibit learning. This research focusses on the implementation of decorative pictures as a prime for emotions and context-relatedness. This study examines four groups of decorative pictures which might be conducive for learning. Eighty-two students were randomly assigned to one cell of a 2 (emotionally positive vs. emotionally negative pictures) × 2 (school context vs. leisure context pictures) between-subjects, factorial design. The dimensions of pleasure, arousal, and dominance are examined as possible mediators. Results show that either positively valenced pictures or learning pictures foster retention and transfer performance. Pleasure is identified as mediator of the effect between valence of pictures and learning performance. A further analysis shows differences for arousal and dominance for both factors. These results are interpreted with concepts like motivated attention and other arousal theories.     

The effects of affective pedagogical agent in multimedia learning environments: A meta-analysis

Affective pedagogical agent (PA) is an image of a character embedded in multimedia lessons with the ability to influence learners' affective experiences and learning performance. Prior studies on the effects of affective PA have shown inconsistent findings. In this study, we conducted four separate meta-analyses to address whether adding an affective PA to multimedia lessons can increase learners' retention performance, transfer performance, positive emotions, and intrinsic motivation, and to explore several moderators that may have contributed to the inconsistencies of previous studies. The research framework mainly includes introducing the concept of affective PA, reviewing research on the impact of affective PA on learning performance, emotions, and motivation, analyzing the moderators that may affect the effects of affective PA, performing a meta-analysis, and discussing the results based on the findings of the meta-analysis. We found 36 articles met the inclusion criteria. The results of the meta-analysis indicated that affective PA could increase learners’ positive emotions (k = 25, g = 0.26), improve intrinsic motivation (k = 26, g = 0.26), and facilitate learning performance (retention: k = 35, g = 0.26; transfer: k = 45, g = 0.34). Furthermore, moderator analysis found that affective PA characteristics (i.e., appearance, the number of emotional cues, and body movement) and learning materials characteristics (i.e., subject domain, pacing of presentation) moderated the effects of affective PA. We discussed these findings from different theoretical perspectives. In general, affective PA could help students be happier and more motivated to learn in multimedia learning environments.     

Computer-based multimedia testing: Effects of static and animated representational pictures and text modality

Static representational pictures (RPs) have been focused in research on the multimedia effect in testing and might be especially important in arithmetical word problems, which require a multi-stage mental processing to segment the task. To further highlight the task segments visually, dynamic visualizations could help. However, conventional animations might not apply to this context and the role of dynamic visualizations with temporal segmentations (i.e., animated RPs) is unexplored. This classroom experiment with 456 students investigated multimedia and modality effects in 24 mathematical word problems. Our 3 × 2 mixed design included three multimedia conditions (static RPs, animated RPs, and text-only) and two modality conditions (written text vs spoken text). We investigated effects on response correctness, metacognitive ratings, item-solving satisfaction and time on task. Both static and animated RPs increased response correctness, item-solving satisfaction, and metacognitive ratings compared to text-only. Time on task was affected in distinctive ways in both RP conditions and also varied depending on text modality. Spoken text barely increased response correctness in animated RP items but not at all in static RP items. Moderator analyses revealed that the effects of static and animated RPs on response correctness were dependent on the text modality but varied across school types and the level of mathematical prior knowledge. For students at non-academic-track schools or with low prior knowledge, static and animated RPs improved response correctness compared to text-only across both modalities. For students at academic-track schools or with high prior knowledge, mainly combinations of static or animated RPs with spoken text were effective.     

Emotional design in multimedia learning: Effects of shape and color on affect and learning

We examine design factors that may evoke positive emotions in learners and investigate the effects of these positive emotions on learning. Recent research showed that the emotional design of multimedia learning material can induce positive emotions in learners that in turn facilitate comprehension and transfer. We sought to replicate these results with a different population and different mood induction procedure and examine individual emotions, and to decompose the effects of the design elements of color and shape. Study 1 showed that well-designed materials induced positive emotions and facilitated comprehension, though transfer performance was not affected by emotional design. Study 2 found that round face-like shapes both alone and in conjunction with warm color induced positive emotions. Warm colors alone, however, did not affect learners' emotions. Comprehension was facilitated by warm colors and round face-like shapes, independently as well as together. Transfer was facilitated by round face-like shapes when used with neutral colors.     

Prerequisite knowledge and time of testing in learning with animations and static pictures: Evidence for the expertise reversal effect

An animation can have an informational advantage over a static picture by depicting dynamic features. The aim of this study was to investigate whether the provision of prerequisite knowledge can help learners infer dynamic features from a static picture. It was assumed that this supposedly more active processing with a static picture would result in longer lasting knowledge representations. A 2 × 2 × 2 between-subjects design with visualization format (static picture vs. animation), prerequisite knowledge (provided vs. not provided), and time of testing (immediate vs. one week later) was used (N = 260). The results of a transfer test showed that learners with low prerequisite knowledge benefited from the animation, but this was not the case for learners with high prerequisite knowledge. Time of testing had no influence. In line with the expertise reversal effect, prerequisite knowledge not only fostered learning with the static picture but also hindered learning with the animation.     

Textual and graphical refutations: Effects on conceptual change learning

Refutation text is potentially more effective than standard text for conceptual change. Learning from text and graphic is also potentially superior to learning from text alone. In two studies, we investigated the effectiveness of both a refutation text and a refutation graphic for promoting high school students’ conceptual change learning about season change, as well as their metacognitive awareness of conceptual conflict and knowledge revision. In both studies, participants were randomly assigned to one of four conditions: (1) standard text with standard graphic, (2) standard text with refutation graphic, (3) refutation text with standard graphic, or (4) refutation text with refutation graphic. Both studies had a pretest, immediate post-test, and delayed post-test design and involved students with an initial common misconception about the causes of season change. In Study 2, explicit relevance instructions to observe the important illustration were given to the participants. In both studies, refutation text with refutation graphic was not more beneficial than other instructional materials, either at immediate or delayed post-test. In Study 1, more stable conceptual change learning emerged in readers of the refutation text with standard graphic compared to readers in the control condition. In Study 2, readers of the standard text with refutation graphic performed as well as readers of the refutation text with standard graphic. In addition, more readers of the refutation text with either graphic showed metacognitive awareness of their knowledge change compared to readers in the control condition. Educational implications underline the importance of relevance instructions for guiding readers toward the graphic and of the design of text-graphic pairing to sustain knowledge revision.     

Learning from multimedia presentations: Facilitation function of animations and spatial abilities

Animations may facilitate learning by providing external support for visual–spatial mental processing. Facilitation is challenged by findings that demonstrate involvement of spatial abilities in learning from animations, because this involvement indicates active internal visual–spatial processing. In the present study, learners attended to a system-paced multimedia presentation in which a verbal–auditory explanation was concurrently synchronized either with animation, with static core pictures, or with enriched static pictures that showed additional intermediate steps and arrows indicating motion. Results demonstrated better learning success with animations and with enriched static pictures than with static pictures. Spatial abilities were not substantively related to learning success with animations or with static pictures, but they played a crucial role for learning success with enriched static pictures. It is concluded that active visual–spatial processing was recruited with enriched static pictures. With animations, learning was truly facilitated by external support for visual–spatial mental processing.     

Interactive learning environments and games

Undergraduate psychometrics classes often use computer-intensive active learning projects. However, little research has examined active learning or computer-intensive projects in psychometrics courses. We describe two computer-intensive collaborative learning projects used to teach the design and evaluation of psychological tests. Course evaluations were significantly above the department average, and students perceived the projects as effective in meeting course objectives and improving computer skills. Grades on these projects were unrelated to self-reported computer background, suggesting that all students can succeed at computer-intensive projects when instructors provide adequate support and create a collaborative learning environment.     

Facilitators or suppressors: Effects of experimentally induced emotions on multimedia learning

The present study investigated the influence of experimentally induced emotions (positive, neutral, negative) on learning with multimedia instruction with N = 75 university students. In order to provide sound explanations about how emotional state might impact learning, measures of motivation, cognitive load, and attentional processes (eye tracking) were integrated. Results showed that while emotions did not influence retention, emotions did influence outcomes of the comprehension and transfer test. Specifically, a facilitating effect of an induced negative emotional state on learning outcomes was observed, which could be attributed to a more focused and detailed information processing. In contrast, an induced positive emotional state had a suppressing effect on learning outcomes since learners were distracted from the learning materials by their emotions. Motivational measures were not influenced by learners' different emotional states, but overall, controlled motivation increased and autonomous motivation decreased during learning. In sum, the learners' emotional state should be considered in learning research as an important predictor for learning success.     

Extending the theoretical foundations of multimedia learning: Activation,integration, and validation occur when processing illustrated texts

BackgroundText illustrated by pictures (i.e., multimedia material) is often used to improve learning outcomes. To support learning, it is essential to understand and specify the ongoing cognitive processes when processing illustrated texts.AimsWe focus on three cognitive processes identified when processing non-illustrated texts: activation, integration, and validation. In three experiments, we investigated whether the three processes occur during the processing of illustrated texts and whether the processes differ between illustrated and non-illustrated texts.SamplesExperiment 1 had 170 participants, Experiment 2 had 221 participants, and Experiment 3 had 132 participants.MethodAll experiments used an adapted version of the contradiction paradigm. In Experiments 1 and 2, participants read texts that contained information that was consistent vs. inconsistent with a later sentence (target sentence). It was additionally varied whether a picture illustrated the consistent vs. inconsistent information. In Experiment 3, only the pictures were consistent or inconsistent with the target sentence. We measured reading times for the target sentence and the following sentence (spillover sentence).ResultsIn all three experiments, reading times were significantly longer in the inconsistent than in the consistent conditions. This prolongation of reading times was not affected by the picture in Experiments 1 and 2.ConclusionOur results indicate that activation, integration, and validation processes are similar when processing non-illustrated and illustrated texts (Experiments 1 and 2) and also occur when information is presented across text and picture (Experiment 3). We discuss the implications for the theoretical foundations of multimedia learning.     

Why do learners who draw perform well? Investigating the role of visualization,generation and externalization in learner-generated drawing

In two experiments, we investigated which of the factors generation, visualization, and externalization mainly contribute to the benefits of learner-generated drawing. We also examined whether benefits of drawing were more pronounced in delayed rather than in immediate testing. To this end, Experiment 1 (N = 121) focused on the comparison of the factors visualization and generation, whereas Experiment 2 (N = 204) focused on the role of externalization in generative learning activities. In both experiments, participants were asked to read an expository text about biomechanics in human swimming behavior. In Experiment 1, participants were instructed either to construct drawings, to write summaries, to learn with multimedia material, or to only read. In Experiment 2, participants were instructed either to construct drawings, to mentally imagine the content, or to observe a multimedia presentation evolving gradually. Learning outcomes were measured with a recognition, transfer, and drawing test. In Experiment 1, the tests were administered immediately and after one week (within-subjects), whereas in Experiment 2 time of testing was manipulated between subjects. The results of both experiments revealed effects of experimental conditions for transfer and drawing performance, but not for recognition performance. Taken together, the findings indicate that visualization and externalization are the main contributing factors: The drawing and multimedia conditions outperformed the summary and text-only conditions (Exp. 1), thereby supporting the role of visualization, whereas the drawing and observation conditions outperformed the imagery conditions on the drawing test (Exp. 2), thereby emphasizing the role of externalization. There is little evidence that drawing constitutes a desirable difficulty.     

Learning with multiple representations: Extending multimedia learning beyond the lab

The present study extended multimedia learning principles beyond the lab to an ecologically valid setting (homework). Eighteen information cards were used to perform three homework tasks. The control group students learnt from single representation (SR) cards that presented all information as printed text. The multiple representation (MR) group students received the same information, but each card contained either printed text or an informationally equivalent graphic such as a chart or graph. The MR group students performed better than the SR group students on accuracy of their homework answers and on subsequent posttest retention and transfer, and used more information cards while learning. The improved MR group students' performance is discussed in relation to two alternative possible explanations – the nature of the information sources and students' motivation to learn.     

Cognitive and affective processes in multimedia learning

This special section focuses on cognitive and affective processes in multimedia learning in a range of learning domains. Expanding previous research that has taken a predominantly cognitive perspective of multimedia learning, recent studies have begun to consider affective aspects of multimedia learning with the aim of integrating emotion, motivation, and other affective variables into cognitive processing models. The articles included in this special section are examples of the various ways in which the cognitive perspective can be enhanced by taking affective aspects of learning into account. Investigations range from the study of confusion as an affective state that can be beneficial to learning, and the consideration of the potential distracting or motivating function of decorative illustrations, to an inquiry into how visual design can induce positive emotions in learners. The results of the studies included in this section are in line with Moreno's Cognitive-Affective Theory of Learning with Media (CATLM; Moreno, 2006) and show how emotion and interest facilitate cognitive processing and improve cognitive and affective outcomes.     

Student attitude and learning outcomes of multimedia computer-assisted versus traditional instruction in basketball

The purpose of this study was to examine the effect of multimedia computer-assisted instruction (MCAI), traditional instruction (TI), and combined instruction (CI) methods on learning the skill of shooting in basketball. Additionally, a comparison of the students’ attitudes towards the MCAI and TI methods was made. Seventy-five middle school students of seventh and eighth grade were randomly assigned into three teaching method groups: TI, MCAI and CI. Each group received ten 45-min periods of instruction divided into three sections: (a) 5-min introduction, (b) 30-min instructional time and (c) 10-min questions and review. Students took pre-, post-, and retention written test covering techniques and rules of the games. Participants in the CI group also completed a post-test attitude survey towards the MCAI and TI methods. Two-way analysis of variances (ANOVA), with repeated measures on the last factor, were conducted to determine effect of method groups (MCAI, TI, CI) and measures (pre-test, post-test, re-test) on knowledge test. Paired samples t-test analyses were conducted to measure students’ attitude towards the MCAI and TI methods. Post-test results indicated no significant differences between the groups concerning the written test. Nevertheless, the attitude test scores of the CI group were more favourable to MCAI method than the TI method. Retention test results showed that groups retained the knowledge acquisition. However, the combine method of instruction tended to be the most effective on cognitive learning.     

Supporting learning from text: A meta-analysis on the timing and content of effective feedback

The aim of the present meta-analysis was to examine the effects of feedback on learning from text in conventional readers (ranging from primary school students to university students). Combining 104 contrasts of conditions of reading texts with and without feedback, including 6,124 participants, using the random effects model resulted in a positive effect of feedback on learning from text (g+ = 0.35). Moderator analyses showed that feedback is particularly effective if provided directly after reading, but less so when provided during reading. If feedback is provided directly after reading, elaborate feedback and knowledge-of-correct-response feedback were more effective than knowledge-of-response feedback. If feedback is provided during reading, no differences are found between the effects of different types of feedback. Additionally, computer-delivered feedback is more beneficial for learning from text than non-computer-delivered feedback. Implications for optimizing conditions to support learning from text are discussed.     

Differential effects of problem-solving demands on individual and collaborative learning outcomes

The effectiveness and efficiency of individual versus collaborative learning was investigated as a function of instructional format among 140 high school students in the domain of biology. The instructional format either emphasized worked examples, which needed to be studied or the equivalent problems, which needed to be solved. Because problem solving imposes a higher cognitive load for novices than does studying worked examples it was hypothesized that learning by solving problems would lead to better learning outcomes (effectiveness) and be more efficient for collaborative learners, whereas learning by studying worked examples would lead to better learning outcomes and be more efficient for individual learners. The results supported these crossover interaction hypothesis. Consequences of the findings for the design of individual and collaborative learning environments are discussed.     

Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis

The signaling principle recommends emphasizing relevant aspects of a multimedia message by means of signals (e.g., color coding). We determined the effectiveness of signals that highlight correspondences between text and pictures as well as possible boundary conditions by means of a meta-analysis. To this end, 58 potentially relevant articles were identified in a comprehensive search. After rating the studies based on inclusion criteria and correcting for biases, 27 studies were included in the meta-analysis yielding 45 pairwise comparisons with N = 2464 participants. Domain-specific prior knowledge, pacing of the materials, pictorial format, mapping requirements, and distinctiveness of signals were coded as moderators. For transfer and comprehension performance a positive small-to-medium effect size (r = .17, 95% CI [0.11, 0.22]) favoring signaled multimedia material was found, which was moderated by prior knowledge. The findings support the effectiveness of the signaling principle in particular for learners with low prior knowledge.     

Investigating the effect of deictic tracing on multimedia learning

In the reported study it was investigated whether deictic tracing during processing multimedia materials can support learning. Participants in the tracing group had to connect words in the text to corresponding elements in the picture by tracing with their index finger on a tablet surface. Participants in the tracing group were expected to outperform learners in the control group without tracing regarding text-picture integration performance and pure picture recall. Results did not confirm our assumptions. Instead, learners in the tracing group performed even worse regarding text-picture integration performance and drawing performance (i.e., replicating the to-be-learned picture) compared to the control group. Log-file analyses showed that only few learners were able to trace the lines correctly on all slides, so tracing difficulty may explain the unexpected results. Other possible reasons as well as the implications of these results are discussed.     

An Eye-Tracking Study of Learning From Science Text With Concrete and Abstract Illustrations

This study investigated the online process of reading and the offline learning from an illustrated science text. The authors examined the effects of using a concrete or abstract picture to illustrate a text and adopted eye-tracking methodology to trace text and picture processing. They randomly assigned 59 eleventh-grade students to 3 reading conditions: (a) text only; (b) text with a concrete illustration; and (c) text with an abstract illustration in a pretest, immediate, and delayed posttest design. Results showed that the text illustrated by either the concrete or the abstract picture led to better learning than did the text alone. Eye-fixation data revealed that the abstract illustration promoted more efficient processing of the text. Analyses of the gaze shifts between the 2 types of external representation indicated that the readers of the text with the abstract illustration made a greater effort to integrate verbal and pictorial information. Furthermore, relations between online and offline measures emerged.