An augmented reality-based learning approach to enhancing students’ science reading performances from the perspective of the cognitive load theory

Reading has been regarded as a medium for learning science, revealing the importance of enhancing learners’ reading competence in science education. The critical features of science texts are their multiple representations, such as text and visual elements, which assist the representation of science concepts. A multimedia learning environment can present relevant materials in various formats and help students to process the materials in meaningful ways, for example, by integrating learning materials with relevant prior concepts, and organizing them into a consistent and coherent cognitive structure. However, some issues with multimedia instructional design have been proposed, such as students’ cognitive load and learning motivations. In this study, an augmented reality-based science learning system was developed based on the contiguity principle of multimedia learning in order to promote students’ science learning. Moreover, an experiment was conducted on a natural science course in an elementary school to assess the effectiveness of the implemented system on students’ learning. The experimental results display that the students learning with this approach found made significant gains in their learning achievements and motivations compared to those learning science with conventional multimedia science learning; moreover, their perceptions of extraneous cognitive load were significantly reduced during the learning activity.     

Testing the ATI hypothesis: Should multimedia instruction accommodate verbalizer-visualizer cognitive style?

College students (Experiment 1) and non-college adults (Experiment 2) studied a computer-based 31-frame lesson on electronics that offered help-screens containing text (text group) or illustrations (pictorial group), and then took a learning test. Participants also took a battery of 14 cognitive measures related to the verbalizer-visualizer dimension including tests of cognitive style, learning preference, spatial ability, and general achievement. In Experiment 3, college students received either both kinds of help-screens or none. Verbalizers and visualizers did not differ on the learning test, and almost all of the verbalizer-visualizer measures failed to produce significant attribute x treatment interactions (ATIs). There was not strong support for the hypothesis that verbal learners and visual learners should be given different kinds of multimedia instruction.     

Perceived Role of Multimedia Instructional Materials on Multicriteria Technology and Engineering Decisions*

Studies have shown that it is difficult for people to deal with multicriteria decision‐making situations. Information technology tools such as decision‐support systems and expert systems have been developed in order to help them in such situations. Another tool that has been identified as helping managers understand complex engineering decision‐making situations is multimedia instructional materials. This research investigates the perceptions of business versus engineering students on improvement of their higher‐level cognitive skills when they participated in a multimedia‐based case study that used an expert system to model a complex engineering and technical problem. Two groups of students, business and engineering, participated in an experiment, where they analyzed the case study and made their recommendations. Two questionnaires measured their perceptions on the improvements achieved on different constructs. A structural equations model was developed in order to test the research hypotheses with business students being the experimental group and the engineering students as a control group. The major findings are no significant relationship between student major and higher‐order cognitive skills improvement, business students perceived more higher‐order skills improvement compared to engineering students, both groups perceived an improvement in learning‐driven factor, and business students valued learning‐driven factors more compared to engineering students. These results show that multimedia instructional materials were perceived to be very useful in making multicriteria engineering and technical decisions.     

Metacognitive and multimedia support of experiments in inquiry learning for science teacher preparation

ABSTRACT

Promoting preservice science teachers’ experimentation competency is required to provide a basis for meaningful learning through experiments in schools. However, preservice teachers show difficulties when experimenting. Previous research revealed that cognitive scaffolding promotes experimentation competency by structuring the learning process, while metacognitive and multimedia support enhance reflection. However, these support measures have not yet been tested in combination. Therefore, we decided to use cognitive scaffolding to support students’ experimental achievements and supplement it by metacognitive and multimedia scaffolds in the experimental groups. Our research question is to what extent supplementing cognitive support by metacognitive and multimedia scaffolding further promotes experimentation competency. The intervention has been applied in a two-factorial design to a two-month experimental course for 63 biology teacher students in their first bachelor year. Pre-post-test measured experimentation competency in a performance assessment. Preservice teachers worked in groups of four. Therefore, measurement took place at group level (N?=?16). Independent observers rated preservice teachers’ group performance qualitatively on a theory-based system of categories. Afterwards, experimentation competency levels led to quantitative frequency analysis. The results reveal differing gains in experimentation competency but contrary to our hypotheses. Implications of combining scaffolding measures on promoting experimentation competency are discussed.     

Does the modality principle for multimedia learning apply to science classrooms?

This study demonstrated that the modality principle applies to multimedia learning of regular science lessons in school settings. In the first field experiment, 27 Dutch secondary school students (age 16–17) received a self-paced, web-based multimedia lesson in biology. Students who received lessons containing illustrations and narration performed better on subsequent transfer tests than did students who received lessons containing illustrations and on-screen text. In the second field experiment, 55 Dutch secondary school students (age 16–17) received similar multimedia programs that allowed more self-pacing and required students to record the time to learn. The illustrations-and-narration group outperformed the illustrations-and-text group on subsequent transfer tests for students who required less time to learn but not for students who required more time to learn. The interaction of learning time spent with modality of presentation on post-test scores was studied. Implications for testing of the robustness of cognitive theory of multimedia learning are discussed.     

The Impact of Instructional Design on College Students’ Cognitive Load and Learning Outcomes in a Large Food Science and Human Nutrition Course

The effective design of course materials is critical for student learning, especially for large lecture introductory courses. This quantitative study was designed to explore the effect multimedia and content difficulty has on students’ cognitive load and learning outcomes. College students (n = 268) were randomized into 1 of 3 multimedia groups: text + graphics (Group 1–TG); audio + text + graphics (Group 2–ATG); or video + audio + text + graphics (Group 3–VATG). Participants answered a demographic survey and pretests before viewing 2 food science supplemental lecture materials (i.e., water mobility and amino acid structures) and completing the cognitive load instrument and post‐tests within a noncontrolled setting. Cognitive load scores were tabulated and compared using a 3 × 3 ANOVA and Tukey post hoc analysis across multimedia groups and food science supplemental lecture materials. Based on the post hoc, students in Group 1–TG had higher intrinsic cognitive load scores than Group 2–ATG (ANOVA, P < 0.05). Cognitive load and post‐test scores were tabulated and compared using a spearman correlation across groups. In Group 1–TG, students that reported less intrinsic cognitive load had higher post‐test scores. Also, students that reported more germane cognitive load had higher post‐test scores. In Groups 2–ATG and 3–VATG, students that reported less extraneous cognitive load had higher post‐test scores (ANOVA, P < 0.05).     

The Effect of Three-Dimensional Simulations on the Understanding of Chemical Structures and Their Properties

In a series of three experimental studies, the effectiveness of three-dimensional computer simulations to aid the understanding of chemical structures and their properties was investigated. Arguments for the usefulness of three-dimensional simulations were derived from Mayer’s generative theory of multimedia learning. Simulations might lead to a decrease in cognitive load and thus support active learning. In our studies, the learning effectiveness of three-dimensional simulations was compared to two-dimensional illustrations by use of different versions of a computer programme concerning the modifications of carbon. The first and third study with freshman students of chemistry and biochemistry show that no more knowledge was acquired when participants learnt with three-dimensional simulations than with two-dimensional figures. In the second study with 16-year old secondary school students, use of simulations facilitated the acquisition of conceptual knowledge. It was concluded that three-dimensional simulations are more effective for younger students who lack the experience of learning with different visual representation formats in chemistry. In all three studies, a significant relationship between spatial ability and conceptual knowledge about the modifications of carbon was detected.     

Cognitive support embedded in self-regulated e-learning systems for students with special learning needs

This paper presents an anthropocentric approach in human – machine interaction in the area of self-regulated e-learning. In an attempt to enhance communication mediated through computers for pedagogical use we propose the incorporation of an intelligent emotional agent that is represented by a synthetic character with multimedia capabilities, modelled to imitate human behaviour. The agent is aiming to provide cognitive support to users with learning difficulties and attention disorders and is designed to accommodate self regulated learning elements. We review the basic principles of self regulated learning which, in turn, act as a basis for designing and implementing our system. Kolb’s learning cycle is used to provide a framework upon which agents’ pedagogical behaviour is constructed. A study between 24 students from higher education with learning difficulties and attention disorders is presented. The learning particularities of this special group that contradict with the principles of self regulated learning are reported. The study refers to students in higher education, in the domain of information technology. The analysis of results indicates that emotional agents improve communication between users of the particular learning group and learning environments by providing cognitive support through behavioural communication, compared to agents with neutral behaviour.     

A generative theory of textbook design: Using annotated illustrations to foster meaningful learning of science text

In three experiments, college students read a text explaining how lightning works and then took problem-solving transfer tests. Some students (integrated group) also viewed illustrations depicting the major stages in the formation of lightning that (a) were placed adjacent to corresponding text paragraphs and (b) contained annotations repeating the verbal cause-and-effect information from the text. Other students (separated group) viewed the same illustrations (a) on a separate page and (b) without annotations, after they had finished reading the text. The integrated group generated approximately 50% more creative solutions on transfer problems than the separated group, and this pattern was stronger for students who lacked experience in meteorology than for high-experience students. The positive effects of integrated illustrations depended on incorporating annotations (i.e., captions and labels) into the illustrations rather than placing illustrations close to corresponding paragraphs. Results were interpreted in light of a generative theory of multimedia learning which posits that meaningful learning requires constructing connections between visual and verbal representations of a system.     

Cognitive and affective processes in multimedia learning

This special section focuses on cognitive and affective processes in multimedia learning in a range of learning domains. Expanding previous research that has taken a predominantly cognitive perspective of multimedia learning, recent studies have begun to consider affective aspects of multimedia learning with the aim of integrating emotion, motivation, and other affective variables into cognitive processing models. The articles included in this special section are examples of the various ways in which the cognitive perspective can be enhanced by taking affective aspects of learning into account. Investigations range from the study of confusion as an affective state that can be beneficial to learning, and the consideration of the potential distracting or motivating function of decorative illustrations, to an inquiry into how visual design can induce positive emotions in learners. The results of the studies included in this section are in line with Moreno's Cognitive-Affective Theory of Learning with Media (CATLM; Moreno, 2006) and show how emotion and interest facilitate cognitive processing and improve cognitive and affective outcomes.     

理查德·梅耶多媒体学习的理论基础

梅耶的多媒体学习理论是建立在坚实的理论基础和可靠的实证经验基础上的科学体系。多媒体学习的认知理论是理解多媒体学习的关键。双重通道假设、容量有限假设和主动加工假设是梅耶构建多媒体学习认知理论的基石,也是整个多媒体学习科学体系的逻辑起点。这三大假设赖以成立的理论前提正是双重编码理论、工作记忆模型、生成学习理论和认知负荷理论,由此构成了多媒体学习的理论基础。具体而言,双重编码理论和工作记忆模型为多媒体学习的认知理论构建提供了关键概念与元素;生成学习理论则为多媒体学习的认知理论构建提供了基本的解释性框架;多媒体学习的认知理论正是由这些关键概念、元素和解释性框架整合而成;而认知负荷理论则以多媒体学习的认知理论为基础,进而为多媒体教学的系列设计原理提供了关键支撑。     

An examination of cognitive processing of multimedia information based on viewers' eye movements

This study utilized qualitative and quantitative designs and eye-tracking technology to understand how viewers process multimedia information. Eye movement data were collected from eight college students (non-science majors) while they were viewing web pages containing different types of text and illustrations depicting the mechanism of atmospheric pressure and the formation of sea and land winds. The results showed that participants' eyes were fixated more often on the text than on the illustrations. Breaking the instructional multimedia into small successive segments did not seem to increase the number of eye fixations on the illustrations. Participants alternated their eye fixations on related components of the illustrations while focusing on verbs or sentences representing the kinematics of the weather systems. Text seemed to provide more detailed explanations than pictures and therefore served as the main resource for understanding the content. Scan paths revealed that participants were likely to be distracted by decorative icons in the illustrations. The decorative icons also created a split-attention effect on students' cognitive processing. Eye-tracking technology was found to be a valuable tool for achieving the objectives of this study, and it provided insights into students' cognitive processes during multimedia learning. Discussion and suggestions for instructional designers and future studies are provided.     

Cognitive load and learning effects of having students organize pictures and words in multimedia environments: The role of student interactivity and feedback

The cognitive load and learning effects of dual-code and interactivity—two multimedia methods intended to promote meaningful learning—were examined. In Experiment 1, college students learned about the causal chain of events leading to the process of lightning formation with a set of words and corresponding pictures (Group WP), pictures (Group P), or words (Group W). Some students were presented with the organized causal chain of events to study, whereas others were given a self-organization task. Consistent with a cognitive theory of multimedia learning, Condition WP was the highest in instructional efficiency for retention and transfer. However, contrary to our predictions, having students organize the multimedia materials was detrimental to transfer. Two follow-up experiments tested the hypotheses that the negative effects of interactivity were due to students' lack of time control (Experiment 2) and the form of feedback (Experiment 3). The findings showed that interactivity was effective when students were asked to evaluate their answers before receiving corrective feedback from the system. This research was supported by the CAREER 0238385 grant from the National Science Foundation. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. Casey Frechette and Paul Gibson created the multimedia materials used in these studies.     

Which features make illustrations in multimedia learning interesting?

How can illustrations motivate learners in multimedia learning? Which features make illustrations interesting? Beside the theoretical relevance of addressing these questions, these issues are practically relevant when instructional designers are to decide which features of illustrations can trigger situational interest irrespective of individual differences. We analysed ratings of illustrations with respect to four potentially interest-triggering features (concreteness, personal relevance, ease of comprehension and unexpected information) and to situational interest. A methodological contribution was to show how multilevel modelling can be applied to take individual differences into account in several respects. Situational interest was predicted by 957 ratings of the four features on an intra-individual level (level 1). Inter-individual differences were controlled by modelling individuals on level 2 (N?=?82 high-school students). Concreteness, personal relevance and ease of comprehension of illustrations are what mainly triggered situational interest. Nearly, 55% of the situational interest variance was explained by inter-individual preferences, thus, highlighting the usefulness of multilevel modelling to control for individual differences.     

梅耶多媒体教学设计原理的生成与架构

多媒体学习理论是一个贯通了学习理论与教学理论的科学体系。作为学习理论的多媒体学习认知理论基于双重编码理论、工作记忆模型以及生成加工理论,解释了学习者通过加工语词与画面所呈现的材料来建构知识的学习机制,属于解释性理论;作为教学理论的多媒体教学设计理论发展出一系列教学设计应遵循的原则,为教育实践提供了具有处方性意义的行动指南,属于处方性理论。解释性的学习理论为处方性的教学理论提供了扎实可靠的科学基础。在多媒体学习研究从学习理论向教学理论转化的过程中,多媒体教学设计理论是实现跃迁的关键环节,而认知负荷理论则是理论跃迁成功的关键变量。基于认知负荷理论,梅耶提出多媒体学习认知负荷三元模型,包括必要认知加工、外来认知加工和生成性认知加工。围绕这三类认知加工,梅耶及其同事进行了大量的实验研究,最终确定了12项与多媒体学习认知理论及其前提假设保持高度逻辑一贯性的多媒体教学设计原则。这些原则都是经得起实践检验的,但教学设计人员在应用的过程中,应明确各项原则的问题情境、适用范围等边际条件。     

Foundations of dynamic learning analytics: Using university student data to increase retention

With digitisation and the rise of e‐learning have come a range of computational tools and approaches that have allowed educators to better support the learners' experience in schools, colleges and universities. The move away from traditional paper‐based course materials, registration, admissions and support services to the mobile, always‐on and always accessible data has driven demand for information and generated new forms of data observable through consumption behaviours. These changes have led to a plethora of data sets that store learning content and track user behaviours. Most recently, new data analytics approaches are creating new ways of understanding trends and behaviours in students that can be used to improve learning design, strengthen student retention, provide early warning signals concerning individual students and help to personalise the learner's experience. This paper proposes a foundational learning analytics model (LAM) for higher education that focuses on the dynamic interaction of stakeholders with their data supported by visual analytics, such as self‐organising maps, to generate conversations, shared inquiry and solution‐seeking. The model can be applied for other educational institutions interested in using learning analytics processes to support personalised learning and support services. Further work is testing its efficacy in increasing student retention rates.     

Testing the usability of information technology applications with learners with special educational needs (SEN)

This paper reports on the 'usability' element of a study examining the development of a multimedia Learning Environment (LE) for Special Educational Needs (SEN) students, designed to match learner requirements to learning materials, as elicited from cognitive and accessibility profiles drawn up by teachers and learning support assistants. In developing the system, the researchers examined how usability tests could be undertaken that meaningfully involved people with cognitive disabilities. Methods were developed following interviews with staff and much observation of lessons involving the use of computers. The usability tests themselves consisted of a series of graded activities drawn from various SEN sources. They required only one or two actions – activating a mouse and/or guiding a cursor – for completion. The study highlighted a number of issues inherent in working with a user group comprising SEN students, including interpreting non-compliance and other behaviour patterns, making tasks meaningful, and accounting for the presence and degree of assistance given by a helper. Of particular interest was the issue of matching the intellectual level of tasks with the physical ease-of-use of the system. The paper suggests various methods for obviating problems elicited, and makes recommendations for the further development of computer-based activities designed to promote independent learning and inclusivity.     

Effects of visual cues and self-explanation prompts: empirical evidence in a multimedia environment

The purpose of this study was to investigate the impacts of visual cues and different types of self-explanation prompts on learning, cognitive load, and intrinsic motivation in an interactive multimedia environment that was designed to deliver a computer-based lesson about the human cardiovascular system. A total of 126 college students were randomly assigned in equal numbers (N?=?21) to one of the six conditions in a 2?×?3 factorial design with visual cueing (cueing vs. no cueing) and type of self-explanation prompts (prediction prompts vs. reflection prompts vs. no prompts) as the between-subjects factors. The results revealed that (a) participants presented with cued animations had significantly higher learning outcome scores than their peers who viewed uncued animations, and (b) cognitive load and intrinsic motivation had different impacts on learning outcomes due to the moderation effect of cueing. The results suggest that the cues may not only enhance learning, but also indirectly impact learning, cognitive load, and intrinsic motivation.     

Impacts of integrating the repertory grid into an augmented reality-based learning design on students’ learning achievements,cognitive load and degree of satisfaction

Augmented reality (AR) offers potential advantages for intensifying environmental context awareness and augmenting students’ experiences in real-world environments by dynamically overlapping digital materials with a real-world environment. However, some challenges to AR learning environments have been described, such as participants’ cognitive overload and the ways to provide assistance in constructing the presented learning materials. In this study, a mindtool-based AR learning system was developed, based on the repertory grid method and the contiguity principle of multimedia learning, for assisting students in constructing their knowledge in a natural science course. Furthermore, an experiment was carried out on an elementary school natural science course to compare the influences of this method with those of the conventional AR learning system on students’ learning effectiveness. The experimental results show that the designated approach effectively promoted the students’ learning achievements, and no significant difference existed between the mindtool-based AR learning system and the conventional AR learning system in terms of students’ cognition load and satisfaction degree; moreover, both the experimental group and the control group perceived low cognition load during the learning activity and rated their own AR learning systems as being highly satisfactory.