How Effective are Instructional Explanations in Example-Based Learning? A Meta-Analytic Review

The worked example effect within cognitive load theory is a very well-established finding. The concrete effectiveness of worked examples in a learning situation, however, heavily depends on further moderating factors. For example, if learners improve their processing of worked examples by actively explaining the worked examples to themselves, they are usually better able to solve transfer problems. Another way to enhance example processing is to present learners with instructional explanations instead of prompting them to produce these explanations on their own. In this article, we review 21 experimental studies to address the issue whether instructional explanations support example-based learning. Meta-analytic results lead to three important conclusions: First, the benefits of instructional explanations for example-based learning per se are minimal. Second, instructional explanations are more helpful for acquiring conceptual knowledge than for acquiring procedural knowledge. Third, instructional explanations are not necessarily more effective than other methods supporting example processing such as self-explaining.     

Example-based learning: The benefits of prompting organization before providing examples

Example-based learning often follows a design in which learners first receive instructional explanations that communicate new principles and concepts and second examples thereof. In this setting, using the knowledge components of the instructional explanations to explain the examples (i.e., generating principle-based self-explanations) is considered to be a highly important learning process. However, a potential suboptimality of this learning process is that it scarcely requires learners to organize the content of the instructional explanations into coherent mental representations. Thus, in two experiments we investigated whether prompting learners to organize the content of the instructional explanations before providing them with the examples (and self-explanation prompts) enhances the effectiveness of example-based learning. We consistently found that organization prompts fostered learning regardless of whether the learners also received self-explanation prompts. Hence, in example-based learning, learners should be prompted to not only generate principle-based self-explanations but also to organize the content of the instructional explanations.     

Effects of worked examples, example-problem, and problem-example pairs on novices’ learning

Research has demonstrated that instruction that relies more heavily on example study is more effective for novices’ learning than instruction consisting of problem solving. However, ‘a heavier reliance on example study’ has been implemented in different ways. For example, worked examples only (WE), example-problem pairs (WE-PS), or problem-example pairs (PS-WE) have been used. This study investigated the effectiveness of all three strategies compared to problem solving only (PS), using electrical circuits troubleshooting tasks; participants were secondary education students who were novices concerning those tasks. Based on prior research, it was hypothesized and confirmed that WE and WE-PS would lead to lower cognitive load during learning and higher learning outcomes than PS. In addition, the open questions of whether there would be any differences between WE and WE-PS, and whether there would be any differences between PS-WE and PS were explored. Results showed no differences between WE and WE-PS or between PS-WE and PS. This study can inform instructional designers on which example-based learning strategies to implement: it does not seem necessary to alternate example study and problem solving, but when doing so, example-problem pairs should be used rather than problem-example pairs.     

Fostering active processing of instructional explanations of learners with high and low prior knowledge

Despite the potential advantages of instructional explanations, evidence indicates that they are usually ineffective. Subsequent work has shown that in order to make instructional explanations effective indeed, one successful strategy is to combine them with indications of the limitations in learners' understanding that they are intended to revise, which makes learners deeply process the explanations. We explored whether this is so for both learners with low and those with high prior domain knowledge. In one experiment, 77 participants with low and high prior knowledge learned about plate tectonics from a multimedia presentation. In addition to the presentation, half the participants received instructional explanations combined with indications, whereas the rest received instructional explanations with no indications. After using the materials, the participants solved retention and transfer tests. Results showed that low prior knowledge learners learned more from explanations including indications of their misunderstandings, whereas high prior knowledge learners profited from instructional explanations either with or without the indications. We discussed theoretical and practical implications.     

The expertise reversal effect in prompting focused processing of instructional explanations

Providing prompts to induce focused processing of the central contents of instructional explanations is a promising instructional means to support novice learners in learning from instructional explanations. However, within research on the expertise reversal effect it has been shown that instructional means that are beneficial for novices can be detrimental for learners with more expertise if the instructional means provide guidance that overlaps with the internal guidance provided by the prior knowledge of learners with more expertise. Under such circumstances, prompts to induce focused processing might even be detrimental for learners with expertise whose prior knowledge already provides internal guidance to learn from explanations. On this basis, we aimed at experimentally varying expertise by developing prior knowledge. Specifically, we used a preparation intervention with contrasting cases to enhance learners’ prior knowledge (expertise). Against this background, we tested 71 university students in a 2 × 2 factorial experimental design: (a) Factor of expertise. Working with contrasting cases to develop prior knowledge and expertise to provide internal guidance to learn from instructional explanations (with vs. without), (b) Factor of prompts. Prompts to induce focused processing of the explanations (with vs. without). The results showed that prompts to induce focused processing fostered conceptual knowledge for novice learners whereas prompts hindered the acquisition of conceptual knowledge for learners with expertise that was developed by working with contrasting cases beforehand. Moreover, measures of subjective cognitive load and learning processes suggest that the instructional guidance provided by prompts compensated for the low internal guidance of novice learners and overlapped with the internal guidance of learners with expertise.     

Expertise reversal for different forms of instructional designs in dynamic visual representations

The recent advances in software and computer technology have enabled the incorporation of dynamic representations into a multitude of educational and training environments. Cognitive load theory has been extensively used to enhance learning from complex dynamic representations by providing appropriate instructional designs to manage learner cognitive load. The available evidence, however, indicates that the suggested instructional designs that are effective for novice learners can reverse and become ineffective for learners with higher levels of prior knowledge. This phenomenon is called the expertise reversal effect. This paper reviews a series of recent experimental studies that have found interactions between levels of learners' organized knowledge structures (endogenous support) and effectiveness of different instructional designs (exogenous support), leading to the expertise reversal effect. It is argued that adapting instructional designs to learners with different amount of prior knowledge is a crucial part of effective learning.     

Implementing Example-Based Learning and Teaching in the Context of Vocational School Education in Business Administration

Starting from problems of knowledge application in the context of vocational school training in business administration, an instructional approach based on worked-out examples was developed. The effectiveness of additional instructional measures (e.g. an elaboration training) was investigated experimentally. Together with teachers, the approach was adapted to conditions of regular book-keeping lessons at vocational school; then it was implemented and evaluated in practice. The positive results of the first evaluation study in which applicable knowledge was fostered were replicated in additional evaluation studies in which some aspects of the approach were optimised. The main results of the evaluation studies underline the effectiveness of example-based learning and teaching. Furthermore they show that this approach can be transferred successfully to vocational school lessons. In the general discussion, recommendations for further improving and successfully implementing example-based lessons are given. This revised version was published online in July 2006 with corrections to the Cover Date.     

The consequences of fading instructional guidance on delayed performance: the case of financial services training

Empirical studies within a cognitive load framework have determined that for novice learners, worked examples provide appropriate levels of instructional guidance. As learners advance in specific subject domains, worked examples should be gradually replaced by practice problems with limited guidance. This study compared performance, both immediately post‐instruction and delayed, following instruction under different conditions: using example–problem pairs, using gradual fading of worked examples, and using pure problem‐solving. The study was conducted with employees of a financial services company in a classroom environment. Results indicated that the fading condition consistently outperformed the example–problem and problem‐solving conditions, and the advantage of this condition was enhanced, with statistically significant differences in performance, in delayed and transfer posttest performance.     

教学视频中线索类型与学习者先前知识经验对学习的交互影响

教学视频因其多通道展现教学内容的特性而成为数字化学习资源的首选形态。线索作为教学视频中的重要引导性教学设计手段,探究其类型及学习者先前知识经验对学习效果的交互影响,有益于优化教学视频的设计策略。基于学习者先前知识经验水平(高水平和低水平)和线索类型(言语线索和视觉线索)两个维度,运用眼动追踪技术和认知负荷、学习满意度、学习效果等测量工具,通过实验考察二者对学习的影响及其内在机制后发现:学习者先前知识经验水平对认知负荷的影响显著;线索类型对学习满意度的影响显著,且线索类型与学习者先前知识经验水平在学习满意度上的交互效应显著;学习者先前知识经验水平对学习效果的影响显著,且线索类型与学习者先前知识经验水平在迁移测验成绩上的交互效应显著。实验结果表明,线索类型与学习者先前知识经验水平对学习满意度和学习效果存在明显的交互作用,即只有低知识经验水平学习者在学习含有视觉线索的教学视频后,学习满意度与学习效果才有显著提升。这可能是由于该类学习者在信息选择时存在困难,视觉线索可以帮助其提高信息搜索效率,而言语线索却会使其认知负荷超载。     

Expertise reversal effect in using explanatory notes for readers of Shakespearean text

The reported study compared the instructional effectiveness of Modern English explanatory interpretations of Shakespearean play extracts integrated line by line into original Elizabethan English text, with a conventional unguided original text condition. Experiment 1 demonstrated that the explanatory notes group reported a lower cognitive load and performed better in a comprehension test than the control group when students had no prior knowledge of the text. In Experiment 2, a reverse effect occurred when the same material was presented to a group of Shakespearean experts. Experiment 3 replicated the results of Experiment 1 using a different Shakespearean play. The study demonstrated that the relative effectiveness of instructional conditions depended on learner levels of expertise. In accordance with the expertise reversal effect, the benefits of guided instruction reversed and became detrimental for learners with high prior knowledge levels. Retrospective verbal protocols indicated that the explanations were redundant for expert readers.     

Effects of In-video Questions and Feedback on Learning Performance

The eye-tracking technology was used in this study to investigate the effects of embedded questions and feedback in instructional videos on learning performance and attention allocation and whether an expertise reversal effect existed. The experiment involved 49 learners with high-level prior knowledge and 45 ones with low-level prior knowledge from a university. Meanwhile, they learned instructional videos with no embedded feedback, embedded questions without feedback and embedded questions with feedback. Findings from the experiment showed that the instructional videos with embedded questions but without feedback not only improved the participants’ attention but also enhanced their learning performance. Furthermore, there was an expertise reversal effect on the learning performance whereby instructional videos with embedded questions but without feedback improved the learning performance of learners with low-level prior knowledge, but not those with high-level prior knowledge.     

Self-explanation in the domain of statistics: an expertise reversal effect

This study investigated the effects of four instructional methods on cognitive load, propositional knowledge, and conceptual understanding of statistics, for low prior knowledge students and for high prior knowledge students. The instructional methods were (1) a reading-only control condition, (2) answering open-ended questions, (3) answering open-ended questions and formulating arguments, and (4) studying worked-out examples of the type of arguments students in the third group had to formulate themselves. The results indicate that high prior knowledge students develop more propositional knowledge of statistics than low prior knowledge students. With regard to conceptual understanding, the results indicate an expertise reversal effect: low prior knowledge students learn most from studying worked-out examples, whereas high prior knowledge students profit most from formulating arguments. Thus, novice students should be guided into the subject matter by means of worked-out examples. As soon as students have developed more knowledge of the subject matter, they should be provided with learning tasks that stimulate students to solve problems by formulating arguments.     

Enhancing transfer by learning generalized domain knowledge structures

Transferring one’s knowledge in new situations is usually associated with cognitively demanding processes. The paper explores an approach to facilitating transfer of knowledge by explicitly instructing learners in medium-level generalized but yet domain-connected knowledge structures that are applicable to a broader range of tasks in the domain and could be essential in managing the cognitive load associated with transfer. The paper includes a theoretical analysis of the potential role of the generalized domain knowledge in transfer and an experimental study designed to investigate the effectiveness of explicit instruction in a generalized domain knowledge structure (function–process–structure schema) in technical areas. Forty-nine undergraduate university students with low or no prior knowledge in the domain participated in the randomised 2 (schema-based vs. non-schema-based instruction)?×?2 (general-to-specific vs. specific-to-general knowledge sequences) experiment investigating the effects of these two factors on posttest transfer performance and subjective ratings of learning difficulty (interpreted as indicators of cognitive load). The results indicated a significant (p?<?0.05) main effect of schema-based instruction; a possible trend (p?<?0.1) favouring general-to-specific instructional sequence for posttest test performance; and a significant interaction between the two factors for ratings of difficulty. The paper concludes that (a) transfer within a domain could be facilitated by explicitly instructing learners in generalized domain schemas; (b) general-to-specific approach could possibly be used as a preferred instructional sequence for enhancing transfer; and (c) cognitive load perspective could add some valid arguments to explain the role of generalized domain knowledge in transfer.     

Research in Science Education at the University of Glasgow

The purpose of this study was to examine how prior knowledge of cellular transport influenced how high school students in the USA viewed and interpreted graphic representations of this topic. The participants were Advanced Placement Biology students (n = 65); each participant had previously taken a biology course in high school. After assessing prior knowledge using the Diffusion and Osmosis Diagnostic Test, two graphical representations of cellular transport processes were selected for analysis. Three different methods of data collection—eye tracking, interviews, and questionnaires—were used to investigate differences in perceived salient features of the graphics, interpretations of the graphics, and processing difficulty experienced while attending to and interpreting the graphics. The results from the eye tracking data, interviews, and instructional representation questionnaires were triangulated and revealed differences in how high and low prior knowledge students attended to and interpreted particle differences, concentration gradient, the role of adenosine triphosphate , endocytosis and exocytosis, and text labels and captions. Without adequate domain knowledge, low prior knowledge students focused on the surface features of the graphics (ex. differences in particle colour) to build an understanding of the concepts represented. On the other hand, with more abundant and better‐organised domain knowledge, high prior knowledge students were more likely to attend to the thematically relevant content in the graphics, which enhanced their understanding. The findings of this study offer a more complete understanding of how differentially prepared learners view and interpret graphics and have the potential to inform instructional design.     

Instruction-first and problem-solving-first approaches: alternative pathways to learning complex tasks

According to cognitive load theory, using worked examples is an effective and efficient instructional strategy for initial cognitive skill acquisition for novice learners, as it reduces cognitive load and frees up cognitive resources to build task competence. Contrary to this, productive failure (as well as invention learning, desirable difficulties and other problem-solving-first) frameworks suggest that scaffolded problem-solving activities (a generation phase) preceding explicit instruction enhance learners’ performance. The reported experimental study investigated the effectiveness of different levels of instructional guidance provided to students during the learning phase preceding explicit instruction in standard solution procedures in enhancing students’ engagement and transfer problem-solving skills. Specifically, the study compared partially-guided or unguided attempts at generating problem solutions as opposed to comprehensive guidance, in the form of a worked example. Levels of experienced cognitive load and learner motivation were evaluated in addition to delayed post-test performance scores. There were no differences between the three groups on the transfer post-test outcomes, even though the condition with fully-guided worked examples prior to the explicit instruction expectedly reduced cognitive load relative to the conditions without such guidance. There were also differences between the conditions on some sub-dimensions of the motivation scale. In general, the findings indicate that similar overall outcomes (delayed transfer performance) could be achieved by different sequences of instructional tasks aimed at achieving different sets of specific goals.     

Interactive Example-Based Learning Environments: Using Interactive Elements to Encourage Effective Processing of Worked Examples

This review describes parts of our research program on example-based learning that relates to recent efforts to incorporate interactive elements into learning environments designed to support learning from worked-out examples. Since most learners spontaneously study or process examples in a very passive or superficial manner, this review focuses on how a variety of specific interactive elements in example-based leaning environments are capable of encouraging learners to actively process the examples. The review begins with an overview of the literature on worked examples and the associated self-explanation, which is important given that the quality of self-explanation is a major factor in determining whether learners benefit from studying examples. The review notes that example-based learning environments tend to be effective but often promote passive processing. It then highlights the strengths and limitations of three types interactivity introduced to example-based learning environments. The review concludes with a discussion of the role that these interactive elements play in these learning environments.     

Fostering positive emotions and history knowledge with location-based augmented reality and tour-guide prompts

There is a lack of theory-driven empirical research that evaluates outcomes of location-based augmented reality (AR) applications with the purpose of improving instructional design and use guidelines. The primary aim of this study was to compare the effectiveness of two historical reasoning guide protocols, one based on prior research by Harley and colleagues (2016a; the other an extension) while learners used a mobile AR app to learn about history. Learners reported significantly higher levels of enjoyment and curiosity from learning about history than using the app itself, though mean levels were high for both—in contrast to negative emotions. Results suggest that the new and extended historical reasoning guide protocol succeeded in fostering higher levels of knowledge than the former. Findings also revealed that learners reported significantly higher levels of task value after the guided tour compared to their pre-guided-tour responses. Implications and future directions are discussed.     

Viewing or visualising—which concept map strategy works best on problem‐solving performance?

The purpose of this study was to investigate the effects of two types of maps (generative vs. completed) and the amount of prior knowledge (high vs. low) on well‐structured and ill‐structured problem‐solving performance. Forty‐four undergraduates who were registered in an introductory instructional technology course participated in the study. Participants were randomly assigned to two treatments that used generative and completed concept maps. Within those treatment groups, participants were differentiated by prior domain knowledge, high or low. Although the high knowledge‐generative group outperformed the other three groups on well‐structured problem‐solving performance, it did not have an effect on ill‐structured problem‐solving performance.     

Understanding and Enhancing the Use of Multiple External Representations in Chemistry Education

Theories on learning with Multiple External Representations (MER) claim that low prior knowledge learners in science have difficulties using MER, which are seen as necessary to achieve a conceptual understanding. In two experiments, we analyze the mechanisms underlying the learning of chemistry with MER. Our first experiment focuses on how MER can support learning. We found no difference in learning gains of conceptual understanding, regardless of the format (whether MER were provided or not). It is concluded that chemical MER on themself cannot be seen as learning aids. The second experiment compares three types of instructional aids (prompts, prompts with an answer, and note-taking) to determine which types of aids enhance learning with MER. Contrary to the findings of Seufert (Learn Instr 13:227?C237, 2003), path-analysis suggests that the lowest prior knowledge group benefits the most from instructional aids such as prompts and note-taking. These aids guide learners?? attention towards one specific representational format (symbols), while other formats (submicroscopic representations) receive less attention.     

Supporting coherence formation in learning from multiple representations

Multimedia learning environments combine multiple forms of representations like texts, static and animated pictures or graphs. Knowledge acquisition from multiple representations requires that the learner create referential connections between corresponding elements and corresponding structures in different representations. As this process is usually difficult, learners frequently fail to construct coherent mental representations and, thus, do not sufficiently understand the subject matter. This paper analyzes the effects of different kinds of instructional help on the process of coherence formation from multiple representations by learners with different prior knowledge. Three groups of university students with different domain-specific knowledge had to learn a complex subject matter from chemistry using six different forms of representation. In addition, a first group received directive help for coherence formation. A second group received non-directive help, and a third group received no instructional help. Results indicate that directive help is effective for recall performance because of its summarizing and repeating function. Furthermore, learners with different levels of prior knowledge show different reactions when help is given. For learners with insufficient prior knowledge help is not helpful or, in case of recall performance, even harmful. Learners with a medium level of prior knowledge can increase especially their comprehension performance when help is offered, whereas learners with too much prior knowledge seem not to be affected by help.