Robust effects of the efficacy of explicit failure-driven scaffolding in problem-solving prior to instruction: A replication and extension

Although Productive Failure has shown to be effective (Kapur, 2016; Loibl, Roll, & Rummel, 2017), it is not clear if failure in problem-solving is necessary. Initial work in a quasi-experimental setting suggests that explicitly designing for experiences of failure leads to better learning outcomes than designing for success. We build on this to report on a controlled experimental study where students are exposed to failure-driven, success-driven, or no explicit scaffolding in problem-solving prior to instruction. For assessments of non-isomorphic conceptual understanding, our results align with those from prior work. Despite the similarity in posttest scores, students exposed to failure-driven scaffolding demonstrate higher quality of constructive reasoning than those receiving success-driven scaffolding. Additionally, our study reveals learning benefits of failure-driven scaffolding (for both posttest scores and reasoning quality) on assessments of transfer. Several cognitive, affective and meta-cognitive mechanisms are investigated to explain robust learning benefits of failure-driven scaffolding in preparatory problem-solving.     

Investigating the mechanisms of learning from a constrained preparation for future learning activity

Many studies have shown benefits associated with engaging students in problem-solving activities prior to administering lessons. These problem-solving activities are assumed to activate relevant knowledge and allow students to develop some initial knowledge structures, which support understanding of the lesson. In this paper we report the results of two studies in which we investigated the underlying benefits of engaging in a preparatory activity—setting up experiments without running them or receiving feedback—prior to an interactive computerized lesson on experimental design compared to only engaging in the interactive lesson. We predicted that the seventh-grade participants who demonstrated some initial knowledge of the topic—experimental design—would benefit more from spending the whole time engaged in instructional activities. However, we expected students who did not demonstrate initial knowledge would benefit more from engaging in the preparatory activity, which would allow them to activate or develop initial knowledge that would aid their understanding of the subsequent instruction. The predicted condition by initial knowledge interaction was found in both studies. In Study 1, the benefit of only engaging in the instruction was found only for the lowest-knowledge of students who demonstrated initial knowledge. For students who did not demonstrate some initial knowledge, the benefit of completing the preparatory activity appeared to be due to the development of an understanding of the general goal of the activity rather than of specific knowledge of experimental design. Based on this finding, in Study 2, we investigated an initial goal by condition interaction. In fact, students who did not express an understanding of the task goal on the pretest benefited from engaging in the preparatory activity and students who did benefited more from the instruction. Again, this benefit appeared to be due to students’ development of an appropriate understanding of the task goal during the preparatory activity.     

Comparing Learning From Productive Failure and Vicarious Failure

A total of 136 eighth-grade math students from 2 Singapore schools learned from either productive failure (PF) or vicarious failure (VF). PF students generated solutions to a complex problem targeting the concept of variance that they had not learned yet before receiving instruction on the targeted concept. VF students evaluated the solutions generated by PF students before receiving the same instruction. Student-generated solutions were either suboptimal or incorrect, and in this sense can be conceived as failed problem-solving attempts. Although there was no difference on self-reported engagement, PF students reported significantly greater mental effort and interest in knowing the canonical solution to the problem than VF students. When preexisting differences in general ability, math ability, and prior knowledge were controlled, PF students outperformed VF students on conceptual understanding and transfer without compromising procedural fluency. These results suggest that when learning a new math concept, people learn better from their own failed solutions than those of others provided appropriate instruction on the targeted concept is given after the generation or evaluation activity.     

Learning from direct instruction: Best prepared by several self-regulated or guided invention activities?

Learning from direct instruction can be enhanced by preparatory invention tasks: students invent an index that allows to differentiate a set of cases regarding important aspects (self-regulated). However, contradictory results have been found. As self-regulated activities often need practice, we tested whether the contradictory findings persist when students can practice inventing. We randomly assigned 99 eighth-grade students to two conditions (independent variable): they either invented twice (self-regulated; n = 49) or worked through worked solutions of the two tasks (guided; n = 50) before learning about ratios in physics from a lecture. Extraneous load, deep-structure recall, knowledge-gap perception, and self-efficacy were potential mediators. Transfer was the dependent measure. Guidance led to less extraneous load. However, self-regulation led to higher transfer because the students devoted more attention to the deep structure of the preparation tasks. Our findings suggest that—given some practice—self-regulated outperforms guided preparation for learning from direct instruction.     

Secondary School Students Learning From Reflections on the Rationale Behind Self-Made Errors: A Field Experiment

Thus far, it is unclear how students can learn most effectively from their own errors. In this study, reflections on the rationale behind self-made errors are assumed to enhance knowledge acquisition. In a field experiment with pre/post/follow-up design, the authors practiced fractions with 174 seventh- and eighth-grade students who were randomly assigned to one of two conditions: The students reflected on either the rationale behind their own errors or on the correct solution corresponding to their own errors. Students in the first condition group demonstrated a greater procedural knowledge at the posttest and at the follow-up test. Furthermore, at the follow-up test, these students demonstrated a higher conceptual knowledge. The implications for theory and school instruction are discussed.     

Making the failure more productive: scaffolding the invention process to improve inquiry behaviors and outcomes in invention activities

Invention activities are Productive Failure activities in which students attempt (and often fail) to invent methods that capture deep properties of a construct before being taught expert solutions. The current study evaluates the effect of scaffolding on the invention processes and outcomes, given that students are not expected to succeed in their inquiry and that all students receive subsequent instruction. While socio-cognitive theories of learning advocate for scaffolding in inquiry activities, reducing students’ agency, and possibly their failure rate, may be counter-productive in this context. Two Invention activities related to data analysis concepts were given to 87 undergraduate students in a first-year physics lab course using an interactive learning environment. Guided Invention students outperformed Unguided Invention students on measures of conceptual understanding of the structures of the constructs in an assessment two months after the learning period. There was no effect, however, on measures of procedural knowledge or conceptual understanding of the overall goals of the constructs. In addition, Guided Invention students were more likely to invent multiple methods during the Invention process. These results suggest that the domain-general scaffolding in Invention activities, when followed by instruction, can help students encode deep features of the domain and build on their failures during Productive Failure. These results further suggest not all failures are equally productive, and that some forms of support help students learn form their failed attempts.     

Intuitive Interference in Probabilistic Reasoning

One theoretical framework which addresses students’ conceptions and reasoning processes in mathematics and science education is the intuitive rules theory. According to this theory, students’ reasoning is affected by intuitive rules when they solve a wide variety of conceptually non-related mathematical and scientific tasks that share some common external features. In this paper, we explore the cognitive processes related to the intuitive rule more A–more B and discuss issues related to overcoming its interference. We focused on the context of probability using a computerized “Probability Reasoning – Reaction Time Test.” We compared the accuracy and reaction times of responses that are in line with this intuitive rule to those that are counter-intuitive among high-school students. We also studied the effect of the level of mathematics instruction on participants’ responses. The results indicate that correct responses in line with the intuitive rule are more accurate and shorter than correct, counter-intuitive ones. Regarding the level of mathematics instruction, the only significant difference was in the percentage of correct responses to the counter-intuitive condition. Students with a high level of mathematics instruction had significantly more correct responses. These findings could contribute to designing innovative ways of assisting students in overcoming the interference of the intuitive rules.     

Teaching Writing to Students With Attention Deficit Disorders and Specific Language Impairment

Abstract

The self-regulated strategy development approach to instruction was used to help 3 middle school students who had learning problems, including attention deficit hyperactivity disorder and specific language impairment, learn a strategy for planning and writing expository essays. The composition strategy helped students to consider their topic in advance and to use text structure knowledge to develop 5-paragraph essays. Regular education teachers provided instruction to the target students in inclusive classrooms; special education teachers facilitated the writing program. A multiple-probe design across students (R. D. Horner & D. M. Baer, 1978) was used to assess the effects of the strategy. Instruction had a positive effect on the students' approach to writing and overall writing performance. Four weeks following instruction, students' papers remained improved and were still longer and more complete.     

Instruction-first and problem-solving-first approaches: alternative pathways to learning complex tasks

According to cognitive load theory, using worked examples is an effective and efficient instructional strategy for initial cognitive skill acquisition for novice learners, as it reduces cognitive load and frees up cognitive resources to build task competence. Contrary to this, productive failure (as well as invention learning, desirable difficulties and other problem-solving-first) frameworks suggest that scaffolded problem-solving activities (a generation phase) preceding explicit instruction enhance learners’ performance. The reported experimental study investigated the effectiveness of different levels of instructional guidance provided to students during the learning phase preceding explicit instruction in standard solution procedures in enhancing students’ engagement and transfer problem-solving skills. Specifically, the study compared partially-guided or unguided attempts at generating problem solutions as opposed to comprehensive guidance, in the form of a worked example. Levels of experienced cognitive load and learner motivation were evaluated in addition to delayed post-test performance scores. There were no differences between the three groups on the transfer post-test outcomes, even though the condition with fully-guided worked examples prior to the explicit instruction expectedly reduced cognitive load relative to the conditions without such guidance. There were also differences between the conditions on some sub-dimensions of the motivation scale. In general, the findings indicate that similar overall outcomes (delayed transfer performance) could be achieved by different sequences of instructional tasks aimed at achieving different sets of specific goals.     

Learning from WebQuests

WebQuests are activities in which students use Web resources to learn about school topics. WebQuests are advocated as constructivist activities and ones generally well regarded by students. Two experiments were conducted in school settings to compare learning using WebQuests versus conventional instruction. Students and teachers both enjoyed WebQuest instruction and spoke highly of it. In one experiment, however, conventional instruction led to significantly greater student learning. In the other, there were no significant differences in the learning outcomes between conventional versus WebQuest-based instruction.     

Tangible User Interfaces and Contrasting Cases as a Preparation for Future Learning

In this paper, we describe an experiment that compared the use of a Tangible User Interface (physical objects augmented with digital information) and a set of Contrasting Cases as a preparation for future learning. We carried out an experiment (N?=?40) with a 2?×?2 design: the first factor compared traditional instruction (“Tell & Practice”) with a constructivist activity designed using the Preparation for Future Learning framework (PFL). The second factor contrasted state-of-the-art PFL learning activity (i.e., students studying Contrasting Cases) with an interactive tabletop featuring digitally enhanced manipulatives. In agreement with prior work, we found that dyads of students who followed the PFL activity achieved significantly higher learning gains compared to their peers who followed a traditional “Tell & Practice” instruction (large effect size). A similar effect was found in favor of the interactive tabletop compared to the Contrasting Cases (small-to-moderate effect size). We discuss implications for designing socio-constructivist activities using new computer interfaces.     

Improving instruction of future teachers: A multimedia approach that supports implementation of evidence-based vocabulary practices

Teacher education efforts must prepare future teachers to implement evidence-based practices that are effective for all students. A strand of practices necessary for reading competence is vocabulary instruction; however, teachers spend less time teaching vocabulary as opposed to other literacy skills. In this experimental study, researchers investigated a multimedia-based intervention, which pairs video with a Content Acquisition Podcast (i.e., video plus CAP) to teach preservice teachers (N = 49) to implement vocabulary practices with struggling students. Those who watched the video plus CAP used significantly more teaching behaviors associated with an evidence-based vocabulary practice during instruction than the comparison group.     

The use of exemplars in English writing classrooms: from theory to practice

Recent literature on the use of exemplars in the context of higher education has shown that exemplar-based instruction is implemented in various disciplines; nevertheless, how exemplar-based instruction can be implemented in English-as-a-Second-Language (ESL) writing classrooms in higher education institutions remains under-explored. In this connection, this article reports on a textbook development project which adopts an exemplar-based instruction approach to be used by university English instructors to prepare students for IELTS writing (academic module). The goal of the textbook is to cultivate students’ understanding of the assessment standards of the two IELTS writing tasks through the design and use of exemplar-based dialogic and reflective activities. In this article, theoretical underpinnings of the use of exemplars, namely tacit knowledge, assessment as learning and dialogic feedback, will first be discussed in detail. Then, an overview of an ongoing project which aims to develop an exemplar-based IELTS writing textbook will be given. The last section of this article suggests practical strategies for ESL writing teachers who are interested in using exemplars to develop students’ understanding of assessment standards.     

师专学生就业思想教育探析

如何做好师专学生的就业思想教育和就业指导工作 ,是当前摆在我们面前的重要课题。面对激烈竞争的就业形势和学生的思想状况 ,应重视抓好对学生的就业形势教育、择业观教育、巩固专业思想教育 ,使学生转变就业观念 ,认准目标 ,找准位置。学校应把思想教育和就业指导结合起来 ,把思想教育和解决就业实际问题结合起来 ,走校社 (社会 )结合、校校结合、校企结合的路子 ,使人才培养更具有针对性和目标性。     

Examining the preparatory effects of problem generation and solution generation on learning from instruction

The goal of this paper is to isolate the preparatory effects of problem-generation from solution generation in problem-posing contexts, and their underlying mechanisms on learning from instruction. Using a randomized-controlled design, students were assigned to one of two conditions: (a) problem-posing with solution generation, where they generated problems and solutions to a novel situation, or (b) problem-posing without solution generation, where they generated only problems. All students then received instruction on a novel math concept. Findings revealed that problem-posing with solution generation prior to instruction resulted in significantly better conceptual knowledge, without any significant difference in procedural knowledge and transfer. Although solution generation prior to instruction plays a critical role in the development of conceptual understanding, which is necessary for transfer, generating problems plays an equally critical role in transfer. Implications for learning and instruction are discussed.     

‘Study like Italians do’ as a migration project: field research in Togo

In this article we present ethnographic research conducted on students taking an Italian language and culture course in Lomé, the capital of Togo. We interacted with the students and participated in their school days. In addition to the interviews, we turned to Focus Groups in order to investigate certain crucial issues. Our research reinforces the idea that migration is a strategy of living, even before surviving, thanks to which many students from West Africa can achieve their desire to learn and explore the world and gain access to higher quality education. We noted the importance of the preparatory phase, the process by which students acquire different skills needed to deal with the migration experience. ‘Study like Italians do’ also anticipates the scenario of the migration in the host country, which influences the expectations and behaviour that students will implement once they arrive in Italy.     

The impact of guidance during problem-solving prior to instruction on students’ inventions and learning outcomes

Multiple studies have shown benefits of problem-solving prior to instruction (cf. Productive Failure, Invention) in comparison to direct instruction. However, students’ solutions prior to instruction are usually erroneous or incomplete. In analogy to guided discovery learning, it might therefore be fruitful to lead students towards the discovery of the canonical solution. In two quasi-experimental studies with 104 students and 175 students, respectively, we compared three conditions: problem-solving prior to instruction, guided problem-solving prior to instruction in which students were led towards the discovery of relevant solution components, and direct instruction. We replicated the beneficial effects of problem-solving prior to instruction in comparison to direct instruction on posttest items testing for conceptual knowledge. Our process analysis further revealed that guidance helped students to invent better solutions. However, the solution quality did not correlate with the posttest results in the guided condition, indicating that leading students towards the solution does not additionally promote learning. This interpretation is supported by the finding that the two conditions with problem-solving prior to instruction did not differ significantly at posttest. The second study replicated these findings with a greater sample size. The results indicate that different mechanisms underlie guided discovery learning and problem-solving prior to instruction: In guided discovery learning, the discovery of an underlying model is inherent to the method. In contrast, the effectiveness of problem-solving prior to instruction does not depend on students’ discovery of the canonical solution, but on the cognitive processes related to problem-solving, which prepare students for a deeper understanding during subsequent instruction.     

Productive failure in mathematical problem solving

This paper reports on a quasi-experimental study comparing a “productive failure” instructional design (Kapur in Cognition and Instruction 26(3):379–424, 2008) with a traditional “lecture and practice” instructional design for a 2-week curricular unit on rate and speed. Seventy-five, 7th-grade mathematics students from a mainstream secondary school in Singapore participated in the study. Students experienced either a traditional lecture and practice teaching cycle or a productive failure cycle, where they solved complex problems in small groups without the provision of any support or scaffolds up until a consolidation lecture by their teacher during the last lesson for the unit. Findings suggest that students from the productive failure condition produced a diversity of linked problem representations and methods for solving the problems but were ultimately unsuccessful in their efforts, be it in groups or individually. Expectedly, they reported low confidence in their solutions. Despite seemingly failing in their collective and individual problem-solving efforts, students from the productive failure condition significantly outperformed their counterparts from the lecture and practice condition on both well-structured and higher-order application problems on the post-tests. After the post-test, they also demonstrated significantly better performance in using structured-response scaffolds to solve problems on relative speed—a higher-level concept not even covered during instruction. Findings and implications of productive failure for instructional design and future research are discussed.     

STEM‐focused high schools as a strategy for enhancing readiness for postsecondary STEM programs

The logic underlying inclusive STEM high schools (ISHSs) posits that requiring all students to take advanced college preparatory STEM courses while providing student‐centered, reform‐oriented instruction, ample student supports, and real‐world STEM experiences and role models will prepare and inspire students admitted on the basis of STEM interest rather than prior achievement for postsecondary STEM. This study tests that logic model by comparing the high school experiences and achievement of students in ISHSs and comparison schools in North Carolina. After identifying ISHS and non‐STEM comparison high schools serving students who were similar in terms of socioeconomic status and academic achievement prior to high school entry, we employed propensity‐score weighting and HLM modeling to estimate the impact of attending an ISHS on a set of outcome measures obtained from student surveys and from the state's longitudinal student data system. Analyses of student survey data found that attending an ISHS raises the likelihood that a student will complete pre‐calculus or calculus and chemistry in high school, leads to increased involvement in STEM extracurricular and out‐of‐class activities, and enhances interest in science careers and aspirations to earn a master's or higher degree. Analyses of student outcome data from state administrative records revealed a positive impact of inclusive STEM high school attendance on grade point average (GPA) but not on ACT scores. © 2016 The Authors. Journal of Research in Science Teaching Published by Wiley Periodicals, Inc. J Res Sci Teach 53: 709–736, 2016

     

English Reading Effects of Small‐Group Intensive Intervention in Spanish for K–1 English Learners

In this article we report small, but statistically significant, effects of brief supplemental instruction on English reading by Spanish‐speaking kindergartners (N = 37) who performed poorly on a bilingual battery of phonological‐processing tasks. Intervention design was compatible with the Reading First initiative and with research on use of multitiered intervention strategies for preventing reading failure among young monolingual students (e.g., L. S. Fuchs & Vaughn, 2003). We describe a Core Intervention Model (CIM) comprised of specific instructional behaviors that teachers might easily learn and employ regardless of curriculum, and discuss implications of our findings for building multitiered preventative instruction for young English learners.