Metacognitive judgments and disfluency – Does disfluency lead to more accurate judgments,better control,and better performance?

Theories of metacognition assume that better monitoring leads to better control and performance. Furthermore, monitoring accuracy is often low because students are overconfident (absolute accuracy) and unable to discriminate comprehension of different text-passages (relative accuracy). Fluency seems to be a cue for metacognitive judgments, and therefore, reducing fluency should lead to less automatic processing, lower judgments, and better absolute and relative accuracy. Because the accuracy of metacognitive judgments is the basis of the control of learning, disfluency should lead to more appropriate control and thus to better performance. To test these assumptions, students (N = 83) learned either with disfluent or with fluent text-passages. The results show that disfluency led to better absolute and relative accuracy but not for all types of judgments. Moreover, students hardly implemented monitoring in control, resulting in lack of improved performance. Further research is required to investigate why students did not base control on monitoring.     

Accuracy of metacognitive judgments as a moderator of learner control effectiveness in problem-solving tasks

A possible explanation for why students do not benefit from learner-controlled instruction is that they are not able to accurately monitor their own performance. The purpose of this study was to investigate whether and how the accuracy of metacognitive judgments made during training moderates the effect of learner control on performance when solving genetics tasks. Eighty-six undergraduate students solved self-selected genetics tasks using either a full learner control or a restricted learner control. Results indicated that learner control effectiveness was moderated by the absolute accuracy (i.e., absolute bias) of metacognitive judgments, and this accuracy was a better predictor of learning performance for full learner control than for restricted learner control. Furthermore, students’ prior knowledge predicted absolute accuracy of both ease-of-learning judgments (EOLs) and retrospective confidence judgments (RCJs) during training, with higher prior knowledge resulting in a better absolute accuracy. Overall, monitoring guided control, that is, EOLs predicted time-on-task and invested mental effort regardless of the degree of learner control, whereas RCJs predicted the total training time, but not the number of tasks selected during training. These results suggest that monitoring accuracy plays an important role in effective regulation of learning from problem-solving tasks, and provide further evidence that metacognitive judgments affect study time allocation in problem solving context.     

Prompting and visualising monitoring outcomes: Guiding self-regulatory processes with confidence judgments

Sensible self-regulated study decisions are largely based on monitoring learning and using this information to control learning processes, but research has found that such processes may not be initiated automatically. To support learners, we adopted prompting and visualisation methods by asking learners to assign confidence ratings to learning tasks and visualising them during re-study, and tested the effects on metacognitive and cognitive measures in an experimental study (N = 95). Results show that prompting monitoring increased study efforts while visualising monitoring outcomes during learning focussed these efforts on uncertain answers. Due to low monitoring accuracy, metacognitively sensible regulation did not lead to cognitive learning gains. While the results support the idea of using visualisation techniques to implicitly guide self-regulated learning, more needs to be done to increase monitoring accuracy. Further, our study suggests that researchers should be aware of the effect that assessing confidence judgments has on subsequent learning behaviour.     

How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system?

The goal of this study was to investigate 65 students' evidence scores of emotions while they engaged in cognitive and metacognitive self-regulated learning processes as they learned about the circulatory system with MetaTutor, a hypermedia-based intelligent tutoring system. We coded for the accuracy of detecting students’ cognitive and metacognitive processes, and examined how the computed scores related to mean evidence scores of emotions and overall learning. Results indicated that mean evidence score of surprise negatively predicted the accuracy of making a metacognitive judgment, and mean evidence score of frustration positively predicted the accuracy of taking notes, a cognitive learning strategy. These results have implications for understanding the beneficial role of negative emotions during learning with advanced learning technologies. Future directions include providing students with feedback about the benefits of both positive and negative emotions during learning and how to regulate specific emotions to ensure the most effective learning experience with advanced learning technologies.     

6- and 8-year-olds’ performance evaluations: Do they differ between self and unknown others?

The current study investigated kindergarteners and second graders’ ability to monitor and evaluate their own and a virtual peer’s performance in a paired-associate learning task. Participants provided confidence judgments (CJs) for their own responses and performance-based judgments (judgments provided after receiving feedback on their performance) for both their own and a virtual peer’s responses. For the performance-based judgments, children were confronted with their own or the peer’s answer as well as the correct answer. Additionally, participants were asked to credit their own and the peer’s correct and incorrect answers while facing feedback. Results indicate an age-related progression in metacognitive monitoring skills, with second graders differentiating more strongly in their confidence judgments between correct and incorrect responses compared to kindergarteners. Regarding performance-based judgments, children of both age groups provided higher judgments for correctly compared to incorrectly recognized items as well as for their own responses in comparison to the responses of the unknown child. Similarly, when crediting, participants of both age groups gave more credits for correct recognition than for incorrect recognition and for their own responses than for the peer’s responses. The significant interaction between age group and recognition accuracy for the crediting shows that second graders gave more credits for correctly recognized items while kindergarteners gave more credits for incorrect answers than the older children – primarily for their own incorrect answers. In conclusion, the study provides new insights into 6- and 8-year-olds’ evaluations of their own and an unknown child’s performance in a paired-associate learning task by showing that children of both age groups generally judged and credited responses in their own favor. These results add to our understanding of biases in children’s performance evaluations, including metacognitive judgments and judgments provided after receiving feedback.     

Elementary mathematics teachers’ judgment accuracy and calibration accuracy: Do they predict students’ mathematics achievement outcomes?

In this study we investigated whether elementary mathematics teachers’ knowledge of their students, as reflected in both the accuracy and confidence with which they are able to estimate their students’ task-specific performance on sets of mathematics problems, predicted students’ overall mathematics achievement. Thirty-nine teachers made predictions about the performance of a random sample of target students (n = 150) in their classrooms on sets of “easy” and “difficult” multiplication and division problems. Teachers also provided confidence ratings for those judgments. From these data, indicators of teachers’ judgment accuracy, judgment confidence and calibration accuracy (a measure of metacognitive monitoring) were then related to all of their students’ (n = 834) performance on year-end standardized mathematics achievement tests. Multilevel analyses indicate that teachers’ calibration accuracy, but not their task-specific judgment accuracy, significantly predicted students’ mathematics achievement. Implications for future research on teacher knowledge as well as professional development programs are discussed.     

Developmental patterns of school students' motivational‐ and cognitive‐metacognitive competencies

This study examined the metacognitive developmental patterns of Hong Kong school students. Students rated their own metacognitive competencies by responding to an inventory of six motivational‐ and cognitive‐metacognitive subscales. Results showed that students' metacognitive competencies decreased with age—from primary 4 (age 9) to secondary 5 (age 17)—with a sharp decline noticeable at the primary/secondary school transition. Age had a more powerful effect than gender on students' perception of their metacognitive competencies. This decreasing pattern of Hong Kong students' metacognitive competencies is contrary to the developmental trends found in Western countries. However, the comparatively high academic performance of Hong Kong students also suggests some different recommendations about student learning.     

Improving metacognition in the classroom through instruction,training, and feedback

Accurately judging one’s performance in the classroom can be challenging considering most students tend to be overconfident and overestimate their actual performance. The current work draws upon the metacognition and decision making literatures to examine improving metacognition in the classroom. Using historical data from several semesters of an upper-level undergraduate course (N?=?127), we analyzed students’ judgments of their performance and their actual performance for two exams. Students were instructed on the concepts of overconfidence, received feedback on exams, and were given incentives for accurate calibration. We found results consistent with the “unskilled and unaware” effect Kruger & Dunning (Journal of Personality and Social Psychology, 77(6), 1121–1134, 1999) where lower performing students initially displayed overconfidence and the highest performing students initially displayed underconfidence. Importantly, students were able to change both judgments and performance such that metacognitive accuracy improved significantly from the first to the second exam. In a second study, two additional semesters for the same course used in Study 1 were examined (N?=?90). For one of the semesters feedback was not provided, allowing us to determine whether feedback can improve both metacognitive judgments and performance. Our findings revealed significant improvements in performance paired with decreases in overconfidence on Exam 2, but only for students who received feedback about their performance and judgments. We postulate that feedback may be an important component in improvement metacognitive judgments.     

Do cognitive and metacognitive processes set the stage for each other?

Cognitive and metacognitive learning processes might not only functionally complement but also set the stage for each other. To address potential stage-setting effects between these processes, we conducted two experiments in which we varied whether students were prompted to engage in the cognitive processes of organization and elaboration prior to using the metacognitive processes of comprehension monitoring and remediation planning as well as implementing their remediation plans (cognitive-first sequence), or vice versa (metacognitive-first sequence). As the medium for engaging in these processes we used learning protocols, which were performed as follow-up activity to a lecture or regular lessons. We consistently found that the learners in the metacognitive-first groups outperformed their counterparts regarding the quality of the executed organization and metacognitive processes. We conclude that cognitive and metacognitive processes can influence each other's quality; however, they do not necessarily set the stage but can also damage the stage for each other.     

The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy

Monitoring one’s own study processes accurately is important in self-regulated learning. This study compared a treatment (N = 45) and comparison class (N = 39) on the effects of monitoring exercises and feedback on calibration and test performance over a 16-week undergraduate course. Path analyses revealed a significant influence of the intervention on class performance, calibration, and self-efficacy. The results suggest the appropriateness of integrating distributed metacognitive exercises in class content and the fundamental role of monitoring ability in performance-based course outcomes and self-efficacy.     

Extending Students’ Practice of Metacognitive Regulation Skills with the Science Writing Heuristic

Metacognition can be described as an internal conversation that seeks to answer the questions, ‘how much do I really know about what I am learning’ and, ‘how am I monitoring what I am learning?’ Metacognitive regulation skills are critical to meaningful learning because they facilitate the abilities to recognize the times when one's current level of understanding is insufficient and to identify the needs for closing the gap in understanding. This research explored how using the Science Writing Heuristic (SWH) as an instructional approach in a laboratory classroom affected students’ practice of metacognitive skills while solving open-ended laboratory problems. Within our qualitative research design, results demonstrate that students in the SWH environment, compared to non-SWH students, used metacognitive strategies to a different degree and to a different depth when solving open-ended laboratory problems. As students engaged in higher levels of metacognitive regulation, peer collaboration became a prominent path for supporting the use of metacognitive strategies. Students claimed that the structure of the SWH weekly laboratory experiments improved their ability to solve open-ended lab problems. Results from this study suggest that using instruction that encourages practice of metacognitive strategies can improve students’ use of these strategies.     

Self-regulated learning by writing learning protocols: Do goal structures matter?

Having students write learning protocols is an established follow-up task to course work that elicits processes of self-regulated learning. To date, a wealth of research has focused on optimizing the learning protocol task itself by integrating instructional support measures such as prompts. By contrast, research that focuses on optimizing the context in which learning protocol writing is embedded is widely missing. In the present study, we approached this gap by focusing on the role of the contextual factor goal structure. Specifically, in an experiment with N = 166 high school students we tested whether embedding the learning protocol task in a mastery goal structure would be more beneficial than embedding it in a performance goal structure. The mastery goal structure fostered metacognitive processes, learning outcomes, and learning efficiency. We conclude that considering contextual factors such as the goal structure is crucial for understanding and optimizing the effects of learning protocols.     

Examining the role of self-efficacy and online metacognitive monitoring behaviors in undergraduate life science education

In STEM education, a thorough understanding of the interaction of self-efficacy and metacognitive monitoring behaviors is needed to refine theories and inform the design of instructional supports for students with varying levels of motivation and self-regulation skills. We examined how students' (n = 1063) exam scores in an undergraduate life science course were influenced by their self-efficacy and online metacognitive monitoring behaviors by integrating variable-centered and person-centered approaches. In a semester-long study, students' self-efficacy judgements made at the end of the semester were stronger predictors of students' final exam performance than those made at the beginning of the semester. Results further suggested that the influence of self-efficacy on exam scores decreased as online monitoring behaviors increased. Students’ prior GPA predicted membership in three latent profiles indicated by 1) high self-efficacy with high metacognitive monitoring activity; 2) high self-efficacy with low metacognitive monitoring activity; and 3) low self-efficacy with low metacognitive monitoring activity. Learners with high self-efficacy and high monitoring activity outperformed those with high self-efficacy and low monitoring, who outperformed those with low self-efficacy and low monitoring on exams.     

Completion problems can reduce the illusions of understanding in a computer-based learning environment on genetics

Inaccurate judgments of task difficulty and invested mental effort may negatively affect how accurate students monitor their own performance. When students are not able to accurately monitor their own performance, they cannot control their learning effectively (e.g., allocate adequate mental effort and study time). Although students' judgments of task difficulty and invested mental effort are closely related to their study behaviors, it is still an open question how the accuracy of these judgments can be improved in learning from problem solving. The present study focused on the impact of three types of instructional support on the accuracy of students' judgments of difficulty and invested mental effort in relation to their performance while learning genetics in a computer-based environment. Sixty-seven university students with different prior knowledge received either incomplete worked-out examples, completion problems, or conventional problems. Results indicated that lower prior knowledge students performed better with completion problems, while higher prior knowledge students performed better with conventional problems. Incomplete worked-out examples resulted in an overestimation of performance, that is, an illusion of understanding, whereas completion and conventional problems showed neither over- nor underestimation. The findings suggest that completion problems can be used to avoid students' misjudgments of their competencies.     

元认知策略在口译教学中的运用

口译教学效果的好坏直接关系到学生口译技能的掌握与口译能力的提高。文章结合口译训练特点,讨论了如何将元认知策略运用到口译教学中,以及培养学生元认知意识和发展元认知策略的途径。根据教学实践和学生反馈,发现元认知策略对于口译教学质量和学生口译水平的提高均有明显效果。     

More accurate than assumed: Learners’ metacognitive beliefs about the effectiveness of retrieval practice

We doubt the prevailing interpretation of lower Judgments of Learning (JOLs) for testing over rereading to reflect learners' favoritism of an ineffective activity. We argue that JOLs for testing are biased due to a negative feedback effect. In three preregistered experiments (N_final = 306), we eliminated the feedback effect by asking students to only imagine learning with the described activities (rereading/testing) after reading a text and by capturing offline-JOLs (off-JOLs = being decoupled from the current learning experience) as a function of an imaginary final test delay (5 min/1 week/2 weeks). In 5-min conditions, off-JOLs consistently reflected no differences between rereading and testing; in 1-week and 2-week conditions, two (of three) experiments demonstrated an advantage of testing over rereading. These results are consistent with actual learning outcomes in an experiment using the same text and activities (Rummer et al., 2017, Exp. 1). Learners’ metacognitive judgments resembled actual learning outcomes more accurately than suggested by previous research.     

Relationship between maternal scaffolding and preschooler's metacognitive strategies in a problem-solving situation

This study examined how mothers' scaffolding predicts preschoolers' metacognitive strategies and task performance. N = 132 preschoolers and their mothers participated in the study. Problem-solving tasks were solved in mother-child interactions and independently. Mothers' scaffolding (means; cognitive, metacognitive, autonomy support) and mother-child task performance were coded during mother-child interactions. Children's metacognitive strategies and task performance were coded during child-alone problem-solving. Path-model analyses found that mothers' metacognitive support was negatively – and autonomy support positively – associated with mother-child task performance. Mothers' scaffolding means served different scaffolding intentions, building two scaffolding strategies: (1) Mothers using more scaffolding means provided more cognitive support, which was related to lower levels of children's metacognitive strategies. (2) Mothers using fewer scaffolding means provided more autonomy support, which was related to higher levels of children's metacognitive strategies. This study demonstrates the importance of examining scaffolding strategies and shows that different scaffolding strategies may be relevant in joint and child-alone problem-solving.     

Promoting metacognition in first year anatomy laboratories using plasticine modeling and drawing activities: a pilot study of the "blank page" technique

Many first year students of anatomy and physiology courses demonstrate an inability to self-regulate their learning. To help students increase their awareness of their own learning in a first year undergraduate anatomy course, we piloted an exercise that incorporated the processes of (1) active learning: drawing and plasticine modeling and (2) metacognition: planning, monitoring, reaction, and reflection. The activity was termed "blank page" because all learning cues were removed and students had to create models and diagrams from reflection and recall. Two hundred and eighty-two students responded to a questionnaire reporting qualitative feedback on the exercise. Based on student responses, the "blank page" activity was a positive learning experience and confirmed a need to teach metacognitive skills. From this pilot study, we established that drawing or plasticine modeling is an excellent vehicle for demonstration of the metacognitive processes that enable self-regulation: a known predictor of academic success.     

The contribution of classroom exams to formative evaluation of concept-level knowledge

Are students able to learn from exam experience about their level of knowledge for tested topics? Prior to taking an exam, undergraduates made predictive category learning judgments (CLJs) by estimating the percentage of questions they expected to answer correctly for six topics. After the exam, they made postdictive CLJs for the same topics. Supporting the postdiction superiority hypothesis, postdictive CLJs were slightly more accurate than predictive CLJs, indicating students could make better formative evaluations after taking an exam. However, postdiction accuracy was low, and in a second study, accuracy did not differ for predictive and postdictive CLJs. We also investigated two processes required to make accurate postdictive CLJs: monitoring performance for individual questions and accurately classifying each question with respect to the topic that it assessed. Although students performed these tasks adequately, their less-than-perfect performance would constrain their ability to accurately judge their topical knowledge from exam experience.     

Changing the Metacognitive Orientation of a Classroom Environment to Stimulate Metacognitive Reflection Regarding the Nature of Physics Learning

Problems persist with physics learning in relation to students' understanding and use of representations for making sense of physics concepts. Further, students' views of physics learning and their physics learning processes have been predominantly found to reflect a ‘surface’ approach to learning that focuses on mathematical aspects of physics learning that are often passed on via textbooks and lecture-style teaching. This paper reports on a teacher's effort to stimulate students' metacognitive reflection regarding their views of physics learning and their physics learning processes via a pedagogical change that incorporated the use of a representational framework and metaphors. As a consequence of the teacher's pedagogical change, students metacognitively reflected on their views of physics and their learning processes and some reported changes in their views of what it meant to understand physics and how they might learn and understand physics concepts. The findings provide a basis for further explicit teaching of representational frameworks to students in physics education as a potential means of addressing issues with their physics learning.