Individual differences in decision-making and confidence: capturing decision tendencies in a fictitious medical test

Decision-making is a complex process that is largely studied from an experimental perspective or in specific organizational contexts. As such, no generalizable framework exists with which to study decision-making from an individual differences perspective for predictive/selection purposes. By generalising a context-specific decision model proposed by Koriat and Goldsmith (1996), the focus of this research was to therefore test a novel framework for studying individual differences in decision-making tendencies. Utilising this framework within a fictitious Medical Decision-Making Test (MDMT) yielded five novel variables that provided unique insight into individuals’ decision tendencies: Optimal, Realistic, Incompetent, Hesitant and Congruent. Metacognitive confidence and its calibration (bias and CAQ) were used as predictor variables to validate this framework. One hundred ninety-three undergraduate students completed the MDMT and three cognitive ability tests with confidence ratings, a personality questionnaire, and the Need for Closure questionnaire. All decision tendency variables demonstrated excellent internal consistency and were predicted by the metacognitive variables incrementally to the remaining variables as hypothesized. Additionally, the metacognitive indices were found to generalize across the decision-making and cognitive tests. The results imply that this novel framework and MDMT reliably capture individuals’ decision behaviour that shares a meaningful relationship with their general confidence and calibration.     

Mastering cognitive development theory in computer science education

To design an effective computer science curriculum, educators require a systematic method of classifying the difficulty level of learning activities and assessment tasks. This is important for curriculum design and implementation and for communication between educators. Different educators must be able to use the method consistently, so that classified activities and assessments are comparable across the subjects of a degree, and, ideally, comparable across institutions. One widespread approach to supporting this is to write learning objects in terms of Bloom’s Taxonomy. This, or other such classifications, is likely to be more effective if educators can use them consistently, in the way experts would use them. To this end, we present the design and evaluation of our online interactive web-based tutorial system, which can be configured and used to offer training in different classification schemes. We report on results from three evaluations. First, 17 computer science educators complete a tutorial on using Bloom’s Taxonomy to classify programming examination questions. Second, 20 computer science educators complete a Neo-Piagetian tutorial. Third evaluation was a comparison of inter-rater reliability scores of computer science educators classifying programming questions using Bloom’s Taxonomy, before and after taking our tutorial. Based on the results from these evaluations, we discuss the effectiveness of our tutorial system design for teaching computer science educators how to systematically and consistently classify programming examination questions. We also discuss the suitability of Bloom’s Taxonomy and Neo-Piagetian theory for achieving this goal. The Bloom’s and Neo-Piagetian tutorials are made available as a community resource. The contributions of this paper are the following: the tutorial system for learning classification schemes for the purpose of coding the difficulty of computing learning materials; its evaluation; new insights into the consistency that computing educators can achieve using Bloom; and first insights into the use of Neo-Piagetian theory by a group of classifiers.     

“How do I remember when I got my dog?” The structure and development of children’s metamemory

Kreutzer et al.’s (Monographs of the Society for Research in Child Development 40(1):1–60, 1975) metamemory interview has been widely used in children’s metamemory literature, yet the psychometric properties of the measure have yet to be reported, and the format and language of some subtests may pose problems for young children. Researchers often combine subtests with other tests purported to measure metamemory, yet there is little empirical data regarding how these subtests relate. It has been proposed that metamemory is comprised of distinct procedural and declarative components, but this has not been empirically tested in young children. Therefore, the two studies reported here aimed to adapt Kreutzer et al.’s interview to increase its developmental appropriateness, to examine the relationship between the interview subtests, to add subtests that purport to test procedural metamemory, and then to examine the factor structure of the resulting scores and investigate how metamemory changes with age across the elementary school years. The results suggest that the adapted versions of the subtests are generally less contaminated by language ability, especially for the younger children. Factor analysis indicated the presence of two declarative metamemory factors and one procedural metamemory factor. Both declarative factors followed a similar developmental trajectory, increasing steadily from early to late elementary school age, whereas procedural metamemory increased significantly between Grades 1 and 3 only.     

Mothers’ stress,resilience and early intervention

The aim of the study was to examine factors that predict maternal stress, reported by mothers whose infants were diagnosed as having developmental disabilities at the beginning of participating in an early intervention programme ‘Me and My Mommy’ and after one year. A second goal was to identify and to portray a subgroup of resilient mothers. The sample consisted of 70 mothers from intact families, whose infants were diagnosed mostly with Down’s syndrome. All mothers were receiving early intervention services. The mothers were presented questionnaires—Sense of coherence (SOC); Family adaptability and cohesion evaluation (FACES III); Coping scale of parenting stress index (PSI‐SF), at the beginning and at the end of the year. They were also interviewed at the end of the intervention regarding their satisfaction with the programme. The results showed that at the beginning of the year, the mothers’ sense of coherence had predicted the stress experience. After a year of participation in the intervention, in addition to the contributions of the initial stress and the mothers’ satisfaction with the intervention programme, the following variables: the mothers’ sense of coherence, coping style and family cohesion, assessed at the beginning of the intervention, were considered. A group of resilient mothers was identified and they revealed following intervention a higher sense of coherence, lower stress, an increased family cohesion and decreased family adaptation measures. The results have implications for the planning of effective intervention programmes.     

Introduction to the special Issue “applied metacognition: real-world applications beyond learning”

Metacognition and Learning - Research in the area of metacognition is on the rise. Translating and applying the fruits of basic scientific results to various end-users and real-world scenarios is...     

Confidence to spare: individual differences in cognitive and metacognitive arrogance and competence

Metacognition and Learning - While some individuals are able to confidently make competent choices, others make poor decisions but are unjustifiably confident. What are their individual...     

Metacognitive beliefs, self-confidence and primary learning environment of sixth grade students

Metacognition is an integral component of a self-regulated approach to learning. The present study examined the relationships between academic self-efficacy and perceptions of one's own competence in memory and reasoning abilities, and their role in predicting the Self-confidence trait. The study also aimed to determine the role of key classroom factors (goal orientation and self-efficacy with the teacher) in predicting self-beliefs, the Self-confidence trait and academic achievement in Year 6 students (N = 177). EFA and Path analysis were used to determine these relationships. The hypothesised path model was tested in a simultaneous fashion of the entire system of variables to determine whether or not hypothesised relationships were consistent with data. The results suggest that academic self-efficacy and metacognitive competency beliefs define a broad factor—Metacognitive Beliefs—which serves as a key predictor of Self-confidence. Mastery goal-orientation and self-efficacy with teacher predicted Metacognitive Beliefs and, indirectly, Self-confidence. Students with stronger Metacognitive Beliefs were less engaged in self-handicapping behaviours. Known common factors—intelligence, gender and a proxy for SES, school fees—were controlled for. The present study has important implications for both metacognitive theory and educational practice.     

First- and second-order metacognitive judgments of semantic memory reports: The influence of personality traits and cognitive styles

In learning contexts, people need to make realistic confidence judgments about their memory performance. The present study investigated whether second-order judgments of first-order confidence judgments could help people improve their confidence judgments of semantic memory information. Furthermore, we assessed whether different personality and cognitive style constructs help explain differences in this ability. Participants answered 40 general knowledge questions and rated how confident they were that they had answered each question correctly. They were then asked to adjust the confidence judgments they believed to be most unrealistic, thus making second-order judgments of their first-order judgments. As a group, the participants did not increase the realism of their confidence judgments, but they did significantly increase their confidence for correct items. Furthermore, participants scoring high on an openness composite were more likely to display higher confidence after both the first- and second-order judgments. Moreover, participants scoring high on the openness and the extraversion composites were more likely to display higher levels of overconfidence after both the first- and second-order judgments. In general, however, personality and cognitive style factors showed only a weak relationship with the ability to modify the most unrealistic confidence judgments. Finally, the results showed no evidence that personality and cognitive style supported first- and second-order judgments differently.     

Acute short-term sleep deprivation does not affect metacognitive monitoring captured by confidence ratings: a systematic literature review

This article presents the results of a systematic review of the literature surrounding the effects that acute sleep deprivation has on metacognitive monitoring. Metacognitive monitoring refers to the ability to accurately assess one’s own performance and state of knowledge. The mechanism behind this assessment is captured by subjective feelings of confidence concerning the accuracy of our judgments or performance. These judgments influence decision behavior. How well these subjective feelings fit with reality is critical for good decision making. For example, a driver who is overconfident in their ability to remain vigilant after a night without sleep is at risk of having an accident. A learner who is overconfident in their ability to perform well on an exam without sleep is at risk of failing. A break down in metacognitive monitoring might be responsible for the increase in poor decision making observed when people are sleep deprived. Using defined search terms and exclusion criteria, electronic database searches identified ten empirical studies suitable for review. Participants in these studies completed performance-based tasks, typically cognitive, while remaining awake for 28–63 hours. In all studies, metacognitive monitoring was assessed via confidence ratings either pre-, on-, or post-task. Extended wakefulness had a significant negative effect on performance in most studies. Evidencing good monitoring, however, the monitoring estimates such as confidence also tended to decline. Moreover, two critical variables that assess the fit of these estimates to actual performance (bias and discrimination) were mostly unaffected by the number of hours awake. Still, some results indicated that these variables may be affected by substances intended to fight sleep deprivation, such as modafinil. Within the limitations of extant literature (e.g., a sampling bias towards young adult male participants), empirical observations to date converge to suggest that metacognitive monitoring remains largely unaffected by the examined quantities of acute sleep deprivation (up to 63 hours).