Self-efficacy and prior domain knowledge: to what extent does monitoring mediate their relationship with hypermedia learning?

While research has documented the key role of monitoring processes during hypermedia learning, limited empirical research has used process data to examine the possibility that these processes mediate the relationship between motivational constructs (such as self-efficacy) and cognitive factors (such as prior domain knowledge) with hypermedia learning outcomes. This multi-method study addressed this issue by examining: (1) The extent to which the relationship between self-efficacy and hypermedia learning outcomes is mediated by the use of specific monitoring processes and; (2) The extent to which the relationship between prior domain knowledge and hypermedia learning outcomes is mediated by the use of specific monitoring processes. Participants included 68 education majors. A self-report questionnaire was used to measure self-efficacy, a pretest was used to measure prior domain knowledge, a posttest was used to measure learning outcomes, and a think-aloud protocol were used to identify the deployment of monitoring processes during a 30-min hypermedia learning task. Results indicated that the relationship between self-efficacy and specific monitoring processes (Monitoring Understanding, Monitoring Environment, and Monitoring Progress Towards Goals) was significantly detectable. Additionally, the relationship between prior domain knowledge and Monitoring Understanding was significantly detectable. Lastly, regression analyses revealed that the relationship between self-efficacy and hypermedia learning outcomes was mediated by the extent to which participants monitored their understanding and the environment.     

The effect of a human agent’s external regulation upon college students’ hypermedia learning

In this study we examined the effectiveness of self-regulated learning (SRL) and externally regulated learning (ERL) on college students’ learning about a science topic with hypermedia during a 40-min session. A total of 82 college students with little knowledge of the topic were randomly assigned either to the SRL or ERL condition. Students in the SRL condition regulated their own learning, while students in the ERL condition had access to a human tutor who facilitated their self-regulated learning. We converged product (pretest–posttest declarative knowledge and qualitative shifts in participants’ mental models) with process (think-aloud) data to examine the effectiveness of SRL versus ERL. Analysis of the declarative knowledge measures showed that the ERL condition group mean was statistically significantly higher than the group mean for the SRL condition on the labeling and flow diagram tasks. There were no statistically significant differences between groups on the matching task, but both groups showed statistically significant increases in performance. Further analyses showed that the odds of being in a higher mental model posttest group were decreased by 65% for the SRL group as compared to the ERL group. In terms of SRL behavior, participants in the SRL condition engaged in more use of selecting new information sources, re-reading, summarizing, free searching, and enacting control over the context of their learning. In comparison, the ERL participants engaged in more activation of prior knowledge, utilization of feeling of knowing and judgment of learning, monitoring their progress toward goals, drawing, hypothesizing, coordination of information sources, and expressing task difficulty. An earlier version of this paper was presented at the international conference of Artificial Intelligence in Education (AI-Ed 2007), Los Angeles, LA (July, 2007).     

Self-regulated learning with hypermedia: The role of prior domain knowledge

Think-aloud and pre-test data were collected from 49 undergraduates with varying levels of prior domain knowledge to examine the relationship between prior domain knowledge and self-regulated learning with hypermedia. During the experimental session, each participant individually completed a pretest on the circulatory system, and then one 40-min hypermedia learning task during which he or she learned about the circulatory system. Think-aloud data were collected during the 40-min learning task to measure each participant’s use of specific self-regulated learning processes related to planning, monitoring, and strategy use. Results indicate that prior domain knowledge is significantly related to how the participants self-regulated their learning during the 40-min learning task with hypermedia. Specifically, prior domain knowledge is positively related to participants’ monitoring and planning and negatively related to their use of strategies during the hypermedia learning task.     

Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?

We examined how self-regulated learning (SRL) and externally-facilitated self-regulated learning (ERL) differentially affected adolescents’ learning about the circulatory system while using hypermedia. A total of 128 middle-school and high school students with little prior knowledge of the topic were randomly assigned to either the SRL or ERL condition. Learners in the SRL condition regulated their own learning, while learners in the ERL condition had access to a human tutor who facilitated their self-regulated learning. We converged product (pretest-posttest shifts in students’ mental models and declarative knowledge measures) with process (think-aloud protocols) data to examine the effectiveness of self- versus externally-facilitated regulated learning. Findings revealed that learners in the ERL condition gained statistically significantly more declarative knowledge and that a greater number of participants in this condition displayed a more advanced mental model on the posttest. Verbal protocol data indicated that learners in the ERL condition regulated their learning by activating prior knowledge, engaging in several monitoring activities, deploying several effective strategies, and engaging in adaptive help-seeking. By contrast, learners in the SRL condition used ineffective strategies and engaged in fewer monitoring activities. Based on these findings, we present design principles for adaptive hypermedia learning environments, engineered to foster students’ self-regulated learning about complex and challenging science topics.

超媒体环境下自主学习有效干预模式研究——扶助式学习与英语阅读

近年来,自主学习逐渐成为学术界的一个热点问题。然而,超媒体环境下自主英语学习的有效干预模式研究却为数不多。本研究探讨超媒体环境下扶助式学习与英语阅读的关系,某综合性高校经选取的某班30名大学本科学生被随机分为两组：即无扶助学习组（NS）及概念建构组（CS）,均要求在半小时的时间内在超媒体环境下学习有关美国文化的内容。数据收集工具为有声思考法。结果显示,30分钟的自主阅读过程中,CS组的学生无论是在学习计划、学习监控,还是学习策略的使用上,都显著的高于NS组的学生;两组同学在各项学习监控指标上都呈下降趋势。研究结果还证明,有声思考法是考察超媒体环境下自主阅读过程的有效方法。     

Adaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia

This study examines the effectiveness of three scaffolding conditions on adolescents’ learning about the circulatory system with a hypermedia learning environment. One hundred and eleven adolescents (n = 111) were randomly assigned to one of three scaffolding conditions (adaptive scaffolding (AS), fixed scaffolding (FS), or no scaffolding (NS)) and were trained to use a hypermedia environment to learn about the circulatory system. Pretest and posttest data were collected to measure the qualitative changes in students’ mental models of the topic and quantitative changes in their declarative knowledge. Verbal protocols were collected during the 40-minute learning task to examine how each condition affected the way in which students regulated their learning. Findings revealed that learners in both the AS and NS conditions gained significantly more declarative knowledge than did those in the FS condition. Also, the AS condition was associated with shift in learners’ mental models significantly more than the other conditions. Associated with these significant shifts in their mental models, learners in the AS condition regulated their learning by planning and activating prior knowledge, monitoring their cognitive activities and their progress toward learning goals, using several effective strategies, and engaging in adaptive help-seeking. By contrast, those in the NS condition used fewer effective strategies, while those in the FS regulated their learning by using several regulatory processes which seemed to impede their learning. Implications for the design of scaffolds for fostering students’ self-regulated learning with hypermedia are presented.     

Investigating how college students’ task definitions and plans relate to self-regulated learning processing and understanding of a complex science topic

Winne and Hadwin (2008) identified four phases of self-regulated learning (SRL) including defining the task, setting goals and making plans, studying (i.e., learning), and adaptation. The vast majority of SRL research has focused on processing during the third phase, studying. In this study, we developed coding rubrics that allowed us to examine how the results of college students’ processing during phases one and two of Winne and Hadwin’s model, task definitions and plans, affected their SRL processing while learning with a hypermedia learning environment (HLE), and their subsequent academic performance. Our findings showed that, on average, participants gained both factual knowledge and integrated conceptual understanding over the course of learning with the HLE. The quality of participants’ task definitions and plans at pretest, as well as their SRL processing during learning, were related to learning outcomes. On average, participants’ task definitions improved from pretest to posttest. The findings from this study and the associated coding methodologies have implications for educational research and practice.     

Note-taking within MetaTutor: interactions between an intelligent tutoring system and prior knowledge on note-taking and learning

Hypermedia learning environments (HLE) unevenly present new challenges and opportunities to learning processes and outcomes depending on learner characteristics and instructional supports. In this experimental study, we examined how one such HLE—MetaTutor, an intelligent, multi-agent tutoring system designed to scaffold cognitive and metacognitive self-regulated learning (SRL) processes—interacts with learner’s prior domain knowledge to affect their note-taking activities and subsequent learning outcomes. Sixty (N = 60) college students studied with MetaTutor for 120 min and took notes on hypermedia content of the human circulatory system. Log-files and screen recordings of learner-system interactions were used to analyze notes for several quantitative and qualitative variables. Results show that most note-taking was a verbatim copy of instructional content, which negatively related to the post-test measure of learning. There was an interaction between prior knowledge and pedagogical agent scaffolding, such that low prior knowledge students took a greater quantity of notes compared to their high prior knowledge counterparts, but only in the absence of MetaTutor SRL scaffolding; when agent SRL scaffolding was present, the note-taking activities of low prior knowledge students were statistically equivalent to the number of notes taken by their high prior knowledge counterparts. Theoretical and instructional design implications are discussed.     

Domain-specificity of self-regulated learning processing in science and history

As computer-based learning environments grow in prominence, so do the demands placed upon students to learn with these tools. Empirical research has shown that students who are effective at self-regulating their learning are more likely to acquire deep conceptual understanding while using these environments. However, there is a noticeable lack of research into the degree to which self-regulated learning (SRL) is domain-specific. Investigating this theoretical question about domain-specificity results in related questions about how to best capture and model SRL. To address these concerns, we randomly assigned college students to either a science or history digital library, and used think-aloud protocol (TAP) data to examine the degree to which SRL processing predicted knowledge gains, above and beyond the effects of prior knowledge. We examined multiple methods of aggregating SRL TAP data into analysis variables, to determine which would be the most predictive of learning gains, and then tested these findings using a sample from a second study. In addition, we tested whether the frequency of SRL processing differed by academic domain. We found that data-driven aggregation methods were the most effective at predicting learning gains, and that there were both intriguing similarities in SRL processing across domains (e.g., the importance of corroborating sources) as well as differences (e.g., the predictive validity of self-questioning). Our findings have implications for how to capture and model SRL processing, as well as how to foster SRL among those students who do not yet enact it effectively on their own.     

Technology-supported learning innovation in cultural contexts

Many reform initiatives adopt a reductionist, proceduralized approach to cultural change, assuming that deep changes can be realized by introducing new classroom activities, textbooks, and technological tools. This article elaborates a complex system perspective of learning culture: A learning culture as a complex system involves macro-level properties (e.g., epistemological beliefs, social values, power structures) and micro-level features (e.g., technology, classroom activities). Deep changes in macro-level properties cannot be reduced to any component. This complex system perspective is applied to examining technology-supported educational change in East Asia and analyzing how teachers sustain the knowledge building innovation in different contexts. Working with the macro–micro dynamics in a learning culture requires a principle-based approach to learning innovation that specifies macro-level changes using principle-based instead of procedure-based terms and engages teachers’ deep reflection and creative engagement at both the macro- and the micro-level.     

Preparing preservice teachers for self-regulated learning in the context of technological pedagogical content knowledge

The present study investigated effects of two hypermedia environments on 95 preservice university teachers' self-regulated learning (SRL) in the context of technological pedagogical content knowledge (TPCK): hypermedia with metacognitive instruction (HYP + META) and without (HYP). The study combined online reflections with self-report measures to assess SRL processes. Results showed that exposure to metacognitive support using the IMPROVE self-questioning method may enhance preservice teachers' ability to reflect on and regulate their learning processes. This, in turn, can develop their TPCK, both as learners (comprehension skills) and as teachers (design skills). Further analysis indicated high correlations within SRL measures (self-reports, online reflections) and between SRL and TPCK tasks. Implications are discussed for teacher training in SRL-integrated TPCK contexts.     

The challenge of promoting self-regulated learning among primary school children with a low socioeconomic and immigrant background

The authors explore the effects of student tutoring as an approach to provide support on self-regulated learning (SRL) to fifth- and sixth-grade students with a low socioeconomic or immigrant background. In total, 401 Flemish (Belgium) students participated. A quasi-experimental study with pretest, posttest, and retention test control group design was used, combining teacher ratings, self-report questionnaires, and think-aloud protocols. The teacher rating results show a significantly positive effect from pretest to posttest for the experimental condition, but this was not maintained at the retention test. The questionnaire and think-aloud results reveal no significant effects on students’ SRL. However, differential effects depending on students’ motivational profile were found. This study illustrates the complexity of promoting SRL among primary school children with a low socioeconomic or immigrant background, recommending further research into conditions and factors influencing the effectiveness of student tutoring programs promoting SRL.     

Exploring the fluctuation of motivation and use of self-regulatory processes during learning with hypermedia

We collected think-aloud, pre-test, post-test, and motivation data from 43 undergraduates to examine the impact of conceptual scaffolds on the fluctuation of certain motivation constructs and use of self-regulatory processes during learning with hypermedia. Participants were randomly assigned to either the No Scaffolding (NS) or Conceptual Scaffolding (CS) condition. During the experimental session, each participant individually completed a pre-test on the circulatory system, a pre-task motivation questionnaire, one 30-min hypermedia learning task during which they learned about the circulatory system, a motivation questionnaire at three regular intervals during this learning task, a post-test on the circulatory system, and a post-task motivation questionnaire. Results indicated that while participants in both conditions gained declarative knowledge, participants who received conceptual scaffolds during learning demonstrated deeper understanding of the circulatory system on the post-test. In terms of self-regulatory processes, the results indicated that participants in the CS condition used significantly more planning processes during learning than participants in the NS condition. Additionally, participants in both conditions significantly decreased their use of strategies as they progressed through the learning task. Regarding motivation while learning with hypermedia, results indicated that participants in both conditions reported significantly increased levels of interest as they progressed through the learning task. Furthermore, participants in the CS condition reported the task as being easier and putting forth less effort than participants in the NS condition.

Extending the testing effect to self-regulated learning

In addition to serving summative assessment purposes, testing has turned out to be a powerful learning tool. However, while the beneficial effect of testing on learning performances has been confirmed in a large body of literature, the question of exactly how testing influences cognitive and metacognitive processes remains unclear. We therefore set out to investigate the effect of testing on self-regulated learning (SRL) processes. We hypothesized that by recalibrating metacognitive monitoring, regular practice testing can trigger efficient SRL processes and, in turn, foster learning. To test this hypothesis, we exposed first-year undergraduates to a complex neurology module. Participants were randomly assigned to either the practice testing group or a control group. The testing group underwent multiple practice tests during the neurology module, whereas the control group only underwent the multiple practice tests after the course. To assess the impact of practice testing on SRL processes, we combined a think aloud protocol with a metacognitive monitoring self-report measure. Results showed that, compared with controls, participants in the practice testing group were significantly less overconfident in their ability to recall recently learned information and performed better on a posttest questionnaire. Furthermore, mediation analyses confirmed that enhanced learning performance was explained by the use of efficient SRL processes. Therefore, these results allow us to extend the testing effect to SRL, and empirically underscore the central role of monitoring in SRL. Contributions to the fields of practice testing and SRL are discussed.     

Examining the interplay of affect and self regulation in the context of clinical reasoning

There is an active strand of research on how affect and self-regulatory activities influence performance and learning outcomes, but the mechanisms through which they interact during learning remain poorly understood. Additionally, these constructs have been under-researched in medical education. Using multimodal data in the context of a clinical reasoning task for medical students learning case diagnosis, we explored the temporal nature of cognition, affect, motivation, and self-regulation. With a sample of n = 10 medical students, we collected data on self-regulated learning (SRL) processes through think-aloud analyses; emotion data through facial expressions; and achievement goal orientations and habitual emotion regulation strategies through self-report questionnaires. Results from our sequential data mining techniques and quantitative analyses suggested that high-performing medical students (who arrived at an accurate diagnosis) differed from low-performing students (who did not arrive at correct diagnosis): Low performers reported higher performance goal orientation, and expressed more emotions overall, than high performers. High performers exhibited marginally more monitoring SRL behaviours, while low performers tended to orient and reorient throughout the task. High and low performers also differed on the co-occurrences of, and sequential transitions between, emotions and SRL behaviours. The implications of these findings with respect to research and medical education are discussed.     

Process mining techniques for analysing patterns and strategies in students’ self-regulated learning

Referring to current research on self-regulated learning, we analyse individual regulation in terms of a set of specific sequences of regulatory activities. Successful students perform regulatory activities such as analysing, planning, monitoring and evaluating cognitive and motivational aspects during learning not only with a higher frequency than less successful learners, but also in a different order—or so we hypothesize. Whereas most research has concentrated on frequency analysis, so far, little is known about how students’ regulatory activities unfold over time. Thus, the aim of our approach is to also analyse the temporal order of spontaneous individual regulation activities. In this paper, we demonstrate how various methods developed in process mining research can be applied to identify process patterns in self-regulated learning events as captured in verbal protocols. We also show how theoretical SRL process models can be tested with process mining methods. Thinking aloud data from a study with 38 participants learning in a self-regulated manner from a hypermedia are used to illustrate the methodological points.     

Analysis of self-regulated learning processing using statistical models for count data

Researchers often use measures of the frequency of self-regulated learning (SRL; Zimmerman, American Educational Research Journal, 45(1), 166–183, 2000) processing as a predictor of learning gains. These frequency data, which are really counts of SRL processing events, are often non-normally distributed, and the accurate analysis of these data requires the use of specialized statistical models. In this study, we demonstrate how to implement and interpret count statistical models in path and latent profile analyses to investigate the role of SRL as a mediator of the relation between pretest and posttest conceptual understanding. Our findings from a sample of 170 college students using a computer to learn about the circulatory system show that SRL does mediate the aforementioned relation, and that count models are a more accurate representation of SRL processing data than standard analysis models based on ordinary least squares estimation. The results of our path analyses revealed which specific SRL processes were related to learning, above and beyond the effect of prior knowledge. Our latent profile analysis revealed two groups of participants, indicative of Brophy’s (2004) model of schematic and aschematic learners. We conclude with implications and future directions for basic and applied SRL research.     

Is having more prerequisite knowledge better for learning from productive failure?

A critical assumption made in Kapur’s (Instr Sci 40:651–672, 2012) productive failure design is that students have the necessary prerequisite knowledge resources to generate and explore solutions to problems before learning the targeted concept. Through two quasi-experimental studies, we interrogated this assumption in the context of learning a multilevel biological concept of monohybrid inheritance. In the first study, students were either provided or not provided with prerequisite micro-level knowledge prior to the generation phase. Findings suggested that students do not necessarily have adequate prior knowledge resources, especially those at the micro-level, to generate representations and solution methods for a multilevel concept such as monohybrid inheritance. The second study examined how this prerequisite knowledge provision influenced how much students learned from the subsequent instruction. Although the prerequisite knowledge provision helped students generate and explore the biological phenomenon at the micro- and macro-levels, the provision seemingly did not confer further learning advantage to these students. Instead, they had learning gains similar to those without the provision, and further reported lower lesson engagement and greater mental effort during the subsequent instruction.     

Learning with videos vs. learning with print: The role of interactive features

Two complementary studies, one in the laboratory and one in the field, compared the usage patterns and the effectiveness of interactive videos and illustrated textbooks when German secondary school students learned complex content. For this purpose, two videos affording different degrees of interactivity and a content-equivalent illustrated textbook were used. Both studies showed that in contrast to previous studies working with non-interactive videos, the effectiveness of interactive videos was at least comparable to that of print, probably due to the possibilities provided for self-regulated information processing. It was shown that the interactive features of the videos were used spontaneously. However, features enabling micro-level activities, such as stopping the video or browsing, seemed to be more beneficial for learning than features enabling macro-level activities, such as referring to a table of contents or an index. This finding is explained by students’ misconceptions about the use of features enabling macro-level activities.     

A design framework for educational hypermedia systems: theory, research, and learning emerging scientific conceptual perspectives

This paper focuses on theory and research issues associated with the use of hypermedia technologies in education. It is proposed that viewing hypermedia technologies as an enabling infrastructure for tools to support learning—in particular learning in problem-based pedagogical environments involving cases—has particular promise. After considering research issues with problem-based learning related to knowledge transfer and conceptual change, a design framework is discussed for a hypermedia system with scaffolding features intended to support and enhance problem-based learning with cases. Preliminary results are reported of research involving a new version of this hypermedia design approach with special ontological scaffolding to explore conceptual change and far knowledge transfer issues related to learning advanced scientific knowledge involving complex systems as well as the use of the system in a graduate seminar class. Overall, it is hoped that this program of research will stimulate further work on learning and cognitive sciences theoretical and research issues, on the characteristics of design features for robust and educationally powerful hypermedia systems, on ways that hypermedia systems might be used to support innovative pedagogical approaches being used in the schools, and on how particular designs for learning technologies might foster learning of conceptually difficult knowledge and skills that are increasingly necessary in the 21st century.