A sequence of learning processes in an intelligent tutoring system from topic-related appraisals to learning gains

Although intelligent tutoring systems (ITSs) are increasingly used, it is unclear which psychological processes precede students' learning gains. Using a pre- and posttest design, the present study examined a sequence of psychological processes informed by control value theory. We investigated (a) whether secondary school students' topic-related cognitive appraisals (value and control) affected their task-related affective (enjoyment and boredom) and cognitive (engagement and performance) outcomes while using the ITS and (b) whether task-related outcomes affected learning. Path analyses showed that students’ topic-related interest, but not perceived utility, personal importance or self-efficacy, was associated with task-related enjoyment. In turn, enjoyment showed reciprocal effects on and of engagement and ongoing task performance, which predicted final performance and, ultimately, learning gains. The influence of boredom, in contrast, was minimal along this sequence. More generally, the findings highlight the difficulty of establishing a clear pattern of sequential causation derived from control value theory for the current ITS context, with evidence demonstrating the systematic influence of confounders accounting for the predicted relations among components. Despite these limitations, we identified key psychological processes involving the contribution of affective and cognitive processes to learning in the ITS context.     

Activity theory as a framework for designing constructivist learning environments

The epistemic assumptions of constructive learning are different from those of traditional instruction, so classical methods of needs and task analysis are inappropriate for designing constructivist learning environments (CLEs). This paper argues that activity theory provides an appropriate framework for analyzing needs, tasks, and outcomes for designing CLEs. Activity theory is a socio-cultural, socio-historical lens through which designers can analyze human activity systems. It focuses on the interaction of human activity and consciousness within its relevant environmental context. Since conscious learning emerges from activity (performance), not as a precursor to it, CLEs should attempt to replicate the activity structures, tools and sign systems, socio-cultural rules, and community expectations that performers must accommodate while acting on some object of learning. After explicating assumptions of activity theory and briefly describing the components of CLEs, this paper describes a process for using activity theory as a framework for describing the components of an activity system that can be modeled in CLEs.His current research focuses on designing constructivist learning environments, cognitive tools for learning, knowledge representation methods, problem solving, computer-supported collaborative argumentation, cognitive task analysis, and individual differences and learning.His current research focuses on designing constructivist learning environments, cognitive tools for learning, knowledge representation methods, problem solving, computer-supported collaborative argumentation, cognitive task analysis, and individual differences and learning.Her research interests include activity theory and structural knowledge.     

Interactivity in Video-based Models

In this review we argue that interactivity can be effective in video-based models to engage learners in relevant cognitive processes. We do not treat modeling as an isolated instructional method but adopted the social cognitive model of sequential skill acquisition in which learners start with observation and finish with independent, self-regulated performance. Moreover, we concur with the notion that interactivity should emphasize the cognitive processes that learners engage in when they interact with the learning environment. The four-component instructional design (4C/ID) model is used to define a set of cognitive processes: Elaboration and induction enable learners to construct schemas, whereas compilation and strengthening enable learners to automate these schemas. Pacing, cues, control over appearance, prediction, working in dyads, personalized task selection, and reflection prompts are identified as guidelines that might support learners to interactively construct schemas. Personalized task selection with part-task practice helps learners to interactively automate schemas.     

Promoting awareness of the characteristics of classrooms’ complexity: A course curriculum in teacher education

This article presents a video and internet site based intervention designed to address the difficulties that the complex classroom environment poses for teachers, and then presents the study of its effectiveness as applied with 21 trainees in a university teacher education program. The intervention emphasized implicit cognitive processes as central to teaching–learning processes and the utilization of theoretical knowledge while making sense of the interrelations in complex situations. Trainees’ pre- and post-intervention responses to a video-case analysis task underwent content analysis using six dimensions. Paired-samples t-tests were calculated. Following the intervention, the novices exhibited a shift toward a cognitive rather than behavioral perspective; an increased ability to identify and interpret implicit and explicit factors and interrelations, reflecting a higher awareness of complexity; and an enhanced capacity to link perceived teaching–learning processes to theoretical knowledge.     

The impact of complexity on the expertise reversal effect: experimental evidence from testing accounting students

Element interactivity is a central concept of cognitive load theory that defines the complexity of a learning task. The reduction of task complexity through a temporary segmentation or isolation of interacting elements was investigated with 104 students randomly assigned to an interacting elements group, where participants were required to deal with complex accounting problems in their entirety, or an isolated elements group, where the task was broken down into constituent components. The results provide strong support for the expertise reversal effect with isolated elements beneficial for novices, while interacting elements were appropriate for more knowledgeable learners. Critically, these results only were obtained for high rather than low element interactivity materials. It was concluded that segmentation or element isolation should consider the expertise of the learner in conjunction with the complexity of the learning material.     

Component processes in reading: shared and unique variance in serial and isolated naming speed

Reading ability is comprised of several component processes. In particular, the connection between the visual and verbal systems has been demonstrated to play an important role in the reading process. The present study provides a review of the existing literature on the visual verbal connection as measured by two tasks, rapid serial naming and isolated (or discrete-trial) naming speed, as they relate to reading ability. For each identified study, a secondary data analysis was conducted using the provided correlations between serial naming, isolated naming, and reading. The same analysis was repeated for average population-level correlations among these constructs using meta-analytic weighting techniques. Results suggested that isolated naming acts as a suppressor variable in the relation of serial naming with reading, indicating that there exists at least one cognitive component of the serial naming task that is predictive of reading but is not shared with isolated naming speed. The effect has several implications for understanding the underlying cognitive components reading ability, which are discussed.     

The cognitive profile of creativity in design

The objective of the study was to explore the cognitive profile of creativity in design by applying a new approach to the assessment of creativity based on the theory of meaning (Kreitler & Kreitler). The assessment of meaning enables to identify cognitive processes that characterize an individual as well as those necessary for good performance of some cognitive act, such as creativity. It was hypothesized that creativity in design will include partly cognitive components identified in previous studies of creativity and partly new ones. The participants were 52 students in a school of design, who were administered a designing task and the Meaning Test, assessing a broad range of cognitive processes. The design products were assessed for creativity by three experienced architects. The cognitive processes, differentiating significantly between the students who produced highly creative designs and those who produced less creative ones, were interpreted as constituting the cognitive profile of creativity in design. The obtained profile supported the hypothesis and provided information about the cognitive processes of creativity in design, which may also be used for promoting creativity in design students.     

The contribution of attentional processes to calculation skills in second and third grade in a typically developing sample

Attention is an important, multifaceted cognitive domain that includes many key cognitive processes involved in learning. This study aimed to identify the predictive links between different components of attentional skills and core calculation skills development, using two standardized measures assessing calculation (AC-MT 6–11) and attention skills (CAS) in a sample of 143 typically developing children of age range from 7.6 years to 9.4 years. The results showed that in 2nd grade, selective visuo-spatial attention emerged as an important predictor in the written calculation task, while the ability to inhibit distracting information seemed to better predict accuracy in oral calculation. In 3rd grade, visuo-spatial components of attention emerged as no longer predictive, whereas planning and active visuo-spatial attention abilities emerged as predictive of accuracy in the oral calculation task. These results confirm previous findings about the contribution that attentional skills may have in calculation skills development, supporting evidence for progressive automation attentional components over time.

     

Integrating cognitive task analysis into instructional systems development

Traditional methods for task analysis and training design, such as those embodied in Instructional Systems Development (ISD), decompose jobs into discrete tasks composed of specific action sequences and identify prerequisite knowledge and skills for each task. Although these methods have been effective for designing training for simple procedural skills, they offer little insight for analysis or training of jobs involving complex cognitive skills, which increasingly require training today. Because of this, cognitive considerations need to be incorporated into ISD, particularly in the task analysis phase. Recently, cognitive methods have begun to be used to conduct task analysis for training program development and human-computer system development. In this article, recent developments in cognitive task analysis are reviewed, and The Integrated Task Analysis Model (ITAM), a framework for integrating cognitive and behavioral task analysis methods within the ISD model, is presented. Discussed in detail are ITAM's three analysis stages—progressive cycles of data collection, analysis, and decision making—in three components of expertise: skills, knowledge, and mental models. This research was supported in part by the U.S. Air Force Armstrong Laboratory, Human Resources Directorate, Operational Training Division. The views contained herein are solely those of the authors and do not necessarily reflect the views of the U.S. Air Force or the Department of Defense. Both authors contributed equally to this article. Joan M. Ryder is with CHI Systems, Inc. Richard E. Redding is with Human Technology, Inc. Drs. Bernell Edwards and Thomas Killion were the technical monitors and provided valuable guidance. The authors thank John Cannon, Sharon Fisher, Wayne Zachary, and the participants of an AL/HR Workshop on Cognitive Skills Acquisition for helpful comments.     

Diagrammatic Literacy in Secondary Science Education

Students in secondary science education seem to have difficulties with understanding diagrams. The present study focused on explanatory factors that predict students’ difficulties with process diagrams, i.e., diagrams that describe a process consisting of components that are related by arrows. From 18 compulsory national Biology exams of secondary school pre-university students, all process diagram tasks (n?=?64) were included in corpus. Features of the task, student, and diagram were related to the difficulty of that particular task, indicated by the cohort mean exam score. A hierarchical regression analysis showed main effects for (1) the cognitive task demand, (2) the familiarity of the components, and (3) the number of components in a diagram. All these main effects were in the expected direction. We also observed interactions. Within the category of tasks with a high cognitive demand, tasks about a diagram of which students have low prior content knowledge were more difficult than tasks about a diagram of which students have high prior content knowledge. Tasks with a high cognitive demand about a diagram with familiar arrows were, surprisingly, more difficult than tasks with a high cognitive demand about a diagram with unfamiliar arrows. This latter finding might be attributed to compensation for task difficulty by the large number of components in the diagrams involved. The final model explained 46 % of the variance in exam scores. These results suggest that students have difficulties (1) with tasks that require a deeper understanding when the content is new, (2) with diagrams that use unfamiliar component conventions, and (3) with diagrams that have a small number of components and are therefore probably more abstract.     

Metacognitive Instruction: Trainers Teaching Thinking Skills

Humans have the ability to monitor and control their conscious cognitive processes. This ability, called metacognition, implies that people can learn to optimize their cognitive processes. Recent research in metacognition provides new ways of accelerating learning and skill transfer through an improvement in the decision-making, problem solving, and attentional skills of trainees. This paper provides a critical review of recent research in metacognition and presents recommendations for assessing and facilitating metacognitive skills in trainees, using cognitive-based techniques for task analysis and instructional design.     

基于认知负荷理论的有效教学设计研究

有效教学设计应基于学习者的认知规律,设法降低外在、内在认知负荷,同时增加相关认知负荷。在教学设计时,可以采用自由目标策略、关联信息捆绑策略、一步到位策略与多通道策略降低外在认知负荷;采用任务先"分"后"整"逐步呈现策略与任务先"简"后"繁"二次呈现策略降低内在认知负荷;采用变异任务策略与嵌入支架策略增加相关认知负荷。     

Cognitive Control Predicts Academic Achievement in Kindergarten Children

Children's ability to shift behavior in response to changing environmental demands is critical for successful intellectual functioning. While the processes underlying the development of cognitive control have been thoroughly investigated, its functioning in an ecologically relevant setting such as school is less well understood. Given the alarming number of children who face failure in the U.S. school system, the purpose of this project is to determine whether subtly different measures of cognitive control differentially predict academic achievement. Sixty‐five kindergarten children were given two versions of a Dimensional Change Card Sort task—a geometric version followed by a linguistic version. Educational outcomes consisted of a standardized measure of academic achievement as well as assessments used by the school district. Results revealed that cognitive control, particularly as assessed by the linguistic variant, predicted children's academic performance on math and school‐based assessments, thereby suggesting that deficient cognitive control negatively impacts educational success.     

从“工作流”到“学习流”：E-learning系统设计的新视角

目前大多数E-learning支持系统基于内容对象设计,由此造成的学习者控制、网络迷失和认知超载等问题已成为制约E—learning发展的瓶颈。本文借鉴“工作流”的理念,结合学习活动的流程化特性,提出了“学习流”的概念,并建立了学习流的数学模型——ATC模型,在此基础上分析了学习流的构成要素和控制策略设计,试图为E—learning系统的设计和开发提供新的思路和视角。最后简要介绍了本研究开发的基于“学习流”理念的管理系统功能架构,该系统已于2006年成功地应用于一项由教育部主持的面向全国的教师培训项目。研究结果表明,学习者对于“学习流”管理系统支持下的培训有着很高的评价和认同度;采用基于“学习流”的方式组织和管理学习活动,可以大大提高系统的易用性和学习活动的组织效率,避免学习者网络迷航,从而为实施有效教学、促进有意义的学习创造了条件。     

Modeling complexity and difficulty in measures of fluid intelligence

This article applies structural equation modeling to the simultaneous study of task complexity and difficulty in measures of fluid intelligence. The interrelation between 3 tests of fluid intelligence, 2 experimental tasks, and age is examined. Each experimental task is decomposed into 4 subtasks, with the most intellectually demanding ones being measures of fluid intelligence, and the remaining 3 levels constructed to be gradually simpler. The findings suggest that the experimental manipulations produced systematic changes in 3 sets of parameters. These are: (a) the mean intercept parameters of the structural equation model—interpreted as “pure test difficulties” reflecting task‐specific demands placed on elementary cognitive processes of the “same kind” (b) factor loadings on 2 subtask‐specific narrow factors (SWAPS and TRIPLETS) that reflect demands placed on processes of “similar kinds,” that is, processes common to variations within the same experimental task; and (c) factor loadings on a fluid intelligence factor (Gf) that reflect demands placed on processes of “diverse kinds,” which are common to measures of a broad range of different cognitive tasks. The results indicate that as task requirements become more demanding, cognitive processes of the same kind, which are involved in solving the easier subtasks, are no longer critical to performance, but the demand on processes of similar and diverse kinds is increased. It is suggested that for human subjects, increase in task complexity may be associated with lapses of attention in the course of carrying out a series of interconnected steps.     

Linking Brain Growth with the Development of Scientific Reasoning Ability and Conceptual Change during Adolescence

The hypothesis that an early adolescent brain growth plateau and spurt exists and that this plateau and spurt influence students' ability to reason scientifically and to learn theoretical science concepts was tested. In theory, maturation of the prefrontal lobes during early adolescence allows for improvements in students' abilities to inhibit task‐irrelevant information and coordinate task‐relevant information, which along with both physical and social experience influences scientific reasoning ability and the ability to reject scientific misconceptions and accept scientific conceptions. Two hundred ten students ages 13–16 years enrolled in four Korean secondary schools were administered tests of four prefrontal lobe activities, a test of scientific reasoning ability, and a test of air pressure concepts derived from kinetic‐molecular theory. A series of 14 lessons designed to teach the concepts were then taught. The concepts test was then readministered following instruction. As predicted, among the 13‐ and 14‐year‐olds, performance on the prefrontal lobe measures remained similar or regressed. Performance then improved considerably among the 15‐ and 16‐year‐olds. Also as expected, the measures of prefrontal lobe activity correlated highly with scientific reasoning ability. In turn, prefrontal lobe activity and scientific reasoning ability predicted concept gains and posttest performance. A principal components analysis showed that the study variables had two main components, which were interpreted as an inhibiting and a representing component. Therefore, theoretical concept acquisition was interpreted as a process involving both the inhibition of task‐irrelevant information (i.e., the rejection of intuitively derived misconceptions) and the representation of task‐relevant information (i.e, complex hypothetico‐deductive arguments and counterintuitive scientific conceptions about nonobservable entities). © 2000 John Wiley & Sons, Inc. J Res Sci Teach 37: 44–62, 2000     

认知灵活性理论及其对教学实践的启示

认知灵活性理论是基于对高级学习的研究而提出的学习理论,是教学的重要依据之一,它强调知识的学习是一个双向建构的过程。在教学实践中应用认知灵活性理论应结合学习领域特征、考虑学生的年龄、任务难度及情绪等影响因素,运用认知灵活性超文本随机进入教学,培养学生的多元认知表征,最终达到促进迁移的教学目的。     

教学认知能力：教师专业发展核心力

教师教学认知能力是以教学系统为认知对象,对教学目标、学习任务、学习者特点、教学策略与方法以及教学情境等进行分析判断的能力,关系到教师专业的发展和有效教学的实现。厘清教师教学认知能力的意涵,关注教师教学认知能力培养的重要性,解析教师教学认知能力的构成要素,进而探寻其形成条件,提出发展策略与实施路径,成为新时期优化与提升教师教学认知能力的重要命题。     

The impact of student self-concept of ability and task motivation on different indicators of effort at school

The objective of the present study is to explain individual differences in student effort at school. Based on Heckhausen's (1977) extended motivation model, which was converted to represent the dispositional level, two components are considered salient motivational determinants of student effort: subjective competence (self-concept of ability) and task motivation. The impact of these variables on quantitative and qualitative indicators of student effort in mathematics is investigated. The sample consisted of N = 651 elementary students of the 5th grade. The results vary widely, depending on two task characteristics, time vs. intensity and voluntariness vs. obligation. The impact of cognitive student characteristics is much greater for time-spent variables then for intensity of effort, and the predictive power of task motivation for effort increases as a function of the voluntariness of the task.