Heuristic task analysis on e-learning course development: a formative research study

Utilizing heuristic task analysis (HTA), a method developed for eliciting, analyzing, and representing expertise in complex cognitive tasks, a formative research study was conducted on the task of e-learning course development to further improve the HTA process. Three instructional designers from three different post-secondary institutions in the U.S. were selected for interviews. The interviews focused on three e-learning course development cases (one from each institution), and the participants were asked to articulate their underlying thoughts and principles for designing e-learning courses. Overall, the HTA process worked well in the sense that the study could elicit procedural steps and sub-steps involved in e-learning course development and heuristic knowledge with which the instructional designers performed each step. On the surface, the e-learning course development processes that the instructional designers used looked more alike than different, entailing major steps such as meeting with faculty, developing content, monitoring courses in progress, and debriefing the instructor and students. The underlying principles and knowledge that guided each instructional designer through the processes, however, were unique in that each instructional designer constructed her own heuristics to accommodate the myriad contextual factors that arose in her work setting. The study also discussed the challenge of identifying the simplest yet most representative e-learning course development case with multiple experts and suggestions for further improving the HTA process were also presented.

Analysing and training task analysis

Hierarchical Task Analysis (HTA) is used particularly in the context of instructional development. This paper involves two exploratory studies concerning the difficulties of those learning to perform HTA (Study 1) and how these might be overcome (Study 2). In Study 1 seventeen students were provided with declarative training in the major features of HTA and were then asked to analyse the task of making a cup of tea (task 1) or of painting a door (task 2). HTAs were analysed in terms of five HTA criteria (hierarchical representation, logical decomposition rule, logical equivalence, specification of plans and the P × C rule) and four other error categories (task boundaries incorrect, cognitive goals omitted, operations described as activities rather than goals, and lack of versatility of the analysis in terms of encompassing task variation). Errors occurred with respect to all HTA criteria and other error categories suggesting that carrying out HTA is itself a complex cognitive task. This together with an analysis of questionnaire responses concerning self-reported difficulties and strategies suggested that the tendency to use an action-oriented representation of the task being analysed might be one cause of poor performance. Study 2 investigated the effectiveness of three instructional conditions at improving analysts' performance at HTA: procedure training which specified eight main goals in carrying out HTA, criteria training which involved understanding and practice at using or recognising the five HTA criteria and types of error, and combined criteria/procedure training. Performance at HTA improved in both conditions that involved criteria training.     

Heuristic Reasoning in Chemistry: Making decisions about acid strength

The characterization of students’ reasoning strategies is of central importance in the development of instructional strategies that foster meaningful learning. In particular, the identification of shortcut reasoning procedures (heuristics) used by students to reduce cognitive load can help us devise strategies to facilitate the development of more analytical ways of thinking. The central goal of this qualitative study was thus to investigate heuristic reasoning as used by organic chemistry college students, focusing our attention on their ability to predict the relative acid strength of chemical compounds represented using explicit composition and structural features (i.e., structural formulas). Our results indicated that many study participants relied heavily on one or more of the following heuristics to make most of their decisions: reduction, representativeness, and lexicographic. Despite having visual access to reach structural information about the substances included in each ranking task, many students relied on isolated composition features to make their decisions. However, the specific characteristics of the tasks seemed to trigger heuristic reasoning in different ways. Although the use of heuristics allowed students to simplify some components of the ranking tasks and generate correct responses, it often led them astray. Very few study participants predicted the correct trends based on scientifically acceptable arguments. Our results suggest the need for instructional interventions that explicitly develop college chemistry students’ abilities to monitor their thinking and evaluate the effectiveness of analytical versus heuristic reasoning strategies in different contexts.     

Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions

Traditionally, Cognitive Load Theory (CLT) has focused on instructional methods to decrease extraneous cognitive load so that available cognitive resources can be fully devoted to learning. This article strengthens the cognitive base of CLT by linking cognitive processes to the processes used by biological evolution. The article discusses recent developments in CLT related to the current view in instructional design that real-life tasks should be the driving force for complex learning. First, the complexity, or intrinsic cognitive load, of such tasks is often high so that new methods are needed to manage cognitive load. Second, complex learning is a lengthy process requiring learners motivational states and levels of expertise development to be taken into account. Third, this perspective requires more advanced methods to measure expertise and cognitive load so that instruction can be flexibly adapted to individual learners needs. Experimental studies are reviewed to illustrate these recent developments. Guidelines for future research are provided.     

Integrating cognitive task analysis into instructional systems development

Traditional methods for task analysis and training design, such as those embodied in Instructional Systems Development (ISD), decompose jobs into discrete tasks composed of specific action sequences and identify prerequisite knowledge and skills for each task. Although these methods have been effective for designing training for simple procedural skills, they offer little insight for analysis or training of jobs involving complex cognitive skills, which increasingly require training today. Because of this, cognitive considerations need to be incorporated into ISD, particularly in the task analysis phase. Recently, cognitive methods have begun to be used to conduct task analysis for training program development and human-computer system development. In this article, recent developments in cognitive task analysis are reviewed, and The Integrated Task Analysis Model (ITAM), a framework for integrating cognitive and behavioral task analysis methods within the ISD model, is presented. Discussed in detail are ITAM's three analysis stages—progressive cycles of data collection, analysis, and decision making—in three components of expertise: skills, knowledge, and mental models. This research was supported in part by the U.S. Air Force Armstrong Laboratory, Human Resources Directorate, Operational Training Division. The views contained herein are solely those of the authors and do not necessarily reflect the views of the U.S. Air Force or the Department of Defense. Both authors contributed equally to this article. Joan M. Ryder is with CHI Systems, Inc. Richard E. Redding is with Human Technology, Inc. Drs. Bernell Edwards and Thomas Killion were the technical monitors and provided valuable guidance. The authors thank John Cannon, Sharon Fisher, Wayne Zachary, and the participants of an AL/HR Workshop on Cognitive Skills Acquisition for helpful comments.     

英语教学中的任务设计

外语教学中任务的主要作用是促进学习者的语言发展,培养语言的运用能力。不仅如此,任务还有助于实现课程目标中有关增进学习情感、学习态度等方面的要求,可以树立学生的自信心,激发他们的学习动机,培养学习策略、沟通策略、批判性思维及创造性,锻炼学生跨文化沟通的意识与能力。而要达到这些目标,就需要从不同的角度考虑教学和评价任务的设计,比如:教学目的,认知策略,学习者和任务设计者(设计过程)。     

Individual performance across motoric self-regulation tasks are not correlated for pet dogs

Inhibitory control, the ability to restrain a prepotent but ineffective response in a given context, is thought to be indicative of a species’ cognitive abilities. This ability ranges from “basic” motoric self-regulation to more complex abilities such as self-control. During the current study, we investigated the motoric self-regulatory abilities of 30 pet dogs using four well-established cognitive tasks – the A-not-B Bucket task, the Cylinder task, the Detour task, and the A-not-B Barrier task – administered in a consistent context. One main goal of the study was to determine whether the individual-level performance would correlate across tasks, supporting that these tasks measure similar components of motoric self-regulation. Dogs in our study were quite successful during tasks requiring them to detour around transparent barriers (i.e., the Cylinder and Detour tasks), but were less successful with tasks requiring the production of a new response (i.e., A-not-B Bucket and A-not-B Barrier tasks). However, individual dog performance did not correlate across tasks, suggesting these well-established tasks likely measure different inhibitory control abilities, or are strongly influenced by differential task demands. Our results also suggest other aspects such as perseveration or properties of the apparatus may need to be carefully examined in order to better understand canine motoric self-regulation or inhibitory control more generally.     

Cognitive task analysis for instructional design: Applications in distance education

The increasing complexity of the subjectmatters taught through distance education calls for a cognitive approach to instructional design. Cognitive task analysis‐based instructional design (CTA‐BID) is especially appropriate for distance education, which requires high‐fidelity instructional materials that teach cognitive content with little or no classroom instruction. CTA‐BID organises instructional materials around the results of a cognitive task analysis that identifies the optimal knowledge structures, mental models, strategies, and skills underlying expertise in the subject matter. CTA‐BID has produced innovative instructional programmes aimed at teaching cognitive skills, accelerating the development of expertise, and improving student performance and training efficiency. This article provides an overview of CTA‐BID and its applications in the design of instructional and testing materials for distance education. I also review recent developments in education, psychology, and instructional design that complement CTA‐BID.     

Instructional control of cognitive load in the training of complex cognitive tasks

Limited processing capacity constrains learning and performance in complex cognitive tasks. In traditional instruction, novices' failure to adequately learn cognitive tasks can often be attributed to the inappropriate direction of attention and the related high or excessive load that is imposed on a learner's cognitive system. An instructional design model for the training of complex cognitive tasks should provide instructional strategies that control cognitive load. We propose such a model and recommend research in which the cognitive load of instructional manipulations is systematically investigated and determined with mental-effort based measures.     

Domain expertise and the effectiveness of dynamic simulator interfaces in the acquisition of procedural motor skills

Previous research into the effectiveness of dynamic versus static instructional design paradigms has reported divergent findings. Dynamic instructions have been shown to be more effective in teaching novel procedural skills. In contrast, the apparent benefit of dynamic over static instructions has been attributed in other studies to the cognitive capabilities and previous knowledge of the learner. Can the benefit of dynamic instruction persist in learners with domain expertise on learning novel tasks? In this paper, we report the result of an experiment that shows that irrespective of the learner's previous knowledge, dynamic instructions retain a significant effectiveness over statics for teaching intra‐domain novel task performance. Twenty‐four participants with domain expertise were divided into three independent groups to perform a procedural motor task following treatment with different training interfaces. After controlling for spatial abilities and excluding previous specific‐to‐task knowledge, we observe that participants that trained with interfaces containing dynamic content recorded better task performance measures than others using non‐dynamic interfaces. This suggest that within the context of motor skill acquisition, dynamic instructional interfaces can yield significant increases to post‐learning task performance measures, which is independent of the learner's cognitive capabilities or previous knowledge.     

刍议教师的阳光心态对合作学习的影响

合作学习是指学习者在合作过程中进行知识构建,既包括认知的发展也包括社交技能的培养。成功的合作学习有五个基本原则。合作学习中教师的五个不同的指导任务归纳为认知任务、情感任务、共同认知任务、社交任务以及组织指导任务。教师的阳光心态对合作学习的效果起着重要的作用。     

A new heuristic for task scheduling in heterogeneous computing environment

Heterogeneous computing （HC） environment utilizes diverse resources with different computational capabilities to solve computing-intensive applications having diverse computational requirements and constraints. The task assignment problem in HC environment can be formally defined as for a given set of tasks and machines, assigning tasks to machines to achieve the minimum makespan. In this paper we propose a new task scheduling heuristic, high standard deviation first （HSTDF）, which considers the standard deviation of the expected execution time of a task as a selection criterion. Standard deviation of the expected execution time of a task represents the amount of variation in task execution time on different machines. Our conclusion is that tasks having high standard deviation must be assigned first for scheduling. A large number of experiments were carried out to check the effectiveness of the proposed heuristic in different scenarios, and the comparison with the existing heuristics （Max-min, Sufferage, Segmented Min-average, Segmented Min-min, and Segmented Max-min） clearly reveals that the proposed heuristic outperforms all existing heuristics in terms of average makespan.     

In the eyes of the beholder: How experts and novices interpret dynamic stimuli

Tasks with a complex, dynamic visual component require not only the acquisition of conceptual/procedural but also of perceptual/attentional skills. This study examined expertise differences in perceiving and interpreting complex, dynamic visual stimuli on a performance and on a process level, including perceptual and conceptual strategies. Performance, eye movement, and verbal report data were obtained from seven experts and 14 novices. Results show that experts compared to novices attend more to relevant aspects of the stimulus, use more heterogeneous task approaches, and use knowledge-based shortcuts. Implications for instructional design for the acquisition of perceptual skills are discussed.     

Relative expertise in an everyday reasoning task: Epistemic understanding, problem representation, and reasoning competence

Experts in cognitive domains differ from non-experts in how they represent problems and knowledge, and in their epistemic understandings of tasks in their domain of expertise. This study investigates whether task-specific epistemic understanding also underlies the representation of knowledge on an everyday reasoning task on which the competent reasoners have neither expert domain knowledge nor training. 180 people on jury duty were assessed for epistemological understanding about the nature of knowledge and knowing in general, understanding of the specific task of the juror, and level of argument skill and evidence representation on two jury cases. Epistemic construal of the juror task and task-specific competent reasoning was found related to general epistemology, argument skills, and representation of the evidence. Additionally, estimations of the possibility of certainty in general and in a juror task predicted the participants' expressed certainty about their verdict choices. Implications for developing everyday reasoning competence are discussed.     

Instructional Design as a Professional Development Tool-of-Choice for Graduate Teaching Assistants

Institutions need effective and efficient methods of professional development for preparing graduate students to teach. These skills are important both for their immediate roles as teaching assistants (TAs) and for their eventual roles in the professoriate. An iterative process model from instructional design can function as a cognitive organizational framework for the development of teaching expertise. It facilitates expertise by supporting TAs in connecting new and existing knowledge about teaching and learning in meaningful ways that reflect the cognitive processes of expert teachers. Thus, it can support both the current and future development of teaching expertise and facilitate the application of knowledge in the form of teaching strategies. Patricia L. Hardré earned her Ph.D. in Education at the University of Iowa. She specializes in Instructional Design and Technology with emphases on cognition and instruction, human motivation, and educational assessment. She is currently an Assistant Professor in the Department of Educational Psychology at the University of Oklahoma. Her current research pursuits include K-12 teacher education, TA training and development, high school students' motivation to learn and persist in school, and the effects of computer-based administration of research instruments.     

Disabled readers' processing of prose: Do any processes change because of intervention?

A multiple baseline design was implemented to address the questions, “Do qualitative changes in reported strategies occur during treatment and does strategy instruction concurrently influence a conceptually related task?” The dependent measure for the prose recall task was the number of idea units recalled, while the number of facts comprehended during silent reading sessions assessed transfer effects. “Thinking aloud protocols” were used to identify cognitive processes during prose recall. The results suggested that a qualitative shift in verbal strategy reports occurred across training sessions. The introduction of cognitive training (visual and verbal mapping of idea units) increased the recall of prose compared to the baseline conditions, although concurrent effects on reading comprehension tasks were minimal. It was assumed that unstable cognitive processes during prose recall, as well as nonequivalent mental processes between the two tasks, accounted for the poor transfer of training effects.     

Implications of task structure on self‐regulated learning and achievement

School tasks interact with student motivation, cognition, and instruction to influence learning and achievement. Heeding calls for additional research linking motivational and cognitive factors in learning and instruction on specific tasks within authentic classroom settings we quantitatively and qualitatively track 90 tenth‐grade science students’ motivation, reported use of learning strategies, achievement, calibration, and task perceptions as they engage in a well‐structured task (WST) and an ill‐structured task (IST). Students achieved higher grades on, and reported more ease and value for, the WST whereas they utilised critical thinking and peer learning strategies more on the IST. Lower academic achievers calibrated their achievement less accurately on each task and experienced lower grades, interest, ease, and management capability on the IST. Conversely, higher academic achieving students reported more self‐efficacy and effort regulation and lower anxiety and elaboration on the IST. Motivation – notably less intrinsic goal orientation in low academic achievers and higher task value and self‐efficacy – predicted performance on the IST. The structure of tasks may provide prompts that illicit unique self‐regulated learning responses in students.     

The role of task design and argumentation in cognitive development during peer interaction: The case of proportional reasoning

This paper examines task design that affords deep changes in mathematical thinking in the context of peer interaction. We describe a study in which 60 low-level high-school students solved a proportional reasoning task, the “blocks” task as individuals and/or in dyadic interaction. We show that we could tailor the design of the task in order to create a cognitive conflict among dyads, notwithstanding the strategies used by the students. We show that students' proportional reasoning strategies did not improve as a result of discussion even when guided by an experimenter dedicated at reaching consensus; however the introduction of a hypothesis testing device and the guidance of the experimenter to accommodate divergent views led peers to impressive conceptual change in their discussion and in an individual post-test. Examination of one case of dyadic interaction shows that beyond the value of given characteristics of individuals or of tasks, the process of argumentation that takes place between the peers explains the subsequent gains of the individuals. The conditions under which conceptual change was attained challenge theoretical views on cognitive development and social interactions.