ADAPT<Superscript>IT</Superscript>: Tools for training design and evaluation

This article describes a set of computerized tools that support the design and evaluation of competency-based training programs. The training of complex skills such as air traffic control and process control requires a competency-based approach that focuses on the integration and coordination of constituent skills and transfer of learning. At the heart of the training are authentic whole-task practice situations. The instructional design tools are based on van Merriënboer's 4C/ID^* methodology (1997). The article describes a training design tool (Core) that supports the analysis and design for competency-based training programs and an evaluation tool (Eval) that supports the subsequent revision of this training design.     

Mental Effort and Performance as Determinants for the Dynamic Selection of Learning Tasks in Air Traffic Control Training

The differential effects of four task selectionmethods on training efficiency and transfer incomputer-based training for Air Traffic Controlwere investigated. A non-dynamic condition, inwhich the learning tasks were presented to theparticipants in a fixed, predeterminedsequence, was compared to three dynamicconditions, in which learning tasks wereselected on the basis of performance, mentaleffort, and a combination of both (i.e., mentalefficiency). Using the 3-factor mentalefficiency formula of Tuovinen and Paas (2004, this issue), the hypothesis that dynamic taskselection leads to more efficient training thannon-dynamic task selection was confirmed.However, the hypothesis that dynamic taskselection based on mental efficiency leads tomore efficient training than dynamic taskselection based on performance or mental effortalone was not supported. The results arediscussed in light of the theoretical frameworkand suggestions are given for futureresearch.     

Effects of Web-based Support for the Construction of Competence Maps

Educationalists experience difficulties with the construction of competence maps that describe final attainment levels of educational programs. Web-based support was developed with three supportive aids: A construction kit, a phenomenarium, and an information bank. Each supportive aid was expected to improve perceived process and product quality as well as learning. In a full factorial experiment, 266 educational science students constructed a competence map, whether or not supported by different combinations of the three supportive aids. The availability of the construction kit and the phenomenarium had positive effects on perceived process quality and learning. Furthermore, if there was no phenomenarium with example materials, the absence of the construction kit greatly diminished experienced support (i.e., one aspect of process quality); if a phenomenarium was present, the availability of the construction kit had relatively little effect on perceived support. In general, this study indicates that well-designed Web-based support helps to construct competence maps. in final form: 2 February 2006     

Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions

Traditionally, Cognitive Load Theory (CLT) has focused on instructional methods to decrease extraneous cognitive load so that available cognitive resources can be fully devoted to learning. This article strengthens the cognitive base of CLT by linking cognitive processes to the processes used by biological evolution. The article discusses recent developments in CLT related to the current view in instructional design that real-life tasks should be the driving force for complex learning. First, the complexity, or intrinsic cognitive load, of such tasks is often high so that new methods are needed to manage cognitive load. Second, complex learning is a lengthy process requiring learners motivational states and levels of expertise development to be taken into account. Third, this perspective requires more advanced methods to measure expertise and cognitive load so that instruction can be flexibly adapted to individual learners needs. Experimental studies are reviewed to illustrate these recent developments. Guidelines for future research are provided.     

Peer Assessment Training in Teacher Education: Effects on performance and perceptions

The implementation of peer assessment receives much attention in teacher education. This paper reports the effects of peer assessment training on the performance of student teachers. Ninety-three student teachers were randomly assigned to control groups and experimental groups. The experimental groups were trained in defining performance criteria, giving feedback and writing assessment reports. This was done through peer assessment tasks that were embedded in a redesigned course. Analyses of data derived from peer assessment reports written by the students showed that the experimental groups surpassed the control groups in the quality of the assessment skill. As a result of the training, students from the experimental groups also scored significantly higher grades for the end products of the course than students from the control groups. The results of the questionnaire showed that all students were significantly more satisfied with the redesigned course.     

The differential effects of task complexity on domain-specific and peer assessment skills

In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial design with the between-subjects factor task complexity (simple, n?=?51; complex, n?=?59) and within-subjects factor task type (domain-specific, peer assessment), secondary school students studied four integrated study tasks, requiring them to learn a domain-specific skill (i.e. identifying the six steps of scientific research) and to learn how to assess a fictitious peer performing the same skill. Additionally, the students performed two domain-specific test tasks and two peer assessment test tasks. The interaction effect found on test performance supports our hypothesis. Implications for the teaching and learning of peer assessment skills are discussed.     

Student perspectives on curricular change: lessons from an undergraduate lower-division biology core

Inquiry-based laboratories are acknowledged as the preferred method of instruction for development of research skills. Much has been written about changes in student performance associated with inquiry, but less is known about how students view the inquiry-based format or whether they perceive a benefit from this type of instruction. The Student Assessment of Learning Gains (SALG) survey was used to evaluate and compare student reactions to the new, inquiry-based laboratories of a lower-division undergraduate curriculum, from implementation to the present (an interval of 3 yr). Initial student response to the format and value of the inquiry labs improved over time. The quality of the graduate teaching assistants and the clarity of the laboratory manual were important variables influencing student perception. A student's perception of his/her retention of lab-related skills was strongly associated with perceptions of gains in those skills. Student responses reflect their most current laboratory experience and not a cumulative effect of participation in the core series of courses. Student success in the inquiry format was not associated with gender or status as a transfer student. The majority of students believe that their experiences in the lower-division inquiry labs have prepared them for upper-division course work.     

Observational learning from animated models: effects of studying–practicing alternation and illusion of control on transfer

Animated models explicating how a problem is solved and why a particular method is chosen are expected to be effective learning tools for novices, especially when abstract cognitive processes or concepts are involved. Cognitive load theory was used to investigate how learners could be stimulated to engage in genuine learning activities. It was hypothesized that illusion of control would impede transfer performance compared to a condition without illusion of control. Moreover, we hypothesized that learners who first studied an animated model and then solved the same problem would perform better on transfer than learners who studied the same animated model twice or who first solved the problem and then studied the animated model. In a 2 × 3 factorial experiment (N = 90) with the factors illusion of control (yes vs. no) and instruction method (study–practice, practice–study, study–study) only the first hypothesis was confirmed. Implications for the design of animated models are discussed.     

The instruments for a blind teacher of english: The challenge of the board

This article reports on the training of a blind foreign language teacher of sighted students and the designing of a substitute of the board. A composition of computer devices available today was provided to the blind teacher in order to get pieces of writing projected on a screen. This basic instrument was transformed through instrumental geneses (Rabardel, 1995) i.e., transformations of the blind teacher’s activity and/or of the properties of the artefacts in order to get writings readable for sighted students as well as adapted to didactic purposes. The article deals with knowledge construction, which implies four categories of actions on pieces of writing: adding, erasing, organising and pointing to. The questions involved are: how can a blind teacher manage these various actions? What are the limits of such instrumental geneses?