ADAPT<Superscript>IT</Superscript>: Tools for training design and evaluation

This article describes a set of computerized tools that support the design and evaluation of competency-based training programs. The training of complex skills such as air traffic control and process control requires a competency-based approach that focuses on the integration and coordination of constituent skills and transfer of learning. At the heart of the training are authentic whole-task practice situations. The instructional design tools are based on van Merriënboer's 4C/ID^* methodology (1997). The article describes a training design tool (Core) that supports the analysis and design for competency-based training programs and an evaluation tool (Eval) that supports the subsequent revision of this training design.     

Instructional design and project management: complementary or divergent?

This paper reports the results of a study to identify the extent to which organizations that develop educational/training products are committed to project management, as measured by their project management implementation maturity, as a methodology that is separate and distinct from the processes of instructional design. A Web survey was conducted among 103 public and private sector organizations worldwide that develop educational/training products. Results show no significant difference by project management maturity level in the roles of instructional designer and project manager, although there is some relationship between maturity level and how organizations perceive the skills/competencies of project managers versus those of instructional designers. Further, organizational decision-makers have very specific expectations about the formal education and training of educational/training product development project leaders. The findings should be of value to institutions of higher education in evaluating programs that prepare students for careers in instructional design.     

Measuring perceived social presence in distributed learning groups

Social presence—the degree to which ‘the other’ in a communication appears to be a ‘real’ person—has captured the attention of those dealing with learning in groups through computer-supported collaborative learning environments. The concept is important because it affects participation and social interaction, both necessary for effective collaboration and knowledge construction. This article reports on the construction and validation of a self-reporting (Dutch-language) Social Presence Scale to determine perceived social presence in distributed learning groups using computer-supported collaborative learning environments. The result is a one-dimensional scale consisting of five items with an internal consistency of .81. We used a nomological network of similar constructs for further validation. The findings suggest that the Social Presence Scale has potential to be useful as a measure for social presence.     

Reading and listening progress in segregated primary schools: Does ethnic and socioeconomic classroom composition matter?

This study aimed to investigate the relationship of classroom composition factors with reading and listening comprehension achievement and progress in socially and ethnically segregated primary schools in Flanders (Belgium). Specifically, using a three‐level multivariate repeated measures analysis, it examined the association of reading and listening achievement and progress with ethnic diversity, the proportion of non‐native students and the average socioeconomic status of the class, taking into account student characteristics. At the beginning and end of the school year, reading tests, listening tests and questionnaires were administered to a sample of 7‐ and 8‐year‐old students (n = 683) in 42 second‐grade classes. Students' listening comprehension achievement at the beginning of the school year was negatively related to having a home language other than the language of instruction and to classes with a high proportion of non‐native students. However, progress in listening comprehension was not significantly associated with any student or classroom composition factors. Students whose mothers had a lower level of education performed lower on reading comprehension at the beginning of the school year, while at the end of the school year students whose mothers had a higher level of education were at a greater disadvantage. Limitations of this study and directions for future research are discussed.     

Language use in kindergarten science lessons: language production and academic language during a video feedback coaching intervention in kindergarten science lessons

This paper aims to gain insight into language production and academic language of 4- and 5-year-old students and their teachers in the course of a teacher intervention during kindergarten science education. The study is based on videotaped classroom observations, and specifically focuses on the academic language use of students (N_intervention = 18, N_controls = 26) and teachers (N_intervention = 5, N_controls = 5). The results suggest that this general teacher intervention yields interesting changes in language use and production. Patterns of change over time confirm the idiosyncratic and non-linear nature of these changes. Science lessons represent an appropriate context in which to acquaint students with academic language, which can be used as a basis to build upon more sophisticated language skills.     

Nonverbatim captioning in Dutch television programs: a text linguistic approach

In the Netherlands, as in most other European countries, closed captions for the deaf summarize texts rather than render them verbatim. Caption editors argue that in this way television viewers have enough time to both read the text and watch the program. They also claim that the meaning of the original message is properly conveyed. However, many deaf people demand verbatim subtitles so that they have full access to all original information. They claim that vital information is withheld from them as a result of the summarizing process. Linguistic research was conducted in order (a) to identify the type of information that is left out of captioned texts and (b) to determine the effects of nonverbatim captioning on the meaning of the text. The differences between spoken and captioned texts were analyzed on the basis of on a model of coherence relations in discourse. One prominent finding is that summarizing affects coherence relations, making them less explicit and altering the implied meaning.     

Employment and Achievement in a Problem‐Based Curriculum

The purpose of this study is twofold: first, to examine to what extent the time students work on paid jobs is related to study‐time (class attendance and time devoted to self‐study) and second, to what extent the time students work on paid jobs is related to achievement. A number of 120 students from the problem‐based Faculty of Health Sciences in the Netherlands kept a time‐diary. Academic achievement was measured by using scores on the block‐test. The results showed that working about four to eight hours per week on paid jobs (as opposed to working less than four hours per week or to working intensively, more than 8 hours per week) actually is positively related to study‐time. Test‐scores are not significantly different among students who are not working on jobs, work some hours, or work a lot.