How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

Validation of a self-perceived media competence instrument for pre-service teachers / Validación de un instrumento de autopercepción de competencia mediática para docentes en formación

Abstract

Key to guaranteeing the fundamental human rights of freedom of expression and information is the development of media competence, particularly in schools. Training teachers in the area of media competence is particularly important for developing these skills in the broader citizenry. In order to provide educators and educational policymakers with a useful diagnostic tool, we have designed a self-perception questionnaire. The questionnaire was applied to a sample of Peruvian education students (N = 501). On the one hand, the results confirm the construct’s coherence, validity and instrumental reliability. On the other hand, they allow us to propose a theoretically based update to the way in which this construct is interpreted and applied, confirming the multidimensionality of media competence. Finally, we use this empirical evidence to discuss the integral, transversal and ecological status of media competence.     

Is science itself the cause of ineffective science teaching?

In her article “A Possible ‘Orality’ for Science?” (Interchange, Vol. 23, No. 3, pp. 227–244), Rampal argues that science can be made more relevant to students if its language is reformed and replaced by one that contains elements drawn from oral cultures. There is some point to this policy proposal, but it fails to note that the dispassionate and impersonal prose of science has its own function in the on-going practice of science. The real task for the teacher should not be reforming the language of science but rather using oral culture to lead students in the excitement of scientific theories and the joys of scientific research, bringing them in the end to a mastery of the prose style that the scientific community has found serves well its goal of increasing our knowledge of laws of nature.     

A Feedback Procedure for Teacher Trainees Working with Parent Tutors of Reading

Abstract In this pilot study, four third‐year teacher trainees were trained to give feedback to parents who were tutoring their own children in reading using the Pause Prompt and Praise procedures. The trainees learnt to teach the procedures to the parents and then to give feedback by prompting parents to remember and explain their own tutoring behaviours. Baseline measures showed that when trainees were asked to help parents in any way they could to implement the procedures, they used very intrusive forms of prompts. Following training trainees used much less intrusive forms of prompts, giving parents more opportunity to remember and explain their own tutoring behaviours. It was argued that less intrusive forms of prompting when giving feedback may have been of more assistance to parents in learning the procedures than more intrusive forms of prompting, since parents may have learned to become more independent of trainee support. This, in turn, may have contributed to the substantial gains in children's reading levels which occurred.     

Environmental print and word reading

The nature of the earliest stage of reading was examined by comparing two views about the importance of environmental print in children’s learning experiences. One theory holds that environmental print leads to the acquisition of reading through developing rudimentary representations of specific words and logos, while the second theory concerns assembled phonology and asserts that reading begins with knowing letters and their sounds. Supporters of this theory hold that knowledge of environmental print and logos is reading the environment and may not directly facilitate the acquisition of word reading. Two studies were conducted with non-reading preschool children in which environmental print knowledge was assessed and related to word recognition training. In the first session of each study children were presented with accurate representations of environmental print and logos such as ‘McDonalds’ and ‘Stop’ to find the ones they were able to identify and the ones they failed to identify. In the second session learning trials were conducted with those words from the logos that the children identified and also those that they failed to identify and with matching control words. Both studies found that the words from the known logos were more readily learned than the matching control words, but only in Study 1 were the known logo words learned more readily than the ones the children did not know. The results were discussed in terms of Gibson’s (1969) theory of perceptual learning, and supported the view that environment print and logo knowledge facilitated word reading.     

Effects of a two-phase reading intervention on three orthographic-phonological code connections

According to the Multiple Connections Model, children bring to the task of learning to read varying degrees of skill in three orthographic coding procedures for written words (whole words, single letters, and letter clusters) and in three phonological coding procedures for spoken words (phonetic or name codes, phonemes, and syllables) and thus in ability to form connections between corresponding orthographic and phonological codes: whole word-phonetic/semantic code, letter-phoneme, and letter cluster-syllable/subsyllable. In Phase I of this intervention study only orthographic and phonological coding were remediated. In Phase II explicit teaching in reading was provided that emphasized the multiple orthographic-phonological connections above. Overall the group improved from about one standard deviation below the mean to approximately the mean standard score for grade in reading real words (whole word and subword connections) and in reading nonwords (subword connections only) after an average of 28.7 sessions of about 40 minutes each. Overall 70% of the individuals showed significant gains in reading real words and 90% of the individuals showed significant gains in reading nonwords. The intervention was most effective in creating whole word-phonetic/semantic connections and least effective in creating letter-phoneme connections. These results demonstrate that theory-driven intervention during a critical developmental period in reading acquisition may prevent more serious reading disabilities.     

The Louisville Twin Study: developmental synchronies in behavior

The Louisville Twin Study includes nearly 500 pairs of twins and their siblings who have participated in a longitudinal study of mental development, beginning in infancy and extending to adolescence. The results show that individual differences beginning in infancy and extending to adolescence. The results show that individual differences in intelligence progressively stabilized by school age, and each child followed a distinctive pattern of spurts and lags in mental development. Monozygotic twins became increasingly concordant over ages and matched each other closely for developmental trends. By contrast, dizygotic twins regressed to an intermediate level of concordance, comparable with that found for siblings and parent-offspring sets. A comprehensive home assessment was performed to identify the home/family variables that contributed to mental development. The overall results pointed to a strong developmental thrust in the growth of intelligence, which was principally guided by an intrinsic genetic ground plan. Qualitative features of home and family did, however, add significantly to prediction of offspring IQ. The results are interpreted in the context of Waddington's developmental model, and some recent advances in neurobiology and genetics are surveyed for their implications for developmental behavior genetics.     

Educational Resilience at Risk? The Challenges of Attending an Early College High School

The Urban Review - This study sought to explain student success at an Early College High School. Guided by previous research on Early College High Schools as well as by the construct of educational...