How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

A Qualitative Examination of the Challenges, Resources, and Strategies for Serving Children Learning English in Head Start

The dramatic growth in the number of children learning English as a second language in our country has led to a corresponding increase in the need to understand how teachers and schools can effectively teach children who are learning English as a second language. Many teachers report not feeling prepared to meet the needs of these children (National Center for Education Statistics, Teacher preparation and professional development: 2000. , 2002). The current study used focus group interviews to examine how Head Start teachers in one program addressed the special learning needs of children learning English in their classrooms. Key challenges involved communicating with children and their families in their home language. Teachers used other staff, parents, and children in the classroom to interpret. Strategies involved visual aids, pictures, gestures, and a welcoming classroom environment. Resources used by teachers were professional development and language skills of other staff. However, available resources were often underutilized and limited for teachers to use in meeting the challenges the teachers faced in the classroom. Suggestions are presented for overcoming the challenges and limited resources encountered by teachers, such as changes in preservice and inservice training opportunities, and second language learning opportunities for teachers. Further implications for training and research are discussed.     

Validation of a self-perceived media competence instrument for pre-service teachers / Validación de un instrumento de autopercepción de competencia mediática para docentes en formación

Abstract

Key to guaranteeing the fundamental human rights of freedom of expression and information is the development of media competence, particularly in schools. Training teachers in the area of media competence is particularly important for developing these skills in the broader citizenry. In order to provide educators and educational policymakers with a useful diagnostic tool, we have designed a self-perception questionnaire. The questionnaire was applied to a sample of Peruvian education students (N = 501). On the one hand, the results confirm the construct’s coherence, validity and instrumental reliability. On the other hand, they allow us to propose a theoretically based update to the way in which this construct is interpreted and applied, confirming the multidimensionality of media competence. Finally, we use this empirical evidence to discuss the integral, transversal and ecological status of media competence.     

The inadequacy of individual educational program (IEP) goals for high school students with word-level reading difficulties

This investigation analyzed goals from the Individual Educational Programs (IEPs) of 54 high school students with diagnosed reading disabilities in basic skills (decoding and/or word identification). Results showed that for 73% of the students, the IEPs written when they were in high school failed to specify any objectives regarding their acute difficulties with basic skills. IEPs from earlier points in the students’ educations were also reviewed, as available. For 23 of the students, IEPs were present in the students’ files for three time points: elementary school (ES), middle school (MS), and high school (HS). Another 20 students from the sample of 54 had IEPs available for two time points (HS and either MS or ES). Comparisons with the IEPs from younger years showed a pattern of decline from ES to MS to HS in the percentage of IEPs that commented on or set goals pertaining to weaknesses in decoding. These findings suggest that basic skills deficits that persist into the upper grade levels are not being sufficiently targeted for remediation, and help explain why older students frequently fail to resolve their reading problems.     

Is science itself the cause of ineffective science teaching?

In her article “A Possible ‘Orality’ for Science?” (Interchange, Vol. 23, No. 3, pp. 227–244), Rampal argues that science can be made more relevant to students if its language is reformed and replaced by one that contains elements drawn from oral cultures. There is some point to this policy proposal, but it fails to note that the dispassionate and impersonal prose of science has its own function in the on-going practice of science. The real task for the teacher should not be reforming the language of science but rather using oral culture to lead students in the excitement of scientific theories and the joys of scientific research, bringing them in the end to a mastery of the prose style that the scientific community has found serves well its goal of increasing our knowledge of laws of nature.     

A Feedback Procedure for Teacher Trainees Working with Parent Tutors of Reading

Abstract In this pilot study, four third‐year teacher trainees were trained to give feedback to parents who were tutoring their own children in reading using the Pause Prompt and Praise procedures. The trainees learnt to teach the procedures to the parents and then to give feedback by prompting parents to remember and explain their own tutoring behaviours. Baseline measures showed that when trainees were asked to help parents in any way they could to implement the procedures, they used very intrusive forms of prompts. Following training trainees used much less intrusive forms of prompts, giving parents more opportunity to remember and explain their own tutoring behaviours. It was argued that less intrusive forms of prompting when giving feedback may have been of more assistance to parents in learning the procedures than more intrusive forms of prompting, since parents may have learned to become more independent of trainee support. This, in turn, may have contributed to the substantial gains in children's reading levels which occurred.     

Making broadcast television participative: Eliciting mathematical behavior throughSquare One TV

The current reform movement in mathematics education has called for new ways of teaching that encourage children to become active participants in mathematical problem solving. In this article, the potential of educational television to elicit such behavior is investigated by reviewing research on theSquare One TV television series. A sizable body of evidence indicates that, through viewer participation,Square One TV can promote mathematical behavior directly among its target audience of 8- to 12-year-olds. Described in the article are the types of viewer participation that have been observed, threeSquare One TV formats that have consistently been found to elicit participative behavior, and several characteristics of these formats that may have been responsible for increased viewer participation. If these characteristics are incorporated into future television-based materials, they may increase the potential of the materials to elicit active participation among viewers. The production ofSquare One TV and the research described here were supported by the National Science Foundation, the Corporation for Public Broadcasting, the Carnegie Corporation, and the U.S. Department of Education. Production of the first season was also supported by the Andrew W. Mellon Foundation and by the IBM Corporation. Additional funding for the fourth and fifth seasons was provided by the Intel Corporation. This article is based on a paper presented at the 1993 meeting of the American Educational Research Association in Atlanta, Georgia.     

The Louisville Twin Study: developmental synchronies in behavior

The Louisville Twin Study includes nearly 500 pairs of twins and their siblings who have participated in a longitudinal study of mental development, beginning in infancy and extending to adolescence. The results show that individual differences beginning in infancy and extending to adolescence. The results show that individual differences in intelligence progressively stabilized by school age, and each child followed a distinctive pattern of spurts and lags in mental development. Monozygotic twins became increasingly concordant over ages and matched each other closely for developmental trends. By contrast, dizygotic twins regressed to an intermediate level of concordance, comparable with that found for siblings and parent-offspring sets. A comprehensive home assessment was performed to identify the home/family variables that contributed to mental development. The overall results pointed to a strong developmental thrust in the growth of intelligence, which was principally guided by an intrinsic genetic ground plan. Qualitative features of home and family did, however, add significantly to prediction of offspring IQ. The results are interpreted in the context of Waddington's developmental model, and some recent advances in neurobiology and genetics are surveyed for their implications for developmental behavior genetics.