How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

Neuroscience,Early Childhood Education and Play: We are Doing it Right!

This editorial examines neuroscience and its impact on the field of education. Starting with a narrative between two young children, the author intertwines research with basic principles of learning, using the interaction between two 4-year-olds to illustrate the precepts. The four principles are: (1) the brain is uniquely organized; (2) the brain is continually growing; (3) a “brain-compatible” classroom enables connection of learning to positive emotions; and (4) children’s brains need to be immersed in real-life, hands-on, and meaningful learning experiences. The editorial concludes with an illustration of how the brain works while two children are playing at the small animal center in their classroom.     

Between eclecticism and orthodoxy in instructional design

This paper presents the concept of critical flexibility as an alternative to eclecticism in instructional design. Eclecticism is often viewed as a persuasive alternative to theoretical orthodoxy (i.e., rigid use of a single perspective or process) due to the openness and flexibility it purports to offer. In contrast, the authors argue that eclecticism ignores or discourages critical reflection regarding background understanding (e.g., implicit assumptions and values) and perpetuates the lack of openness and flexibility commonly associated with orthodoxy. Critical flexibility, as an alternative to eclecticism, emphasizes an awareness of background understanding, but construes it as capable of being explicated, critically examined, adjusted in specific contexts, and refined or developed over time to facilitate increasingly flexible and effective design practices. The authors clarify the nature of critical flexibility as a general way of being involved in the design process, suggest how it helps overcome the traditional theory–practice split, and discuss several of its implications for scholarship and training.     

Single-sex computer classes: An effective alternative

Conclusion Considering the technology gender gap that exists today, there can be no doubt that our current educational system is not engaging female students in technology or awakening them to possibilities of the technology industry as a career. Females are not afraid of computers or lack the ability to master computer skills, but they find the computer environment objectionable (http : / / www.aauw.org/2000/ techsavvybd.html). Several factors within the educational system heighten these objections and impede female progression through technology classes. It is these factors that our educational system must address. Single-sex computer classes offer female students the educational advantages of learning in a comfortable, non-threatening classroom environment where they are encouraged to enthusiastically participate in classroom discussions and activities (Kumagi, 1995). In these classes, curriculum may be adjusted to reflect the need females to see computers as productivity tools (Caplice, 1994). As a result of positive experiences gained while attending single-sex computer classes, females are more likely to pursue higher level computer classes. Although it is possible to argue that single-sex computer classes do not mirror the real world females must contend with once outside the classroom, they are, however, effective interim interventions to enable females to lessen the current technology gap (Kumagi, 1995).     

Teaching effectiveness: Comparisons between traditional and nontraditional college students

This article compares traditional college students' perceptions of effective teaching behaviors with nontraditional students' perceptions. A 15-item questionnaire was completed by undergraduates at a small Southeastern university. Nontraditional students viewed personality and interaction behaviors as more indicative of effective teaching, whereas traditional students focused on behaviors that potentially would enhance grades. The implications of the findings are discussed in light of techniques and approaches that facilitate the needs of both types of students.His major areas of interest include testing and counseling. Nina Mattie, M.A. is a recent graduate of the University of West Florida in the area of school psychology. Stephen J. Vodanovich, Ph.D. is an assistant professor in the psychology department at the University of West Florida. His major areas of interest are social psychology and industrial/organizational psychology. Chris Piotrowski, M.A. is a consultant in forensic psychology. His major areas of interest are personality assessment and online database searching.     

Effects of infant cries on alcohol consumption in college males at risk for child abuse

This analog study examines the effect of hearing a child's cries on alcohol consumption, comprising one link in a possible association between drinking and child abuse. Thirty-two male undergraduate volunteers were preselected by age, drinking practices, and abuse potential. Subjects were assigned to either a high or low abuse potential group and were then randomly assigned to hear either an infant cry or a smoke alarm. Blood pressure was measured during each of three stimulus presentations. Following each presentation, the subject was asked to rate the stimulus on a number of different dimensions (e.g., soothing-arousing). Additionally all subjects participated in a subsequent taste-rating task as an unobtrusive measure of alcohol consumption. The results indicate that, regardless of risk group, subjects who listened to the infant cry consumed significantly more alcohol (M = 206 ml, SD = 126.43) during the taste-rating task than did those who heard only the smoke alarm (Mr = 95.68 ml, SD = 62.94) which was also rated as aversive. There was no relationship between abuse potential and alcohol consumption. Although diastolic blood pressure did not differ between groups, analysis of the infant rating scales revealed that, regardless of risk group, subjects who heard the infant cry reported feeling more aversion, arousal, and distress, than did those who heard the smoke alarm. These results lend additional support to studies depicting the infant cry as a stressful and aversive event, capable of eliciting increased drinking. Implications for arousal reduction by alcohol and a model of alcohol-induced child abuse are discussed.     

Concept learning by pigeons: Matching-to-sample with trial-unique video picture stimuli

Pigeons were trained to match-to-sample with several new methodologies: a large number of stimuli, computer-drawn color picture stimuli, responses monitored by a computer touch screen, stimuli presented horizontally from the floor, and grain reinforcement delivered onto the picture stimuli. Following acquisition, matching-to-sample concept learning was assessed by transfer to novel stimuli on the first exposure to pairs of novel stimuli. One group (trial-unique), trained with 152 different pictures presented once daily, showed excellent transfer (80% correct). Transfer and baseline performances were equivalent, indicating that the matching-to-sample concept had been learned. A second group (2-stimulus), trained with only two different pictures, showed no evidence of transfer. These results are discussed in terms of the effect of numbers of exemplars on previous failures to find concept learning in pigeons, and the implications of the positive finding from this experiment on abstract concept learning and evolutionary cognitive development.     

Child developmental impact of Pittsburgh’s Early Childhood Initiative (ECI) in high-risk communities: first-phase authentic evaluation research

The national debate surrounding the issue of school failure has renewed interest in the quality, efficacy, and outcomes of early childhood intervention programs that can promote early school success for children at developmental risk. Moreover, researchers and policymakers report the need to document developmentally-appropriate models for assessing and evaluating early childhood outcomes. We report on the first-phase results of Pittsburgh’s early childhood initiative (ECI). ECI is a privately-funded effort by a consortium composed of the business, corporate, foundation, and community sectors to implement high-quality early care and education options for children in high-risk neighborhoods. The overarching objective of ECI is to ensure early school success for high-risk children. Our Scaling Progress in Early Childhood Settings (SPECS) Evaluation Team implemented an authentic assessment and program evaluation strategy and an enhanced “constructed comparison group” statistical model to conduct longitudinal research on the child developmental impact of the ECI model. First-phase results on 155 high-risk children indicate that those who participated in high-quality ECI programs for the longest periods of time demonstrated patterns of progress that exceeded maturational expectations. Weekly collaborative consultation to teachers and caregivers by consultants about program quality using the National Association for the Education of Young Children (NAEYC) standards as “best practice” benchmarks seemed to be associated with initial enhanced child outcomes and the particular impact of the ECI model.