ICT teacher training: Evidence for multilevel evaluation from a national initiative

This paper is one of a pair that re-examines the evidence from a national initiative to train all teachers in England to bring them up to the level of newly qualified teachers, who are required to know when to use and when not to use information and communication technologies (ICT) in their professional practice. Reanalysis of data gathered for the 2004 evaluation uncovers the complexity of such professional development. The effectiveness of contrasting approaches to ICT-related teacher training was analysed using the national survey of 496 trainees and experts' reports on 11 of the 47 training providers. multilevel evaluation of professional development was shown to be robust for ICT teacher training, including a significant correlation between the views of experts and those of teachers. The presence of the middle level of 'organisational support and change' emerged as a particularly discriminating factor, indicating that higher-quality teacher training supports change in the classroom and in the school. Therefore, we recommend that all five of Guskey's levels be consistently adopted for the evaluation of ICT teacher training, and that research should also adopt a multilevel model. A second paper delves deeper to describe and contrast the highest and lowest-rated approaches to ICT teacher training.     

Enlist micros: Training science teachers to use microcomputers

A National Science Foundation grant to the Biological Sciences Curriculum Study (BSCS) at The Colorado College supported the design and production of training materials to encourage literacy of science teachers in the use of microcomputers. ENLIST Micros is based on results of a national needs assessment that identified 22 compentencies needed by K–12 science teachers to use microcomputers for instruction. A writing team developed the 16-hour training program in the summer of 1985, and field-test coordinators tested it with 18 preservice or in-service groups during the 1985–86 academic year at 15 sites within the United States. The training materials consist of video programs, interactive computer disks for the Apple II series microcomputer, a training manual for participants, and a guide for the group leader. The experimental materials address major areas of educational computing: awareness, applications, implementation, evaluation, and resources. Each chapter contains activities developed for this program, such as viewing video segments of science teachers who are using computers effectively and running commercial science and training courseware. Role playing and small-group interaction help the teachers overcome their reluctance to use computers and plan for effective implementation of microcomputers in the school. This study examines the implementation of educational computing among 47 science teachers who completed the ENLIST Micros training at a southern university. We present results of formative evaluation for that site. Results indicate that both elementary and secondary teachers benefit from the training program and demonstrate gains in attitudes toward computer use. Participating teachers said that the program met its stated objectives and helped them obtain needed skills. Only 33 percent of these teachers, however, reported using computers one year after the training. In June 1986, the BSCS initiated a follow up to the ENLIST Micros curriculum to develop, evaluate, and disseminate a complete model of teacher enhancement for educational computing in the sciences. In that project, we use the ENLIST Micros curriculum as the first step in a training process. The project includes seminars that introduce additional skills: It contains provisions for sharing among participants, monitors use of computers in participants' classrooms, provides structured coaching of participants' use of computers in their classrooms, and offers planned observations of peers using computers in their science teaching.     

Evaluation approaches for a national ICT initiative: the example of laptops for New Zealand teachers

This paper will highlight the successful evaluation approaches deployed for long-term exploration of the impact of a national policy initiative as well as some of the results and outcomes. An interactive feedback process informed decision-making at the national and local level thereby enhancing both the initiative and its implementation in schools. The integration of information and communication technologies (ICT) into schools has been a focus of a plethora of policy initiatives by governments worldwide for over 20 years. The provision of laptops to teachers is one component of the New Zealand compulsory school sector ICT strategy. The evaluation research design was to use a mixed-methods approach incorporating three yearly cycles of annual nationwide surveys, regional focus groups, and school-based longitudinal case studies. Randomized sampling was used to identify 20% of the available laptop schools as potential participants in the survey. The same schools participated in each of the 3 years. A distinctive feature of this evaluation has been the regular feedback loops between the evaluators and the stakeholders. The stakeholders included the Ministry of Education and laptop suppliers as well as schools, school leaders, and teacher unions. In the current accountability, environment schools are increasingly being asked to participate in evaluation studies. In long-term studies, it is important to establish effective relationships with the schools and the policy-makers and to deploy robust evaluation methodologies. This is essential for both validity and reliability of the findings and the useability and utilization of the findings.     

The impacts of new governance on teaching at German universities. Findings from a national survey

In this article we will present findings from a national survey questioning the actual impact of the new governance structures at German universities on academic teaching. To begin with, we give a theoretical underpinning to the economization of higher education institutions (HEIs) according to Principal-Agent Theory. This allows for the development of hypotheses about the influence of new selective incentives (merit pay, performance-related budgeting, Management by Objectives, teaching awards) on the professors’ academic teaching behavior. Instructed by critical considerations on Principal-Agent Theory we extended the axiomatics of this economic theory by incorporating concepts like work task motivation and academic socialization for a supposedly more comprehensive explanation. Data from a nationwide German survey allows us then to test our theory-driven assumptions. Our target population was the entire collectivity of all professors at German universities from which we could draft a sample 8,000 individuals. An estimation of four different OLS-regression models shows that the hypotheses derived from Principal-Agent Theory must be rejected whereas the hypotheses based on motivational aspects and socialization processes can be confirmed. Based on our analysis we can conclude that for the status quo of implementation there are no direct influences of new selective incentives on the actual teaching performance whereas we have strong indications for altered mechanisms of enculturation in the field of universities. New Public Management (NPM) seems to produce a new breed of professors whose preferences and practice are conditioned by the imperatives evoked by this new managerialism.     

Teaching teachers to use HyperCard: a minimal manual approach

Untrained computer users often find traditional comprehensive manuals difficult and daunting. A minimal manual for HyperCard on the Macintosh was developed to ascertain the practicability of untrained classroom teachers learning HyperCard. To this end, the extent and type of use of the manual and software by teachers over a period of occasional use in their own time was recorded. Certain patterns of use were identified from self-report forms completed by 23 of the original 27 subjects and from structured proficiency tests performed in the presence of an interviewer. The manual was rated low on difficulty and high on usefulness. While only three were judged to be able to create their own stacks at the end of the course, most subjects achieved high proficiency up to that level within an average study time of 27 hours. It is concluded that the most effective use of HyperCard by teachers is in using their skills to modify existing stacks for their teaching rather than to create new materials from scratch.     

国外生物学教师入职教育的经验与启示

教师教育一体化理论认为,教师教育应该包括职前培养、入职教育和在职培训三个连续阶段,入职教育是指对初职教师(刚参加工作的新教师或刚到某学科任教的教师,一般为一到三年)进行的各种有计划而系统的指导、帮助和培训,入职教育对初职教师能够更好地适应教学工作,提高其专业素养     

Serving multiple stakeholders: Issues arising from a major national evaluation study

This paper provides an analysis of the issues arising from work with multiple stakeholders within the context of a major national evaluation study. The context is the UK Education Departments' Superhighways Initiative (EDSI), which was jointly funded by the four education departments of England, Wales, Scotland and Northern Ireland. Unusually, the evaluation, which was large scale and employed several teams of evaluators, had a real opportunity to inform the development of policy. Problems of working for multiple stakeholders arose from the tight control that the sponsors exercised over the structure, style and content of the report. In addition to the usual problems of conflicting interests between stakeholders, the Scottish evaluators experienced problems relating to the polarised political context in the UK prior to the general election of 1997. The successful public relations exercise that created the EDSI programme, with commercial sponsorship for projects and government funding only for the evaluation, was an additional factor in determining the evaluators' roles and relationships with stakeholders.     

Using lotteries to evaluate schools of choice: Evidence from a national study of charter schools

This paper draws on data and experiences observing and analyzing school lotteries from the National Evaluation of Charter School Impacts (Gleason et al., 2010) to describe the challenges associated with lottery-based research. In that study, covering 36 charter middle schools in 15 states, we found that charter schools did not affect student achievement or behavior on average, although there was substantial variation across schools. In this paper, we discuss the prevalence of oversubscribed charter schools at the time the study was conducted (the 2005–2006 and 2006–2007 school years), which was lower than commonly reported. We then describe how the sample of schools that participated in the study compared to all other charter middle schools nationwide, to provide some insight into the generalizabilty of findings from lottery-based studies. In general, oversubscribed charter schools were more likely to be located in urban areas and serve a higher-achieving population of students than those without excess demand. We also describe common features of school lotteries and waitlists, and examine implications of these features for a school's ability to support a lottery-based study. Finally, we summarize lessons learned for conducting lottery-based research on charter schools, drawing on our observations of the schools’ lotteries and analysis of the data from these lotteries.     

Training to use Television as a Teacher

Television, no longer in its infancy, no longer a novelty, still possesses the unique ability to focus, one may even say command, the attention of both the individual and the group. It is no doubt due to this quality that the use of television has developed greatly during recent years. The fact that it can keep pace with the contemporary scene (e.g. important events can be shown ‘live’ or soon after they have taken place) plus the personal method of presentation may have made it something more than a ‘teaching aid’.     

Training preservice teachers rapidly: The need to articulate the training given by university supervisors and cooperating teachers

This study evaluated the impact of a specific program on the training of preservice teachers; the program consisted of alternating periods of “condensed” and autonomous classroom work and training sequences with university supervisors and cooperating teachers in order to prepare for these practical work periods. Borrowing from an original theoretical conceptualization of teacher training and professional development based on the postulates of Wittgenstein's analytical philosophy (In G.E.M. Anscomb and G.H. Von Wright (Eds.). (1996). Remarques philosophiques [Philosophical Investigations]. Oxford: Blackwell.), this study (i) examined the circumstances in which preservice teachers are able to use experiences from training situations for professional growth in the training situations and/or in later classroom situations and (ii) proposes ideas for articulating the training work of university supervisors and cooperating teachers.     

Beyond a command performance: reflections on Classmates as a new teacher preparation initiative

This paper reflects on a new pre‐service teacher education initiative, Classmates. Classmates is a collaboration between the University of Western Sydney (UWS) and the New South Wales Department of Education and Training (DET), South Western Sydney Region. Classmates aims to prepare pre‐service teachers to work in challenging, hard‐to‐staff schools. These contexts typically have socially disadvantaged populations and annually experience teacher shortages and high teacher turnover, particularly amongst beginning and early career teachers. Classmates seeks to produce beginning teachers who are highly prepared for, confident and mentally and emotionally equipped to work in such environments. This discussion focuses on some of the positive attributes about the initiative, particularly its practicum structure; its nurturing of pre‐service teachers to work in challenging contexts; and its strong focus on networking and development of ongoing support structures.     

College students' views of male and female college teachers: Part II—Evidence from students' evaluations of their classroom teachers

Although a majority of studies have found that male and female college teachers do not differ in the global ratings they receive from their students, when statistically significant differences are found, more of them favor women than men. Across studies, the average association between gender and overall evaluation, while favoring women (averager=+.02), is so small as to be insignificant in practical terms. Considering specific instructional dimensions of evaluations, female teachers receive very slightly higher ratings on their sensitivity to and concern with class level and progress than do men (averager=+.12). On other specific dimensions, men and women either do not differ or the differences are trivial in size (or, for two dimensions, while nontrivial, based on too few studies to be generalizable with any degree of certainty). Students tend to rate same-gendered teachers a little higher than opposite-gendered teachers. Although interaction effects on evaluations have also been found between gender of teacher and other factors (academic rank of the teacher, academic area, class level of the course, difficulty of the teacher or course, and the teacher's pedagogical orientation or personality characteristics), they are inconsistent across studies. Moreover, ratings of teachers are sometimes enhanced by gender-typical, and sometimes by gender-atypical, attributes, behaviors, and positions. The findings are discussed in terms of the expectations or demands of students and whether or not student ratings are biased by the gender of the teacher.     

Adopting learning technologies: from belief to practice

A challenge faced by most heads of academic departments around the world is to manage the adoption and use of appropriate learning technologies in order to support the department’s learning offerings to students. Earlier research undertaken by the authors revealed that lecturers within the Department of Marketing and Retail Management at the University of South Africa believed a learning management system (LMS) to be the most appropriate technology to use. The experience of the Chair of Department, however, is that lecturers are using the university’s proprietary LMS, myUnisa, either to a limited extent or hardly at all. Consequently, further research was undertaken targeting the other Chairs of Departments and selected senior lecturers within the School of Management Sciences, to which the Department of Marketing and Retail Management belongs, in order to identify ways of increasing the use of myUnisa amongst lecturers.