Assessment of Teacher Reactions to a Standards-Based Teacher Evaluation System: A Pilot Study*

This article reports on teachers' reactions to a pilot implementation of a new standards-based teacher evaluation system in a medium-sized Midwestern school district. The system, based on the Framework for Teaching (Danielson, 1996), was intended to serve as the foundation for a new knowledge and skill pay plan for teachers. Teacher reactions were measured using both interview and survey methods. Teachers' overall favorableness toward the system, as measured by the survey, was correlated with acceptance of the teaching standards, perception of the evaluation process as fair and the evaluator as capable and objective, and perception that the evaluation system had a positive impact on their teaching. In interviews, teachers perceived both positive and negative aspects of the system, and for many these more or less balanced each other. While most teachers accepted the evaluation standards and the need for an evaluation system, many also perceived that the system added too much to teachers' workloads and did not provide enough feedback. Based on these results several changes were made in the evaluation system prior to full implementation. The results are discussed with reference to previous research and the Personnel Evaluation Standards.     

A SPECIAL‐PURPOSE STUDIO

The paper describes the design and use of a studio system which arose out of the need to give demonstrations of experimental procedures to practical classes of up to 150 students. Since the requirements could be specified in some detail it was possible to use novel methods of working which turned out to be very efficient and economical.     

Progress monitoring with objective measures of writing performance for students with mild disabilities

To adequately monitor progress in writing, a test must show stability and demonstrate a performance profile over time that parallels those of accepted criterion measures. This study investigated the technical adequacy of seven objective indexes of writing quality in monitoring the progress of 36 middle school (Grades 6-8) students with mild disabilities over a 6-month period. The stability of each index was assessed. Holistic ratings of the same writing samples and the Test of Written Language served as validation criteria. Three indexes were moderately correlated with holistic ratings, but were not sufficiently stable over time. Direct, objective writing assessment must be used with caution for progress monitoring, given our present lack of precision in measuring the complex task of writing.     

Interdisciplinary project working in engineering education

The purpose of this paper is to give an overview of the interdisciplinary project programme implemented by the Faculty of Technology at Plymouth University teamed with three Royal Academy of Engineering Visiting Professors in Principles of Engineering Design. We examine the challenges encountered in developing such a scheme and identify the processes that were put in place to ensure the quality of the course and to support and maximize student performance. Prior to commencement of the programme the Dean and Vice Chancellor had developed clear objectives and expectations for building upon the significant achievements of the six schools comprising the Faculty of Technology. These objectives were: (a) For the Faculty: ? Provide a focus and impetus for the development of multidisciplinary design in a new portfolio of Masters-level (4 year) engineering courses. ? Enhance the teaching of design in all engineering courses. ? Strengthen a design-oriented approach to all teaching in engineering courses. ? Enhance students' enthusiasm and awareness through greater contact with senior practitioners. ? Improve the understanding of both staff and students concerning the principles of modern engineering design and manufacturing/construction in contemporary professional practice. ? Provide experience and an understanding of the value of interdisciplinary working. (b) For the students: ? Give students the opportunity to tackle problems outside their disciplines. ? Help students understand the relationships between different disciplines. ? Develop innovative and creative solutions to open-ended problems. ? Develop management skills. ? Develop personal and interpersonal skills. ? Focus on developing team-working skills. ? Develop communications and presentation skills. In addition to providing students with a significant intellectual challenge the interdisciplinary project is designed to help them gain a broader insight into problem-solving and in dealing with uncertainty--the essences of engineering. Our experience leads us to believe that both undergraduate and postgraduate engineering students would benefit from working in interdisciplinary teams whilst at university and that having done so they would leave university better fitted for careers in engineering.     

Behavior management in cognitive early education

Even though behavior management is a very high priority of teachers of young children, systems of behavior management receive less attention than do methods of teaching academic content. Even when there are well developed sytems of behavior management, they do not necessarily reflect the same philosophy and methods of teaching that are used to teach content. The authors report on “cognitive-mediational behavior management”, a system designed to be consistent with a cognitive early education program, the Cognitive Curriculum for Young Children. In both behavior management and all their other teaching, teachers use in this program a mediational teaching style. Teachers emphasize thinking processes rather than correct answers, take a problem-solving approach to learning, help children to acquire generalizable strategies of thinking and problem-solving rather than using trial-and-error learning, are optimistic about children’s abilities to learn, and facilitate children’s acquisition of fundamental thinking modes. This system is seen as basically incompatible with a behaviorist, contingent reinforcement system. Behavior sequences are suggested for working with unacceptable behavior so as to produce both behavior change and cognitive change.     

THE VALIDITY AND RELIABILITY OF ORAL EXAMINATIONS IN ASSESSING COGNITIVE SKILLS IN MEDICINE1

In order to attempt to assess aspects of clinical competence, not adequately assessed by other means, the Center for the Study of Medical Education, University of Illinois College of Medicine together with the American Board of Orthopaedic Surgery developed oral examinations in formats specifically designed to yield information on high level cognitive functioning. The examinations were administered to 784 candidates for certification in January 1968. Reliability of the oral problem-solving component score pooled from four examiners was approximately .50. Assessment of content, construct, and concurrent validity made by questionnaire and factor analytic studies indicated that the oral tests identified factors not measured by multiple-choice tests and, therefore, significantly improved the relationship between supervisory evaluations and test scores.