Review of criteria used to measure library effectiveness

This article reports the results of a survey of literature on measures of library effectiveness. This survey led to the formulation of six criterion concepts (accessibility, cost, user satisfaction, response time, cost/benefit ratio, and use). The advantages and disadvantages of each method of measurement are discussed. Several points which became clear during the analysis are discussed. First, there is a relative lack of concern with the rationale behind the evaluation process, although the results invariably lead to a confused interpretation when there is no clear understanding of the purpose of an evaluation. Second, the total library system is rarely considered; instead, each evaluation criterion is taken in isolation rather than as part of the whole. Third, the library's preservation function has not been considered at all.     

Secondary science teachers' knowledge base when teaching science courses in and out of their area of certification

This study examined the similarities and differences in experienced secondary science teachers' planning, teaching, and reflecting on their teaching, when teaching in their science area of certification and when teaching in another science area. The study also focused on the influence of these teachers' content knowledge, pedagogical knowledge, and pedagogical content knowledge on their planning, teaching, and reflecting. Experienced teachers were observed and interviewed while teaching classes in their science area of certification, and in another science area they were teaching for the first or second time. Both similarities and differences in teaching were found in the two areas for all three teachers. For example, their planning and postlesson reflections were similar in both areas. In the interactive phase of teaching more differences were observed. Many aspects of their teaching resembled that of expert teachers in other studies. In the unfamiliar science area, the teachers sometimes acted like novice teachers. However, they were able to draw upon their pedagogical knowledge to provide a framework for their teaching in both science areas. Their wealth of pedagogical knowledge, and pedagogical content knowledge for general science topics, seemed to sustain them in whatever content they were teaching. Recommendations for further study and implications for teacher education are discussed.     

Information and knowledge worker productivity

Information is an essential ingredient in office work, in management decision making, and in knowledge worker productivity. Automated office information systems are designed to process information more efficiently and more effectively so as to increase the productivity of the office staff and the profitability of the organization. The rationale and the functions of automated office information systems are reviewed along with the methods used and difficulties encountered in measuring office productivity. Information science can and should be applied to study the economic benefits of office information systems, to investigate the social and behavioral implications of this new technology, and to help plan governmental policies resulting from the changes now taking place in the environment and in the storage, transfer, display, and use of information.     

Classroom Assessment Practices,Teacher Judgments,and Student Achievement in Mathematics: Evidence from the ECLS

In this study we use data from the Early Childhood Longitudinal Survey third- and fifth-grade samples to investigate teacher judgments of student achievement, the extent to which they offer a similar picture of student mathematics achievement compared to standardized test scores, and whether classroom assessment practices moderate the relationship between the two measures. Results indicate that teacher ratings correlate strongly with standardized test scores; however, this relationship varies considerably across teachers, and this variation is associated with certain classroom assessment practices. Furthermore, the evidence suggests that teachers evaluate student performance not in absolute terms but relative to other students in the school and that they may adjust their grading for some students, perhaps with basis on perceived differences in need and/or ability.     

Measuring instructional practice in science using classroom artifacts: lessons learned from two validation studies

With growing interest in the role of teachers as the key mediators between educational policies and outcomes, the importance of developing good measures of classroom processes has become increasingly apparent. Yet, collecting reliable and valid information about a construct as complex as instruction poses important conceptual and technical challenges. This article summarizes the results of two studies that investigated the properties of measures of instruction based on a teacher‐generated instrument (the Scoop Notebook) that combines features of portfolios and self‐report. Classroom artifacts and teacher reflections were collected from samples of middle school science classrooms and rated along 10 dimensions of science instruction derived from the National Science Education Standards; ratings based on direct classroom observations were used as comparison. The results suggest that instruments that combine artifacts and self‐reports hold promise for measuring science instruction with reliability similar to, and sizeable correlations with, measures based on classroom observation. We discuss the implications and lessons learned from this work for the conceptualization, design, and use of artifact‐based instruments for measuring instructional practice in different contexts and for different purposes. Artifact‐based instruments may illuminate features of instruction not apparent even through direct classroom observation; moreover, the process of structured collection and reflection on artifacts may have value for professional development. However, their potential value and applicability on a larger scale depends on careful consideration of the match between the instrument and the model of instruction, the intended uses of the measures, and the aspects of classroom practice most amenable to reliable scoring through artifacts. We outline a research agenda for addressing unresolved questions and advancing theoretical and practical knowledge around the measurement of instructional practice. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 49: 38–67, 2012