Principals may inflate teacher evaluation scores to achieve important goals

Educational Assessment, Evaluation and Accountability - A concerning attribute of teacher evaluations across countries is the systemic leniency of principals during classroom observations. However,...     

Principals’ use of rating scale categories in classroom observations for teacher evaluation

Teacher evaluation systems commonly rely on observation of teaching practice (OTP) by school principals. However, the value of OTP as evidence of teacher effectiveness depends on its psychometric quality. In this study, we address a key aspect of the psychometric quality of principals’ OTP ratings. Specifically, we investigate the degree to which rating scale categories have a consistent interpretation across teaching episodes and practices. Results suggest that the 1,324 principals’ use of the rating scale categories functioned as intended overall. However, we also found that the midpoint category is underutilized and that rating categories do not always reflect similar levels of teaching effectiveness across teaching episodes and practices. When such discrepancies occur, we cannot assume principals’ ratings reflect a consistent level of teacher effectiveness within and across classrooms. This is a critical component of validity evidence that can inform the interpretation of OTP ratings and point to areas for improvement in both the rubrics and in principals’ training for classroom observations.     

Assessing the Need for Decision-Making Capacity Education in Hospitals and Long Term Care (LTC) Settings

Clinicians are often asked to evaluate older individuals for their capacity to make decisions regarding their medical care, often referred to as “medical decision-making capacity” (MDMC). However, the degree to which clinicians have the necessary knowledge to properly evaluate MDMC is uncertain. To assess the level of training and knowledge that clinicians report having regarding MDMC, and to determine the best avenue for further education on this issue, a survey was developed and distributed to clinicians at a large medical center and long-term-care (LTC) facility. The majority of responders reported having minimal training about MDMC. They endorsed a limited to moderate level of current knowledge regarding the topic, although responders also ascribed a high level of importance/relevance of such knowledge to their line of work. Such responses suggest that the current educational modality has not met the needs of the respondents and that MDMC education has high importance/relevance.     

Making it REAL: Using Informational Picture Books in Preschool Classrooms

This article addresses the importance and benefits of integrating informational texts into read alouds in preschool classrooms through an instructional approach entitled REAL Time. Teachers use the REAL Time framework to pair complex storybooks with one or more informational texts in order to develop children’s understanding of key vocabulary and important real world concepts. Teachers are then encouraged to plan curricular experiences for children that deepen and extend their understanding. Such experiences help the teacher link children’s content knowledge across texts and learning experiences. While implementing REAL Time, teachers draw attention to text features and functions of informational texts in ways that build children’s understanding of print.     

Discovery Tools in the Classroom: A Usability Study and Implications for Information Literacy Instruction

In 2016, the University of Colorado Colorado Springs (UCCS) library acquired ProQuest’s discovery tool Summon. To determine when information literacy instruction using Summon would be effective and what aspects should be taught, librarians conducted a usability study. Students completed tasks focused on determining whether Summon is intuitive and whether the interface needs to be taught. Results indicate that students are comfortable with the interface and have few problems with the tool. Instead, participants struggled with critical thinking processes associated with research. Results were used to integrate the ACRL Framework for Information Literacy for Higher Education into instruction.     

Optimism and Wishful Thinking: Consistency Across Populations in Children’s Expectations for the Future

Two studies investigated 5- to 10-year-olds’ (N = 194) positivity bias when forecasting the future. Children from two geographic locations (mostly Caucasian, higher income college town; mostly African American, lower income urban community) completed a future expectations task (FET). For multiple scenarios, children predicted whether a positive versus negative (optimism items) or a positive versus extraordinary positive (wishful thinking items) outcome would occur, including its likelihood. In both samples, optimism and wishful thinking decreased with age, optimism was higher than wishful thinking, children did not show a comparative self-optimism bias, and individual differences in the FET optimism score correlated with self-reported dispositional optimism and hope. Exploratory comparisons revealed between-sample equivalence in responses to all measures, except for less tempered wishful thinking in the urban community.     

Parents' Evaluation of an Educational Psychology Service

An evaluation of parents' views of an Educational Psychology Service was carried out using a questionnaire survey and follow-up telephone interviews. The most satisfaction was expressed for the pre-school, early years services and child guidance support where a statement was not involved. Parents found it helpful to learn alternative ways to interpret behaviour from understanding professionals. They were less satisfied with statutory assessments of their older children already attending school. The main sources of dissatisfaction were the lack of communication with and involvement of parents in the course of the assessments, the length of time it took to decide on an assessment and the time taken to collect the relevant reports to draw up a statement. Implications for practice are discussed.     

Reading subskill differences between students in Shanghai-China and the US: evidence from PISA 2009

Based on different language systems and educational practices of their respective countries, hypotheses were made regarding how 15-year-old students from Shanghai-China and the US might differ in the 5 reading subskills designated in the Programme for International Student Assessment (PISA) when they have the same overall reading ability (i.e., when their overall reading ability is controlled for). A multilevel analysis was conducted to test the hypotheses using the PISA 2009 reading dataset. When we controlled for students' overall reading ability, individual socioeconomic status (SES), and school mean SES, Shanghai-Chinese students performed significantly better in integrating and interpreting than US students. Further, when we controlled for students' overall reading ability and school mean SES, US students showed significantly higher performance in reading non-continuous texts than Shanghai-Chinese students, whereas US students showed significantly lower performance in reading continuous texts. The results of this study can inform reading instruction and learning in the 2 countries.     

Effects of a college access program for youth underrepresented in higher education: A randomized experiment

This article describes EXCEL, a program that encourages youth underrepresented in higher education to enroll in higher education, specifically at the sponsoring university. Eighty-three eighth grade students with GPA of B and above and standardized test scores at grade level or above were randomly assigned to the program or to a control group. The program guaranteed a scholarship to the sponsoring university and provided enrichment activities throughout high school. Program students were more likely to enroll at the sponsoring university than were control students. However, program and control students enrolled in higher education at rates that did not differ significantly. No differences were detected in self-esteem or high school GPA. Program students desired more education than control students. The results suggest that scholarship incentive and support programs that target average to above average achieving students in the eighth grade may not raise the overall number of aspiring minority youth attending college, but may be useful to specific universities to raise their minority enrollment.