Understanding Differences in Academic Effectiveness: Practitioners’ Views∗

As part of a large‐scale study of the ability of 94 secondary schools to promote academic achievement, case studies of six outlier schools were conducted and headteachers (principals) and their deputies were questioned about the processes of effectiveness. The analysis of their responses ‐ grouped by the performance of their school (measured by value added analyses of three years of public examination results) as effective, ineffective or mixed ‐ reveals considerable support for previously cited characteristics of effective schooling. Despite the limitations imposed by a reliance on the use of retrospective accounts, the study takes forward the field of school effectiveness in its search for generalisable findings and coherent theory.

     

Developmentally appropriate parent training for families with young children

In an effort to explore the value and feasibility of teaching the principles behind developmentally appropriate practices to parents, 53 families with young children were studied. Parents were randomly assigned to participate or not participate in a three month-long, weekly, parent training program. Following completion of the program members of participating families were less likely to engage in conflict during a puzzle solving task than were members of nonparticipating families. Parents who participated were more likely to take a supportive leadership role and have age-appropriate expectations during a puzzle solving task than were nonparticipating parents. Children in participating families showed better social skills than children in nonparticipating families. Portions of the increase in social skills were related to reductions in family conflict and to the development of a task orientation that was more appropriately focused on process than outcome. Lower family conflict was also related to better gross motor skills in children.     

Can Examinees Use a Review Option to Obtain Positively Biased Ability Estimates on a Computerized Adaptive Test?

Part of the controversy about allowing examinees to review and change answers to previous items on computerized adaptive tests (CATs) centers on a strategy for obtaining positively biased ability estimates attributed to Wainer (1993) in which examinees intentionally answer items incorrectly before review and to the best of their abilities upon review. Our results, based on both simulated and live testing data, showed that there were instances in which the Wainer strategy yielded inflated ability estimates as well as instances in which it yielded deflated ability estimates. The success of the strategy in inflating ability estimates depended on the ability estimation method used (maximum likelihood versus Bayesian), the examinee's true ability level, the standard error of the ability estimate, the examinee's ability to implement the strategy, and the type of decision made from the ability estimate. We discuss approaches to dealing with the Wainer strategy in operational CAT settings.     

The Application of Computer Technology to Education—Innovative Projects of the U.S. Office of Education

Dr. Reddick discusses four promising educational research projects currently being funded by the Bureau of Research.