A COMPARISON OF THE RELIABILITY AND VALIDITY OF TWO METHODS FOR ASSESSING PARTIAL KNOWLEDGE ON A MULTIPLE-CHOICE TEST

Differential weighting of response alternatives and confidence testing have been proposed as ways to assess partial knowledge on multiple-choice tests. 211 students in an educational measurement course took their midterm examination under one of three procedures. Results from those students administered the test under conventional directions provided a baseline for comparing, in terms of reliability and validity, the results from students who took the test under the differential weighting of response alternatives or the confidence testing instructions. Reliability was estimated by the split-half technique. Validity was estimated by correlating midterm test scores with scores on a final examination. This investigation provides some support for the contention that validity can be improved using more sophisticated testing techniques. Suggestions for the conduct of more definitive studies were offered.     

Exercising a bounded autonomy: novice and experienced teachers’ adaptations to curriculum materials in an age of accountability

This study explores teachers’ first enactments of a set of theory-based curriculum materials designed to support academic language instruction. Specifically, this multiple case study looks at how six middle school English teachers in three US schools adapted the materials; each case includes a pair of teachers, one novice and one more experienced. All schools were located in the same district where a school performance measurement system was being used to publicly rank schools’ academic performance and growth. Multiple measures were used to look for evidence of adaptations and why teachers made adaptations. We found that all teachers adapted the curriculum, most often in response to either perceived student needs or district reform pressures. In two cases, patterns of adaptation differed by teacher experience; experienced teachers appeared better able to adapt curriculum materials to meet instructional goals. This pattern did not hold up at the third school, where teachers faced greater reform pressures. Taken together, these findings suggest that researchers should pay more attention to the role of school and district policy on teachers’ enactments of theory-based reforms. We conclude with guidance to researchers, instructional leaders and others interested in the potential of theory-based curricula as a lever for improving classroom instruction.     

Does prior mathematics knowledge really lead to variation in elementary statistics performance? Evidence from a developing country

A model incorporating prerequisite mathematics performance and other variables deemed to be associated with learning elementary statistics (ES) is developed. The relationship between ES performance and the explanatory variables is well represented by the logistics form. Aptitude, effort and motivation are the only significant explanatory variables of ES performance. Since prerequisite mathematics is not significant, statistical thinking at the tertiary level may be mostly intuitive and non-mathematical. Students with low aptitude experience increasing returns to effort over the first half of the feasible effort interval, while high-aptitude students experience diminishing returns at all levels of effort. The levels of effort required to achieve a minimum pass are interpreted.     

Toward Developing a Behavioral Counselor Education Model

Counselor education currently does not have a training model that is systematically employed and contains provisions for individual differences or promotes the development of programs for facilitating transfer of training. In the proposed model, counselor educators must decide which of the counseling student's thinking, feeling, and acting behaviors will become the focus of training efforts. The staff creatively implements its conceptualized behavioral curriculum goals through the application of learning principles to specified counseling student behaviors that are assessed to determine if whether or not the desired behavior changes are occurring.     

Determining the level of inquiry in teachers' questions

The purpose of this investigation was to determine if an instrument, originally designed to classify levels of teachers' questions on the basis of logical operations, could be utilized to measure the level of inquiry present in a classroom discussion and to determine if the inquiry questioning behavior of the teacher influenced student achievement. The results of the study show that the modified classification scheme could accurately and reliably measure the inquiry level of teachers' classroom questions. The data also indicated that teachers who ask a greater proportion of high inquiry questions cause a greater change in students as measured by an achievement examination.     

Validity of self-reported reading disability by parents of reading-disabled and control children

Composite reading scores obtained from parents of 125 reading-disabled children and 125 matched control children who participated in the Colorado Family Reading Study were used to test the validity of self-reported reading problems. Parents who reported that they encountered serious difficulty learning to read had significantly lower reading scores than did those who reported no positive history of reading problems. Moreover, this difference was larger for parents of reading-disabled children than for those of controls. Thus, parental self-reports provide a valid index of reading problems.