Writing evaluation: rater and task effects on the reliability of writing scores for children in Grades 3 and 4

We examined how raters and tasks influence measurement error in writing evaluation and how many raters and tasks are needed to reach a desirable level of .90 and .80 reliabilities for children in Grades 3 and 4. A total of 211 children (102 boys) were administered three tasks in narrative and expository genres, respectively, and their written compositions were evaluated in widely used evaluation methods for developing writers: holistic scoring, productivity, and curriculum-based writing scores. Results showed that 54 and 52% of variance in narrative and expository compositions were attributable to true individual differences in writing. Students’ scores varied largely by tasks (30.44 and 28.61% of variance), but not by raters. To reach the reliability of .90, multiple tasks and raters were needed, and for the reliability of .80, a single rater and multiple tasks were needed. These findings offer important implications about reliably evaluating children’s writing skills, given that writing is typically evaluated by a single task and a single rater in classrooms and even in some state accountability systems.     

DEVELOPING PARENT‐PROFESSIONAL PARTNERSHIPS IN A POSTSECONDARY EDUCATION PROGRAM FOR STUDENTS WITH DISABILITIES

Opportunities are increasing for students with intellectual and/or developmental disabilities to attend postsecondary education programs located at college campuses around the nation. Students who attend postsecondary education programs experience numerous positive outcomes, including independent living skills and expanded social networks. However, although parent‐professional partnerships could significantly enhance long‐term outcomes such as competitive employment and independent living, there is a paucity of information about the nature of these partnerships in postsecondary settings. The purpose of this expository article is to describe how staff from a midwestern postsecondary education program facilitate parent‐professional partnerships through parent involvement and support.     

Design,validation, and use of an evaluation instrument for monitoring systemic reform

Over the past decade, state and national policymakers have promoted systemic reform as a way to achieve high‐quality science education for all students. However, few instruments are available to measure changes in key dimensions relevant to systemic reform such as teaching practices, student attitudes, or home and peer support. Furthermore, Rasch methods of analysis are needed to permit valid comparison of different cohorts of students during different years of a reform effort. This article describes the design, development, validation, and use of an instrument that measures student attitudes and several environment dimensions (standards‐based teaching, home support, and peer support) using a three‐step process that incorporated expert opinion, factor analysis, and item response theory. The instrument was validated with over 8,000 science and mathematics students, taught by more than 1,000 teachers in over 200 schools as part of a comprehensive assessment of the effectiveness of Ohio's systemic reform initiative. When the new four‐factor, 20‐item questionnaire was used to explore the relative influence of the class, home, and peer environment on student achievement and attitudes, findings were remarkably consistent across 3 years and different units and methods of analysis. All three environments accounted for unique variance in student attitudes, but only the environment of the class accounted for unique variance in student achievement. However, the class environment (standards‐based teaching practices) was the strongest independent predictor of both achievement and attitude, and appreciable amounts of the total variance in attitudes were common to the three environments. © 2001 John Wiley & Sons, Inc. J Res Sci Teach 38: 646–662, 2001     

Classroom Environment Instruments: Development,Validity and Applications

Few fields of educational research have such a rich diversity of valid, economical and widely-applicable assessment instruments as does the field of learning environments. This article describes nine major questionnaires for assessing student perceptions of classroom psychosocial environment (the Learning Environment Inventory, Classroom Environment Scale, Individualised Classroom Environment Questionnaire, My Class Inventory, College and University Classroom Environment Inventory, Questionnaire on Teacher Interaction, Science Laboratory Environment Inventory, Constructivist Learning Environment Survey and What Is Happening In This Class) and reviews the application of these instruments in 12 lines of past research (focusing on associations between outcomes and environment, evaluating educational innovation, differences between student and teacher perceptions, whether students achieve better in their preferred environment, teachers' use of learning environment perceptions in guiding improvements in classrooms, combining quantitative and qualitative methods, links between different educational environments, cross-national studies, the transition from primary to high school, and incorporating educational environment ideas into school psychology, teacher education and teacher assessment).     

African-American Teachers' Knowledge of Teaching: Understanding the Influence of Their Remembered Teachers

Many researchers have emphasized the connection between teachers' thinking and their autobiography, noting that much of teachers' knowledge of teaching has been derived from their life experiences. Since teachers have spent many years watching teachers teach, those experiences become part of the process of learning to teach. This article examines the role of former or remembered teachers in the shaping of the beliefs and practices of eleven successful African-American teachers who teach in urban schools in a major metropolitan area. Both the remembered teachers and the teachers in this study used their pedagogy to enable their students to achieve in spite of circumstances that often militated against success.     

When Does 'Good News' Become 'Bad News'? Relationships between Government and the Integrated Schools in Northern Ireland

The development of a set of religiously integrated schools in Northern Ireland since 1981 is often portrayed in wholly positive terms. However, the continued growth of the movement has generated serious tensions at a number of levels which have wider implications for any analysis of the implications of parental choice.     

Reward contrast in delay and probability discounting

In this study, we examined whether reward contrast influences choice between delayed and probabilistic outcomes. Specifically, we predicted that the subjective value of an intermediate reward would seem relatively larger or smaller, respectively, if it followed choices involving a smaller or larger reward and would produce corresponding changes in rates of delay and probability discounting. In Experiment 1, subjects made choices about hypothetical 5,000 or5,000 or 50 outcomes and then made choices about 500 outcomes. Delay-discounting rates for the500 outcomes. Delay-discounting rates for the 500 outcome were larger for Group 5,000 than for Group5,000 than for Group 50, whereas the opposite result was obtained for probability-discounting rates. In Experiment 2, we used a design that allowed for contrast effects to be assessed within subjects. Two groups made choices about delayed or probabilistic rewards. After completing question blocks in which the amount was 5,000 or5,000 or 50, subjects responded to questions with an intermediate amount (475/475/525). For Group Delay, the present value of the intermediate reward was greater after the 50 block than after the50 block than after the 5,000 block, whereas the opposite was obtained for Group Probability. The results from both experiments confirmed the predictions of reward contrast and suggested that the subjective value of a monetary reward varies inversely with the prior reward amount.     

What do we know about early sport specialization? Not much!

In November 2005, the International Olympic Committee's Medical Commission issued a statement on Training the elite child athlete recommending that “more scientific research be done to better identify the parameters of training the elite child athlete”. This paper focuses on a specific issue related to training the child athlete: early specialization. While associations between early specialization and expertise development are highlighted, much research also suggests early specialization is associated with a range of negative consequences affecting physical, psychological, and social development. Alternately, some researchers have proposed that an early diversification approach does not disadvantage athletes in acquiring expertise, and is important for the development of intrinsic motivation and skill transferability. However, this review suggests that inadequate evidence exists to resolve the issue in favor of either approach.     

Gender differences in preschool children’s recall of competitive and noncompetitive computer mathematics games

This study investigated whether competitive and noncompetitive educational mathematics computer games influence four‐ to seven‐year‐old boys’ and girls’ recall of game‐playing experience. A qualitative analysis was performed to investigate what preschool children may have learned through their selective recall of game‐playing experience. A difference emerged in six‐ to seven‐year‐old boys’ and girls’ recall after playing a competitive computer mathematics game, such that boys tended to first recall the consequence of ‘winning and losing’ whereas girls of the same age focused on ‘friendship among animated characters’ in the game. Thus, the qualitative results suggest the possibility that selective attention or selective recall might be partially influenced by gender schemas. Based on the recall sequences, educational noncompetitive computer mathematics games may lead to a better learning outcome for older boys.     

The advance of research and evaluation skills by EPs: implications for training and professional development

Research and evaluation has become increasingly important in many professions, including educational psychology, particularly as the profession moves to becoming more evidence‐based in its practice. The recent move to a three year doctoral programme in England, Wales and Northern Ireland may be viewed as a positive one in developing research skills, although it is also crucial to consider what could be done to extend the research skills of those already qualified. Lessons may be learned by looking to clinical psychology and some of the health professions. Finally, some further implications for the training and professional development of Educational Psychologists (EPs) in the UK are considered.