The Stability of School Effectiveness Indices Across Grade Levels and Subject Areas

School effectiveness indices (SEIs) based on regressing achievement test performance onto earlier test performance and a socioeconomic status (SES) measure were obtained for eight subject–grade level combinations for a large sample of elementary schools. School means based on longitudinally matched student scores comprised the data set used in the analysis. The resulting SEIs were found to be somewhat unstable across subject areas (reading and mathematics) and very unstable across grade levels (1 through 4). Grade-to-grade correlations of the SEIs measuring mathematics performance, although small, tended to be statistically significant, whereas those measuring reading performance were generally nonsignificant. Thus, school effects may be more readily discernible in some subject areas than in others. Implications for research on effective schools and for the design of school recognition programs based on student test performance are discussed.     

Monitoring Student Achievement for Accountability: The Demonstration of a Model

Abstract

This study demonstrated a procedural model that can be applied by any school to assess, guide, and account for the progress of its students as well as to analyze its own effectiveness. The model uses equivalent achievement tests to monitor student achievement in subject areas at grade levels, between grade levels, and across subgroups of students. Multiple regression analyses of test scores between grades identify factors associated with achievement Using sixth and eighth grade Comprehensive Tests of Basic Skills scores in a matched longitudinal sample of 208 students, the study found small differences in average achievement between boys and girls. Differences between corresponding sixth and eighth grade test means were higher in mathematics than in language. From the sixth grade to the eighth, there was a widening gap in average achievement between high and low I.Q. groups. In multiple regressions of eighth grade test scores on sixth grade measures, I.Q., study skills, and reading were prevalent in the regression equations, but clusters of measures associated with achievement differed between high and low’ LQ. groups. The results of the study have implications for developing and evaluating the achievement of students with varying mental abilities.     

Black Girls' Achievement in Middle Grades Mathematics: How Can Socializing Agents Help?

The middle grades mathematics classroom is full of transitions that students must overcome to become successful long-term learners of mathematics. This transition can be exorbitantly more tumultuous for Black girls who must overcome gender and racial mathematics achievement stereotypes. Mathematics identities and achievement socialization trends can help Black girls navigate the challenges associated with these transitions. In this article, we argue that socializing agents can play a key role in the development of positive mathematics identities and positive achievement socialization patterns in Black girls. We use recent National Assessment of Educational Progress (NAEP) data to characterize Black girls' middle grades content knowledge through a strength-based and growth-oriented lens. Then using the data, we provide explicit examples of how parents, teachers, and curriculum developers acting as socializing agents can harness Black girls' funds of knowledge to address the observed challenges identified in the mathematics NAEP data.     

Cultural discontinuity between home and school and American Indian and Alaska Native children's achievement

An assumption of culture-based education with respect to American Indian and Alaska Native (AI/AN) children is that discontinuity between home and school cultures is responsible for educational underachievement. Using data from the 2009 round of the National Indian Education Study, a subset of the larger National Assessment of Education Progress (NAEP), the author constructed a measure of cultural discontinuity and examined its relationship to AI/AN students' Grade 4 and 8 reading and mathematics achievement. Contrary to the cultural discontinuity hypothesis, there is no statistically significant negative relationship when the culture of the home is discontinued at school. On the Grade 4 NAEP reading assessment, in particular, cultural discontinuity was positively associated with students' achievement, net of both student- and school-level controls. Findings suggest that the assumptions of culture-based education may be overstated, though longitudinal data are still needed to be able to make causal claims.     

Choice of Holland's Social Type College Majors for U.S. Racial/Ethnic Groups

We used national data to study the longitudinal effects of several variables on choice of Holland (1997) social type college majors versus other majors. We examined these effects for four of the five major U.S. racial/ethnic groups, Asian/Pacific Islanders, Hispanics, Blacks, and Whites. Effects of mathematics scores and gender on choice of social majors were fairly consistent across racial/ethnic groups, whereas effects of reading scores and SES differed across racial/ethnic groups. Results for Whites were most consistent with Holland's theoretical formulations regarding the effects of variables on choice of social-type educational/occupational environments.     

Performance of students in project‐based science classrooms on a national measure of science achievement

Reform efforts in science education emphasize the importance of supporting students' construction of knowledge through inquiry. Project‐based science (PBS) is an ambitious approach to science instruction that addresses concerns of reformers. A sample of 142 10th‐ and 11th‐grade students enrolled in a PBS program completed the 12th‐grade 1996 National Assessment of Educational Progress (NAEP) science test. Compared with subgroups identified by NAEP that most closely matched our student sample, White and middle class, PBS students outscored the national sample on 44% of NAEP test items. This study shows that students participating in a PBS curriculum were prepared for this type of testing. Educators should be encouraged to use inquiry‐based approaches such as PBS to implement reform in their schools. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 410–422, 2002     

Assessment of mathematics and reading performance: An examination of the correspondence between direct assessment of student performance and teacher report

Teacher judgments have been identified as a primary source of information regarding student academic achievement. Research examining the accuracy of teachers' judgments in assessing students' academic abilities has shown relatively high accuracy. However, previous studies have relied primarily on norm‐referenced measures to obtain estimates of students' achievement in reading and mathematics. Recent developments in the assessment of students' academic skills, such as Curriculum‐Based Measurement (CBM), provide a direct estimate of students' skill levels in basic areas such as reading and mathematics. The purpose of the present study was to examine the extent to which teachers' perceptions of students' reading and mathematics skills corresponded to direct estimates of students' reading and mathematics skills. Two second‐grade teachers estimated the reading and mathematics skills of 33 second‐grade students. Results of this study indicated that teachers were not accurate in assessing their students' mathematics functioning. Teachers were more accurate in assessing the occurrence of Mastery mathematics levels in basic addition, but were very inaccurate in assessing the occurrence of Mastery, Instructional, or Frustrational mathematics levels in all other skills assessed. In reading, teachers' judgment accuracy varied as a function of grade‐level material and instructional level. Specifically, teachers experienced considerable difficulty accurately identifying students who were reading at a Mastery level in grade‐level or above‐grade‐level material. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 247–265, 2006.     

Predicting students’ writing performance on the NAEP from student- and state-level variables

This study examines the relationship between students’ demographic background and their experiences with writing at school, the alignment between state and National Assessment of Educational Progress (NAEP) direct writing assessments, and students’ NAEP writing performance. The study utilizes primary data collection via content analysis of writing assessment prompts and rubrics and secondary analysis with NAEP data through hierarchical linear modeling. Results indicate students from states with writing tests more similar to the NAEP do not perform significantly better than students from states with writing tests less similar to the NAEP. Rather, student demographic characteristics, including gender, ethnicity, SES, disability status, and English learner status significantly predict NAEP writing performance, as do factors related to frequency of writing across subject areas, frequency of writing for varied purposes, frequency of writing process use, and computer use in writing. The implications of the findings for writing instruction are discussed.     

Accounting for the gender gaps in student performance in reading and mathematics: evidence from 31 countries

In most countries, girls perform better than boys in reading but worse in mathematics. However, there is much variation between countries. Explanations for the gender gaps include the organisation of the school system, students' expectations and macro‐societal factors. The purpose of this paper is to account for gender differences in both reading and mathematics among 15‐year‐old students using data from the OECD's 2000 Programme for International Student Assessment (PISA) project. In most countries, school system factors are associated with the gender gap in reading but not in mathematics. Generally, gender differences in students' occupational expectations do not account for the gender gaps, although expectations contribute to the gender gaps in reading in New Zealand and the United States. Although several macro‐societal factors—the proportion of women in the workforce, societal inequality and public sector spending—are associated with the gender gap in reading, the correlations are only moderate, unstable and, importantly, are not associated with the gender gaps in mathematics. The much stronger association between the gender gaps in reading and mathematics across countries implies that they are both influenced by policy: the extent that countries have successfully implemented policies to promote the educational outcomes of girls and young women. In such countries the gender gap in mathematics is small or non‐existent but the gender gap in reading is relatively large. Policies shift both gender gaps in tandem.     

Boys Outperforming Girls: an 8‐year cross‐sectional study of attainment and self‐esteem in Year 6

This 8‐year cross‐sectional study measured the self‐esteem, reading and mathematical attainments of eight cohorts of Year 6 children. A total of 1488 children (737 boys, 751 girls) in five randomly selected primary schools within one Local Education Authority (LEA) comprised the sample to which the Lawseq questionnaire (Lawrence, 1982), Mathematics 11 (NFER, 1985) and the Primary Reading Test Level 2 (France, 1981) were administered. Differences in attainment related to gender were found in mathematics, but not in reading, with boys significantly outperforming girls (at the 5% level). The percentage of boys who scored significantly above the mean in mathematics and significantly below the mean in reading contrasted with the girls’ more compressed scores in the middle range. The national test data for Cohorts 7 and 8 followed the national pattern with girls outperforming boys. Boys had significantly higher self‐esteem than the girls (at the 0.1% level). Correlation coefficients between Lawseq and mathematics and reading mean scores for boys and girls were all significant at the 0.1% level. The findings are discussed in relation to the current debate concerning the low performance of boys.     

美国国家教育进展评价NAEP及其借鉴意义

美国国家教育进展评价,即"国家教育报告卡",是美国一个全国性的教育进展评价项目,旨在测量全美中小学生在阅读、写作、数学、科学、社会等学科领域的学术表现及发展趋势。NAEP是美国目前唯一定期在各个学科领域持续测评学生学业的全国性评价项目,它提供了大量有关美国中小学生学业表现的基础数据。NAEP在编制、抽样、组织、报告等方面的一些做法和经验,对于我们研制中小学各科学业评价标准及开展基础教育质量监测,具有借鉴意义。     

A Review of “Constructing Identities in Online Communities of Practice: A Case Study of Online Learning”

ABSTRACT

This study addresses the issue of educational inadequacy and inequity for disadvantaged minority students. It estimates desired national standards and examines interrelated gaps in key school–teacher resources and mathematics achievement by linking national education data sets (National Assessment of Educational Progress [NAEP], Common Core of Data, and Schools and Staffing Survey). Although poor minority students’ chances to meet the national mathematics proficiency standard are undermined by the lack of their access to qualified teachers and adequate school funding, it turns out that the adequacy-based (absolute) gaps are much larger than the equity-based (relative) gaps. Meeting the NAEP Grade 8 mathematics proficiency standard requires substantial increases in per-pupil education spending (from $6,493 to $7,197 in year 2000 dollars) and in-field mathematics teaching rate (from 49% to 91%) across the nation. Research and policy implications are discussed.     

Language and Mathematical Performance: a Comparison of Lower Secondary School Students with Different Level of Mathematical Skills

This study investigated the connection between language (i.e., word comprehension, reading comprehension and spelling skills) and mathematical performance. The sample consisted of grade nine students (N?=?810) in 14 lower secondary schools in the Swedish speaking areas of Finland. Standardized tests for reading and writing skills, and mathematical performance were used. Based on the mathematics test the students were categorized into eight performance groups. Many students had problems in both mathematics and language performance. On the whole data level reading skills were a powerful predictor for math performance, the reading factor explained 52% of the variance in the model. Hence, the reading skills focusing on understanding of the text are important in solving mathematical tasks at the end of compulsory school.     

An instructional intervention's impact on the science and literacy achievement of culturally and linguistically diverse elementary students

This research examined the impact of the first‐year implementation of an instructional intervention to promote achievement and equity in science and literacy for culturally and linguistically diverse elementary students. The research addressed three areas: (a) overall science and literacy achievement, (b) achievement gaps among demographic subgroups, and (c) comparison with national (NAEP) and international (TIMSS) samples of students. The research involved 1,523 third‐ and fourth‐grade students at six elementary schools in a large urban school district. Significance tests of mean scores between pre‐ and posttests indicate statistically significant increases on all measures of science and literacy at both grade levels. While achievement gaps widened with third graders on some of the measures, the gaps tended to narrow with fourth graders. The results based on item‐by‐item comparisons with NAEP TIMSS samples of students indicated overall positive performance of the students in the research at the end of the school year. © 2005 Wiley Periodicals, Inc. J Res Sci Teach 42: 857–887, 2005     

Benefits of Opportunity to Read and Balanced Instruction on the NAEP

Abstract

The National Assessment of Educational Progress (NAEP) requires reading comprehension processes that may be increased by students' amount of engaged reading, parental education, and gender, along with balanced reading instruction and opportunity to read. To examine the effects of those variables on reading achievement and engagement, the authors analyzed the 1994 Grade 4 Maryland NAEP with hierarchical linear modeling to construct both between-school and between-teacher models. Amount of engaged reading significantly predicted reading achievement on the NAEP, after parental education was statistically controlled. Balanced reading instruction significantly predicted reading achievement after accounting for students' engaged reading and parental education. Findings confirmed expectations from the proposed theoretical perspective on reading engagement. Policy implications included an emphasis on some instructional variables in the reading engagement model.     

Socioeconomic Gaps in Academic Achievement Within Schools: Are They Consistent Across Subject Areas?

Few studies have examined the correlates of within-school socioeconomic gaps in academic achievement corresponding to subject areas across schools. This study addressed this limitation with data from the New Brunswick School Climate Study (N = 6,883 students from 148 schools) which contained measures on academic achievement in four subject areas (mathematics, science, reading, and writing) as well as student and school background characteristics. Results of multivariate, multilevel analyses showed that within-school socioeconomic gaps were similar between reading and writing as well as between mathematics and science. Furthermore, the interrelationships of within-school socioeconomic gaps in academic achievement corresponding to the four subject areas across schools were not much influenced by student background characteristics (gender, Native status, number of parents, and number of siblings) and characteristics of school context and climate (school size, school mean SES, disciplinary climate, academic expectation, and parental involvement).     

What Do School‐Level Scores From Large‐Scale Assessments Really Measure?

Although assessments of mathematics, reading, and writing are assumed to measure distinct academic skills, this may be difficult owing to the pervasive influence of general ability on performance. Factor analyses of school-level data from 14 large-scale assessment programs revealed that 80% of the variance in mathematics, reading, and writing scores was due to a common, underlying factor. Multiple regression analyses confirmed that scores contribute little information that is unique to a particular subject (6% or less). Although different assessments may create the illusion of providing unique information, they may be tapping into generic cognitive abilities that cut across content areas. These results raise suspicions about the value and validity of interpretations based on school-level subject area scores.     

Attention,Scholastic Achievement and Timing of Lessons

Previous research has revealed that lower grade elementary school pupils who differ in their ability to learn to read also differ with respect to the optimal time of day for reading achievement. The present study strove to determine the hours of optimal attention in older pupils who varied in their apparent aptitude for mathematics. A sample of 204 fifth graders and 202 tenth graders were divided into three groups (high, average and low ability) on the basis of their mean yearly mathematics achievement scores. The subjects were asked to report on their attention levels throughout the day. The findings showed that fifth graders' attention levels were especially high in the afternoon, whereas tenth graders reported increased concentration during the morning hours. Among tenth graders, but not among fifth graders, there was a significant interaction between mathematics achievement and attention levels at various times of day. The practical implications of these findings for the planning of school schedules are discussed.