New Perspectives on the Correlation of SAT Scores, High School Grades, and Socioeconomic Factors

In studies of the SAT, correlations of SAT scores, high school grades, and socioeconomic factors (SES) are usually obtained using a university as the unit of analysis. This approach obscures an important structural aspect of the data: The high school grades received by a given institution come from a large number of high schools, all of which have potentially different grading standards. SAT scores, on the other hand, can be assumed to have the same meaning across high schools. Our analyses of a large national sample show that, when pooled within-high-school analyses are applied, high school grades and class rank have larger correlations with family income and education than is evident in the results of typical analyses, and SAT scores have smaller associations with socioeconomic factors. SAT scores and high school grades, therefore, have more similar associations with SES than they do when only the usual across-high-school correlations are considered .     

Contextual Factors Associated With the Validity of SAT Scores and High School GPA for Predicting First-Year College Grades

Prior research has shown that there is substantial variability in the degree to which the SAT and high school grade point average (HSGPA) predict 1st-year college performance at different institutions. This article demonstrates the usefulness of multilevel modeling as a tool to uncover institutional characteristics that are associated with this variability. The results revealed that the predictive validity of HSGPA decreased as mean total SAT (i.e., sum of the three SAT sections) score at an institution increased and as the proportion of White freshmen increased. The predictive validity of the three SAT sections (critical reading, mathematics, and writing) varied differently as a function of different institution-level variables. These results suggest that the estimates of validity obtained and aggregated from multiple institutions may not accurately reflect the unique contextual factors that influence the predictive validity of HSGPA and SAT scores at a particular institution.     

Effects of Coaching on SAT I: Reasoning Test Scores

A College Board-sponsored survey of a nationally representative sample of 1995–96 SAT takers yielded a data base for more than 4, 000 examinees, about 500 of whom had attended formal coaching programs outside their schools. Several alternative analytical methods were used to estimate the effects of coaching on SAT I: Reasoning Test scores. The various analyses produced slightly different estimates. All of the estimates, however, suggested that the effects of coaching are far less than is claimed by major commercial test preparation companies. The revised SAT does not appear to be any more coachable than its predecessor.     

New measures of college selectivity

Institutional averages of entering freshman scores on the Scholastic Aptitude Test (SAT) and the American College Test (ACT) were combined and edited to produce a single institutional measure of selectivity for 2,601 institutions. Older scores were adjusted to reflect decreasing performance over time, and ACT scores were converted to SAT equivalents, resulting in a final measure that reflects 1973 performance levels and is expressed as an SAT Verbal plus Mathematical score (range 400–1,600). Actual scores were available for 1,803 schools; the remaining schools with missing values were given an imputed score based upon means from similar institutions among the 1,803. Correlations between scores from different years and between the final measure and 19 institutional attributes indicated substantial reliability and validity for the selectivity measure.     

The Scholastic Aptitude Test: Participation and performance

In the past two decades high school educational achievement, as measured by the Scholastic Aptitude Test, has declined significantly. This paper proposes an empirical model of achievement that will allow us to examine more closely the reasons for this decline. The model posits average SAT scores as a function of various input levels, demographic characteristics of students, and the test-taking proportion itself. The empirical results indicate a strong relationship between test scores and participation rates. As a rule of thumb scores drop about 1.8 points for every one point increase in the participation rate. Adjusting reported SAT scores for participation causes a significant realignment of the cross-sectional state ranking. For a given state over time changes in participation are found to mask true increases or decreases in achievement, making the unadjusted SAT score a misleading indicator for policy analysis. Significantly, after controlling for participation and other input and demographic factors a mild upward trend is found in scores. Factors that may be responsible for the trend are discussed briefly.     

State Mean SAT Score as a Function of Participation Rate and Other Educational and Demographic Variables

The present study examined the impact of participation rate and nine other educational and demographic variables on state mean scores for the Scholastic Aptitude Test (SAT). Participation rate, defined as the percentage of a state's high school seniors taking the SAT represented by the z-score mean of a truncated normal distribution, was the most important single predictor of state mean SAT score, accounting for 77% of the total variance in mean scores. The inclusion of significant educational and demographic variables raised the proportion of variance explained to 94%. The fallacy of comparing the mean standardized test scores of different locations or time periods without taking participation rate into account is discussed.     

Preparing students for college admissions tests

Attaining successful outcomes on the SAT can have profound educational and financial consequences for college-bound students. Using archival data from a private tutoring centre, we investigated variables we hypothesised to contribute to SAT score increases. Our analyses revealed significant effects of time on task and rate of SAT homework completion. Starting preparation earlier in the junior year and distributing tutoring sessions over larger intervals contributed to higher SAT score improvements. Testing effects were significant: more frequent practice tests significantly increased SAT scores. Official SAT administrations contributed more to score increases than did unofficial practice tests. Individual tutoring hours yielded greater increases than did group tutoring hours. Student characteristics such as gender, SES, or private or public school attendance were not significant. Implications for improving test preparation for students as well as directions for future research are discussed.     

Predicting College Performance of American Indians: A Large‐Sample Examination of the SAT

Extensive research has examined the validity and fairness of standardized tests in academic admissions. However, due to their underrepresentation in higher education, American Indians have gained much less attention in this research. In the present study, we examined for American Indian students (1) group differences on SAT scores, (2) the predictive and incremental validity of SAT over high school grades, (3) the effect of socioeconomic status on SAT validity, (4) differential prediction in the use of SAT scores, and (5) potential omitted variables that could explain differential prediction for American Indian students. Results provided evidence of predictive and incremental validity of SAT scores, and the validity of SAT scores was largely independent of socioeconomic status. Overprediction was found when using SAT scores to predict college performance and it was reduced when including high school grades as an additional predictor. This study provides substantial evidence of the validity and fairness of SAT scores for American Indians.     

Comparing public and private high schools using three SAT data sets

Proponents of private schooling claim that private high schools, on the average, more effectively promote measured academic achievement than public high schools. They have also argued that private high schools increase high school completion rates and improve college enrollment rates among high school graduates. Their antagonists, typically, hold that there is little or no difference between public and private high schools with respect to any of these outcomes. We address two of these school effectivenes issues by applying multiple-regression analysis to two SAT data sets for Florida and a national SAT data set. We ask whether there are differences between public and private high schools in promoting achievement as measured by the high-profile SAT verbal and math tests. At the same time, we are asking, at least implicity, if either public or private high schools provide an SAT soore advantage in promoting college enrollments. Our analysis finds a consistent advantage for public high schools with respect to SAT math attainment. For high schools generally, however, it seems clear that school effects outweigh the impact of socially ascribed traits, such as race, ethnicity, gender, and social class.     

The Second Mathematics Standard Assessment Tasks at Key Stage 1: issues of reliability raised by a five school study

This paper assesses the value that can be put on the mathematical Standard Assessment Task (SAT) score as an indicator of how children are doing compared to others. The results of a study of a sample of 171 Year 2 children from five randomly selected primary schools within one Local Education Authority (LEA) are presented. Pupils’ scores on Mathematics 7, a standardised mathematics test for 7 year‐olds are compared to the mathematics SAT score elicited by them in the previous half‐term. Results show that children with the same Mathematics 7 score may be designated Level 1, 2 or 3 on the mathematics SAT. Conclusions, based on such a small study, are tentative. There is a need to be aware that finding out how a child is doing may be more complicated than simply looking at the SAT results. It may be hypothesised that the 10 point assessment scale is too crude a summative device to measure children's mathematical standards accurately.     

Public subsidies to private schools do make a difference for achievement in mathematics: Longitudinal evidence from Canada

Selection into private schools is the principal cause of bias when estimating the effect of private schooling on academic achievement. By exploiting the generous public subsidizing of private high schools in the province of Québec, the second most populous province in Canada, we identify the causal impact of attendance in a private high school on achievement in mathematics. Because the supply of highly subsidized spaces is much higher at the high school level than at the grade school level, 94% of transitions from the public to the private sector occur at the end of primary school, we assume that these transitions are exogenous with respect to changes in transitory unobserved variables affecting math scores conditional on variables such as changes in income and child fixed effects. Using 7 cycles of data from Statistics Canada's National Longitudinal Survey on Children and Youth (NLSCY), we estimate the effect of attending a private high school on the percentile rank and a standardized math test score with different models (child fixed effects, random effects and a pooled OLS) and restricted samples to control for the degree of selection. The results, interpreted as a treatment on the treated effect show that the effect of changing schools, from a public grade school to a private high school, increases the percentile rank of the math score between 4 and 10 points and by between 0.12 and 0.36 of a standard deviation depending on the specification and samples.     

How and Why to Support Common Schooling and Educational Choice at the Same Time

The common school ideal is the source of one of the oldest educational debates in liberal democratic societies. The movement in favour of greater educational choice is the source of one of the most recent. Each has been the cause of major and enduring controversy, not only within philosophical thought but also within political, legal and social arenas. Echoing conclusions reached by Terry McLaughlin, but taking the historical and legal context of the United States as my backdrop, I argue that the ideal of common schooling and the existence of separate schools, which is to say, the existence of educational choice, are not merely compatible but necessarily co-exist in a liberal democratic society. In other words, we need both common schooling and educational choice. The essay proceeds in four parts. First, I explain why we need to understand something about pluralism in order to understand common schooling and school choice. In the second and third parts, I explore the normative significance of pluralism for common schooling and educational choice, respectively. In the fourth part, I show how the two can be reconciled, given a certain understanding of what pluralism demands.     

Academic tracking is related to gains in students' intelligence over four years: Evidence from a propensity score matching study

Ability grouping or tracking during secondary schooling is widespread. Previous research shows academic track schools are more successful than non-academic track schools in teaching mathematics, reading and foreign languages. Reasons include a more favorable student composition and higher instructional quality. However, there is less evidence that between track differences are even large enough to differentially affect the students' cognitive development. We used data from a large Hamburg panel study to test this hypothesis (N = 8628). By employing several propensity score matching algorithms we formed parallelized samples of academic track and either non-academic track students or comprehensive school students. After four years of tracking, academic track students showed considerably higher intelligence scores than their counterparts at the non-academic tracks and slightly higher scores than students at the comprehensive schools. Our results underline the importance of a cognitively stimulating learning environment in school to support students' cognitive development.     

All Validities are Not Created Equal: Determinants of Variation in SAT Validity Across Schools

Previous research has demonstrated that cognitive test validities are generalizable and predictive of academic performance across situations. However, even after accounting for statistical artifacts (e.g., sampling error, range restriction, criterion reliability), substantial variability often remains around estimates of cognitive test–performance relationships suggesting the presence of additional moderators. In the present study, we examine the sources of institutional variation in Scholastic Aptitude Test (SAT) validity across a sample of 110 institutions. Institutional characteristics moderated the size of SAT validities, such that more selective schools and schools that emphasize traditional assessment techniques (i.e., school records, standardized tests) showed higher SAT validities while schools that were larger and where students demonstrated more financial need, schools that emphasized the usage of alternative assessment techniques (i.e., essays, letters of recommendations, extracurricular activities), and schools that enrolled higher percentages of historically disadvantaged minority students generally exhibited lower SAT validities. Future directions in the understanding of situational influences on SAT–grade point average validities are discussed.     

Within‐High‐School Versus Across‐High‐School Scaling of Admissions Assessments: Implications for Validity and Diversity Effects

Previous research has established that SAT scores and high school grade point average (HSGPA) differ in their predictive power and in the size of mean differences across racial/ethnic groups. However, the SAT is scaled nationally across all test takers while HSGPA is scaled locally within a school. In this study, the researchers propose that this difference in how SAT scores and HSGPA are scaled partially explains differences in validity and subgroup differences. Using a large data set consisting of 170,390 students each of whom matriculated at one of 114 separate colleges, the researchers find that awarding SAT scores by ranking SAT within a high school generally results in substantial reduction in the size of subgroup mean differences for this predictor. However, validity for predicting first‐year GPA is also reduced by a small amount. Conversely, placing HSGPA onto a nationally normed metric through the use of multiple regression procedures results in a moderate increase in the size of subgroup mean differences, while also producing a small increase in validity. Taken together, these findings suggest that differences in predictor scaling can partially explain differences in the size of subgroup mean differences between HSGPA and SAT scores and have implications for predictive power.     

School emphasis on academic success: exploring changes in science performance in Norway between 2007 and 2011 employing two-level SEM

We study whether changes in school emphasis on academic success (SEAS) and safe schools (SAFE) may explain the increased science performance in Norway between TIMSS 2007 and 2011. Two-level structural equation modelling (SEM) of merged TIMSS data was used to investigate whether changes in levels of SEAS and SAFE mediate the changes in science performance. Two mediation models were fitted, one using subdomain scores of science as manifest dependent variables and one in which these scores are indicators of a latent science performance variable. The change in the latent science variable was fully mediated by SEAS, but this model did not explain changes in earth science performance, which increased more than the other subdomains. In the model with subdomain scores as manifest dependent variables, SEAS mediated the increased performance of all 4 subdomains of science. SAFE did not explain increased science performance but did have a positive impact on SEAS.     

The Primary Classification Test

ABSTRACT

The authors sought to better understand the relationship between students participating in the Advanced Placement (AP) program and subsequent performance on the Scholastic Aptitude Test (SAT). Focusing on students graduating from U.S. public high schools in 2010, the authors used propensity scores to match junior year AP examinees in 3 subjects to similar students who did not take any AP exams in high school. Multilevel regression models with these matched samples demonstrate a mostly positive relationship between AP exam participation and senior year SAT performance, particularly for students who score a 3 or higher. Students who enter into the AP year with relatively lower initial achievement are predicted to perform slightly better on later SAT tests than students with similar initial achievement who do not participate in AP.     

Away with all teachers: The cultural politics of home schooling

In the United States and a number of nations, one of the most powerful dynamics of educational 'reform' involves the movement toward home schooling. The national media have spoken glowingly about it and the number of children being schooled at home is growing rapidly. In large part, this is stimulated by the circulation of anti-statist discourses and by the continuation and expansion of claims about school failure. In these accounts, the sources of educational problems are multiple: teacher education institutions produce teachers who are unprepared academically and unskilled in teaching the 'basics'; state funded (public, in the US sense of the word) schools have been taken over by 'progressive' models of teaching that are unworkable; these same schools do not teach 'traditional' cultural and religious knowledge, beliefs, and values; and public schools do not listen to conservative parents and are much too bureaucratic. Supporters of home schooling are usually religious fundamentalists who have increasing power in the USA and elsewhere. They have formed a national coalition and have joined in a tense rightist hegemonic alliance with neo-liberals and neo-conservatives, an alliance that seeks to reconstruct our common-sense about education and about all things social. The article shows how the movement toward home schooling has become more extensive and more dangerous than has usually been thought. In the process, home schooling is situated within the larger conservative and authoritarian populist ideological, religious, and social movements that provide much of its impetus. Connections are suggested with other protectionist impulses and connections are made to the history of and concerns about the growth of activist government. Finally, the article points to how it may actually hurt many other students who are not home schooled.     

The Effect of High School Socioeconomic Status on the Predictive Validity of SAT Scores and High School Grade‐Point Average

Research has often found that, when high school grades and SAT scores are used to predict first‐year college grade‐point average (FGPA) via regression analysis, African‐American and Latino students, are, on average, predicted to earn higher FGPAs than they actually do. Under various plausible models, this phenomenon can be explained in terms of the unreliability of predictor variables. Attributing overprediction to measurement error, however, is not fully satisfactory: Might the measurement errors in the predictor variables be systematic in part, and could they be reduced? The research hypothesis in the current study was that the overprediction of Latino and African‐American performance occurs, at least in part, because these students are more likely than White students to attend high schools with fewer resources. The study provided some support for this hypothesis and showed that the prediction of college grades can be improved using information about high school socioeconomic status. An interesting peripheral finding was that grades provided by students’ high schools were stronger predictors of FGPA than were students’ self‐reported high school grades. Correlations between the two types of high school grades (computed for each of 18 colleges) ranged from .59 to .85.     

Gender and ethnic differences in precollege mathematics coursework related to science,technology, engineering,and mathematics (STEM) pathways

This paper aims to investigate how stability varies with the approach used in estimating school performance in a large sample of English primary schools. The results show that (a) raw performance is considerably more stable than adjusted performance, which in turn is slightly more stable than growth model estimates; (b) schools’ performance indicators are less dependent on the schools’ social composition score when scores are adjusted, and in particular for growth scores; (c) in the multilevel growth models (MGM), 74% of the variance in student rates of growth is attributable to schools; (d) the trajectories of individual students within a school are highly convergent, as if they were all being brought towards a common, stable target. Some implications for using these indicators for evaluating and regulating school improvement are discussed.