Using Explanatory Item Response Models to Analyze Group Differences in Science Achievement

Correlational evidence suggests that high school GPA is better than admission test scores in predicting first-year college GPA, although test scores have incremental predictive validity. The usefulness of a selection variable in making admission decisions depends in part on its predictive validity, but also on institutions’ selectivity and definition of success. Analyses of data from 192 institutions suggest that high school GPA is more useful than admission test scores in situations involving low selectivity in admissions and minimal to average academic performance in college. In contrast, test scores are more useful than high school GPA in situations involving high selectivity and high academic performance. In nearly all contexts, test scores have incremental usefulness beyond high school GPA. Moreover, high school GPA by test score interactions are important in predicting academic success.     

Relationships between learning approach,procrastination and academic achievement amongst first-year university students

Individual differences in student learning influence academic performance, and two aspects influencing the learning process are the particular learning approach the students use and procrastination behaviour. We examined the relationships between learning approaches, procrastination and academic achievement (measured 1 year later as the grade point average (GPA)) amongst 428 first-year university students. Deep and strategic learning approaches positively predicted GPA, and a mediation analysis showed that the strategic learning approach also partly mediated the effect between deep learning approach and GPA. Less procrastination was associated with a strategic learning approach, but procrastination tendencies did not predict GPA. Recommendations are made for educating new students in cognitive and meta-cognitive strategies, helping reduce their procrastination and facilitating the use of deep and strategic learning approaches.     

Robust and specific personality traits as predictors of adolescents’ final grades and GPA at the end of compulsory schooling

The study investigated the predictive value of robust and specific personality traits in adolescents (M _age?=?14.7 years), in explaining their academic achievement at the end of basic compulsory schooling. Personality data were obtained through self, maternal, and peer reports using the Inventory of Child/Adolescent Individual Differences. Adolescent gender and maternal education predicted 36, 26, 19, and 26 % of the variance in the final grades in Slovene, English, and mathematics and the overall GPA, respectively. Personality ratings by each of the three groups of informants substantially improved the prediction of students’ academic achievements, over and beyond gender and maternal education. The robust trait scores contributed to significant increments in the variance explained, across the academic achievement indicators, ranging from 8 to 17 % (self-report), 15 to 24 % (maternal report), and 20 to 32 % (peer report). Conscientiousness was consistently the most powerful predictor of students’ academic success and extraversion was negatively associated with all achievement indicators. The study provided support for a relatively stronger predictive utility of specific, rather than robust personality traits. Likewise, peer ratings of the students’ personality provided relatively larger increments in variance explained in academic achievements than maternal and self-ratings; in general, the personality trait ratings added more to the prediction of mathematics grades and the GPA relative to the prediction of success in languages. Among specific traits, subjectively perceived student intelligence was the most powerful and consistent predictor of final grades and GPA.     

Relationships among stress,coping, and mental health in high‐achieving high school students

This study investigates the relationships among stress, coping, and mental health in 139 students participating in an International Baccalaureate (IB) high school diploma program. Mental health was assessed using both positive indicators (life satisfaction, academic achievement, academic self‐efficacy) and negative indicators (psychopathology) of adolescent social‐emotional and school functioning. Findings include that students in an IB program perceive significantly more stress than a sample of 168 of their general education peers, and that specific coping styles are differentially related to mental health outcomes in this subgroup of high‐achieving high school students. Furthermore, coping styles (specifically, anger and positive appraisal) moderate the influence of stress on global life satisfaction and internalizing symptoms of psychopathology. © 2008 Wiley Periodicals, Inc.     

Adaptability,engagement and academic achievement at university

University entry is a time of great change for students. The extent to which students are able to effectively navigate such change likely has an impact on their success in university. In the current study, we examined this by way of adaptability, the extent to which students’ adaptability is associated with their behavioural engagement at university, and the extent to which both are associated with subsequent academic achievement. A conceptual model reflecting this pattern of predicted relations was developed and tested using structural equation modelling. First-year undergraduate students (N = 186) were surveyed for their adaptability and behavioural engagement at the beginning of their first year. Following this, students’ academic achievement was obtained from university records at the end of Semester 1 and 2 of first-year university. Findings showed that adaptability was associated with greater positive behavioural engagement (persistence, planning, and task management) and lower negative behavioural engagement (disengagement and self-handicapping). Moreover, negative behavioural engagement was found to inversely predict academic achievement in Semester 1, which predicted academic achievement in Semester 2. The educational implications of the findings are discussed.     

Questionnaire on Perceived Competency-based Learning for primary school students (#ICOMpri1) / Cuestionario del Aprendizaje Percibido basado en Competencias para el Alumnado de Educación Primaria (#ICOMPri1)

The purpose of this study was to design and validate an assessment tool to find out how primary school students perceive their competency-based learning. By examining the content validity (n = 35 experts), comprehension (n = 173 students) and construct (n = 523 students) of the instrument, the results showed correct psychometric quality, internal consistency, reliability and adequacy of the structural model: χ²/df = 2.08, TLI = 0.88, CFI = 0.90, GFI = 0.90, RMSEA = 0.04, and SRMR = 0.04. The final version of the Questionnaire on Perceived Competency-based Learning of primary school students (#ICOMpri1) includes eight dimensions and 27 items. The results showed a high perceived competency-based learning of primary school students. This is therefore a valid and reliable instrument that provides a more subjective and real vision of primary students’ academic performance. Nevertheless, future studies should analyse the criterion-related validity by comparing perception results with those of international academic achievement.     

Academic success and early career outcomes: Can honors alumni be distinguished from non-honors alumni?

This study compared Dutch alumni who previously participated in an honors program (n = 72) to non-honors alumni who entered university as high-achieving high school students (n = 72) with regard to (1) final university grade point average (GPA) and (2) early career outcomes. Final grades were drawn from university files. Using an online questionnaire, participants were asked to rate themselves on work engagement and other characteristics in their current jobs. Results indicate that, compared to the non-honors control group, honors alumni had a higher study GPA at the end of their studies and higher work engagement after graduation, while job characteristics were found to be similar. Implications for educators and job recruiters are discussed.     

Preparing Students for College and Career in the United States: the Effects of Career-Themed Programs of Study on High School Performance

In the United States, education policy calls for every student to graduate from high school prepared for college and a career. National legislation has mandated programs of study (POS), which offer aligned course sequences spanning secondary and postsecondary education, blending standards-based academic and career and technical education (CTE) content and often including work-based learning opportunities. This study examined the effects of these career-themed POS on high school achievement outcomes in the United States. We used structural equations and an instrumental variable approach to test the effects of POS enrollment and participation in CTE course sequences on GPA and graduation. Results indicated that POS enrollment improved students’ probability of graduation by 11.3 % and that each additional CTE credit earned in POS increased their probability of graduation by 4 %. There were non-significant effects for high school GPA. These findings suggest that POS benefited students in terms of retention at no cost to their achievement.     

Self-regulation and academic achievement and resilience: A longitudinal study

There is a growing body of research indicating that students who can self-regulate cognitive, motivational, and behavioral aspects of their academic functioning are more effective as learners. We studied relations between the self-regulation strategies used by a group of Italian students during the final years of high school and their subsequent academic achievement and resilience in pursuing higher education. We used the self-regulated learning interview schedule, which focuses on cognitive, motivational, and behavioral strategies used during academic learning in both classroom and non-classroom contexts. The cognitive self-regulation strategy of organizing and transforming proved to be a significant predictor of the students’ course grades in Italian, mathematics, and technical subjects in high school and in their subsequent average course grades and examinations passed at the university. The motivational self-regulation strategy of self-consequences was a significant predictor of the students’ high school diploma grades and their intention to continue with their education after high school.     

Adjusting the Cumulative GPA Using Item Response Theory

In college admissions, the predictive validity of preadmissions measures such as standardized test scores and high school grades is of wide interest. These measures are most often validated against the criterion of the first-year grade point average (GPA). However, neither the first-year GPA nor the four-year cumulative GPA is an adequate indicator of academic performance through four years of college. In this study, Item Response Theory (IRT) is used to develop a more reliable measure of performance, called an IRT-based GPA, which is used to estimate the validity of traditional preadmissions information. The data are preadmissions information and course grades for the Class of 1986 at Stanford University (N = 1564). Principal factor analysis is used as a precursor to determine the dimensionality of the course data and to partition courses into approximately unidimensional subsets, each of which is scaled independently. Results show a substantial increase in predictability when the IRT-based GPA is used instead of the usual GPA.     

The impact of student academic achievement on graduate salaries: the case of a leading Russian university

This paper analyses the impact of academic achievement on future salaries by looking into the grade point average (GPA)-earnings relationship for graduates of a leading Russian university. The study is based on pooled cross-sectional graduate survey data for 2014–2015. The issue of how student academic achievement impacts future labour market rewards is analysed through academic, demographic and labour market factors. We found that there is a significant positive impact of GPA on salaries of BA graduates (9–12% wage premium for an additional GPA point) and an insignificant or negative impact for MA programmes graduates. The study depicts that this negative effect can be partially explained by employment sector-specific variables. Among the main factors which positively affect earnings of graduates is work experience. Graduates who combined study and work achieve a 30% wage premium. However, there is no evidence that combining study and work affects student academic achievement, even for those who combined studies with full-time job. Despite the higher GPA of female students, male graduates’ earnings are 18% higher. Gender wage differences can be explained by gender distribution by the sector of employment: the over-representation of women in the low-paid education and science sectors and their under-representation in entrepreneurship and corporate sector.     

The Impact of Centralized Advising on First-Year Academic Performance and Second-Year Enrollment Behavior

To enhance student success, many colleges and universities have expanded academic support services and programmatic interventions. One popular measure that has been recognized as critical to student success is academic advising. Many institutions have expanded advising by creating centralized units staffed with professional advisors who serve specific student groups. In this study, I used propensity score matching to estimate the impact of using centralized academic advising at a large metropolitan public research university on undergraduate students’ first-year GPA and second-year enrollment behavior. Using a cohort of 2,745 first-time full-time freshmen who matriculated in fall 2010, I matched students who used centralized advising with those who used no advising, over the course of two semesters. I then fit an OLS regression model to examine the impact of centralized advising on first-year GPA and a Zero Inflated Negative Binomial model to examine its impact on students’ enrollment behavior in the second year. I used these parametric results to simulate average treatment effects. Results indicated that students who used centralized academic instead of no advising experienced an increase in their first-term GPA, second-term GPA, and first-year cumulative GPA. Also, students who used centralized advising during the second term experienced a decrease in their probability of first-year attrition.     

STEM‐focused high schools as a strategy for enhancing readiness for postsecondary STEM programs

The logic underlying inclusive STEM high schools (ISHSs) posits that requiring all students to take advanced college preparatory STEM courses while providing student‐centered, reform‐oriented instruction, ample student supports, and real‐world STEM experiences and role models will prepare and inspire students admitted on the basis of STEM interest rather than prior achievement for postsecondary STEM. This study tests that logic model by comparing the high school experiences and achievement of students in ISHSs and comparison schools in North Carolina. After identifying ISHS and non‐STEM comparison high schools serving students who were similar in terms of socioeconomic status and academic achievement prior to high school entry, we employed propensity‐score weighting and HLM modeling to estimate the impact of attending an ISHS on a set of outcome measures obtained from student surveys and from the state's longitudinal student data system. Analyses of student survey data found that attending an ISHS raises the likelihood that a student will complete pre‐calculus or calculus and chemistry in high school, leads to increased involvement in STEM extracurricular and out‐of‐class activities, and enhances interest in science careers and aspirations to earn a master's or higher degree. Analyses of student outcome data from state administrative records revealed a positive impact of inclusive STEM high school attendance on grade point average (GPA) but not on ACT scores. © 2016 The Authors. Journal of Research in Science Teaching Published by Wiley Periodicals, Inc. J Res Sci Teach 53: 709–736, 2016

     

Beyond English language proficiency scores: understanding the academic performance of international undergraduate students during the first year of study

ABSTRACT

Past research into the relationship between English proficiency test (EPT) scores and score profiles, such as the IELTS and the TOEFL, has shown that there is not always a clear relationship between those scores and students’ subsequent academic achievement. Information about students’ academic self-concept (ASC) may provide additional information that helps predict future academic success. Research has consistently shown a positive relationship between students’ ASC and subsequent academic achievement and educational attainment in both school and higher education settings. The purpose of the current study was to examine the relationship between the academic performance of international students and their language proficiency and academic self-concept as well as other characteristics related to academic success. The study focused on first year international students in undergraduate business programs at an English-medium university in Canada. The following information was collected about the student participants: grades in degree program courses, annual GPA, and EPT scores (including subscores). In addition, students completed an academic self-concept scale. To obtain additional information about success in first-year business courses, instructors in two required courses were interviewed about the academic and language requirements in their courses and the profile of successful students. Correlations between the students’ course grades, GPA, EPT scores, and ASC score were calculated. The instructor interviews were analyzed using a content analysis procedure. The findings from all data sources were triangulated and show that language ability, ASC, and other factors impact academic success during the first year in a business program. The implications of these findings are discussed.     

Academic achievement in first-year university: who maintains their high school average?

The present study investigates the characteristics which differentiate between first-year university students who maintain their high school averages (Maintainers: n = 165) and those whose averages decrease at least one letter grade (Decliners: n = 435). The 600 students entered first year at one of six Canadian Universities, which varied in size and ethnic diversity. Data were collected in August, prior to the start of school, and in November of first year. Multivariate analyses indicated significant group differences between Maintainers and Decliners on familial variables (gender, fathers’ education level, but not family income, parental reciprocity, parental support or immigrant/generational status), psychological well-being (perceived stress in August and November, and November depression, self-esteem and health), and university adjustment (university plans, transition perception, time management and university adaptation). The current study addresses a gap in the existing academic achievement literature, while providing practical information to students, parents, and educators involved in the transition to university.     

The performance of minority students beyond the freshman year: Testing a “late-bloomer” hypothesis in one state university setting

This study examines the validity of standard admissions variables for predicting the long-term performance of minority and nonminority students in one state university. Special attention is given to what may be termed a late-bloomer hypothesis, according to which minority students may be expected to show relatively greater improvement in performance following the freshman year than their nonminority classmates. This hypothesis derives from the plausible argument that minority students face unique problems of adjustment to college which adversely affect their first-year but not their long-term performance. The predictive validity of admissions variables was found to be higher for minority than for nonminority students regardless of the criterion under consideration, and somewhat higher for longer-term cumulative GPA than for shorter-term GPA. Minority and nonminority students were more sharply differentiated by overall cumulative undergraduate GPA than by first-year GPA, inconsistent with the late-bloomer hypothesis.     

Achievement Outcomes Among High School Graduates in College and Career Readiness Programs of Study

This study investigated the relationships between completing the high school portion of a college- and career-preparatory program of study and high school achievement outcomes in a large urban district in the West. Programs of study are secondary-to-postsecondary educational programs mandated by the federal legislation (Perkins IV) governing career and technical education (CTE) in the United States. At graduation, 49.5% of students in the sample who began a program of study had completed their programs. Using multiple regression models, we compared graduates who completed a program of study (hereafter POS completers) to graduates who completed a number of CTE courses in a specific occupational area (CTE concentrators), and to graduates who may have taken a CTE course or two during high school but were neither POS completers nor CTE concentrators (All Others). POS completers were more likely to (a) have a higher overall GPA, (b) have a higher CTE GPA, and (c) earn more STEM (science, technology, engineering, and mathematics) credits than All Other students. Compared with CTE concentrators, POS completers were more likely to (a) have a higher overall GPA and (b) earn more STEM credits. Qualitative data describe contextual elements of programs of study as offered in West District that could explain these results. Study results suggest that districts should consider implementing career-themed programs such as programs of study that enhance their existing college- and career-readiness initiatives. We also call for further study of the postsecondary and labor market outcomes associated with programs of study in order to generate a clearer picture of their potential to increase academic and technical achievement and promote successful student transitions to higher education and the workplace.     

Personality traits as a predictor of academic achievement in adolescents

The study examined the predictive value of adolescents’ personality trait ratings by different groups of informants in explaining academic achievement [grade point average (GPA)] while controlling for students’ sex and their mothers’ education. The Inventory of Child/Adolescent Individual Differences was employed as a measure of students’ personality traits at the end of elementary schooling (mean age = 14.7 years) and two years later when the participants attended secondary schools. The trait ratings were obtained through self‐, maternal and peer reports at both measurement occasions. They explained substantial portions of unique variance in the students’ GPA concurrently, and over time. Ratings by each of the three groups of informants had an incremental validity over one another in predicting school grades. Among personality variables, conscientiousness and low extraversion were consistently predictive of GPA.     

A longitudinal examination of students’ health behaviours during their first year at university

During the transition from school to higher education, young adults experience a substantial amount of change where they progress from the highly controlled setting of school to the autonomous and self-motivated environment of university. Time spent at university is considered a critical period during which young adults establish a clear sense of identity, which can include forming positive health behaviours such as regular physical activity. The transition from school to university also involves a number of changes that can impact on the mental well-being of students including financial concerns, academic pressures and a lack of social support. Our aim was to longitudinally examine the physical activity levels and mental well-being of Scottish students during their first year at university. Participants were 48 first-year students (males, n = 24; females, n = 24) aged 18–19 years enrolled at two Scottish universities in the UK. At entry to university (semester 1) participants completed a validated self-report measure of physical activity and measures of anxiety and depression. Participants’ physical activity levels were assessed for seven days via accelerometry. Participants completed the same measures six months later (semester 2). Daily moderate physical activity levels decreased across the semesters yet perceptions of mental well-being remained stable. There was a significant increase in hip and waist circumferences across the semesters. The first year of university is a critical period for establishing positive health behaviours and there is a need for universities to actively encourage physical activity as an integral part of university life.