The Findings of the 9‐13 Middle School Survey: a local authority view

This paper presents an illustration of how the regression‐discontinuity design can be used to obtain an unbiased estimate of the causal effect of participating in a university remedial English program on first‐year grade point average. First‐year grade point averages were collected for 197 first‐time, full‐time university students, along with the scores they received on an English placement examination, and a measure of remedial program assignment. Regression discontinuities indicate that first‐year grade point averages were approximately 0.392 points higher for students who participated in a remedial English program as compared to equivalent students who did not participate in the remedial program. We also present various threats to validity and limitations of the regression‐discontinuity design.     

PERFORMANCE IN COLLEGE-LEVEL COURSES AMONG STUDENTS CONCURRENTLY ENROLLED IN REMEDIAL COURSES: POLICY IMPLICATIONS

Community colleges utilize open-door admission policies to provide educational opportunities for all students, including those who are academically under-prepared in one or more areas. Current approaches to assisting under-prepared students include the targeted delivery of remedial courses in math, English, and reading. This approach typically relies on the use of standardized placement tests to determine whether students have remedial needs. Based on those placement test scores, students may have a remedial need in only one of the core academic areas (e.g., math, English, or reading). In such cases, students may concurrently enroll in required remedial courses and college-level courses unrelated to the area in which they are considered to be academically under-prepared. The research reported in this article evaluated the assumption that a student's under-preparedness is limited to a specific area by assessing the college-level performance of students concurrently enrolled in remedial and college-level courses. The results show that college-level pass rates are much lower among students concurrently enrolled in remedial courses who do not successfully complete one or more of these remedial courses. These students under-perform irrespective of the type of college-level course. In contrast, students who pass their remedial courses are generally successful in their college-level courses. Policy implications in regard to developmental education are discussed.     

Using State Assessments for Predicting Student Success in Dual‐Enrollment College Classes

Scores on state standards‐based assessments are readily available and may be an appropriate alternative to traditional placement tests for assigning or accepting students into particular courses. Many community colleges do not require test scores for admissions purposes but do require some kind of placement scores for first‐year English and math courses. In this study, we examine the efficacy of using the reading and math portions of the Kansas State Assessment (KSA) for predicting the success of high school students taking College Algebra and College English I at a Kansas community college. Results showed that in this sample KSA scores predicted as well or better than more traditional placement tests and with no extra cost to the institution.     

Offshore and onsite placement testing for English pathway programmes

English language programmes provide established pathways for international students seeking university admission in countries such as Australia and the United Kingdom. In order to refer international applicants to appropriate levels and durations of English language support prior to matriculation into their main course of study, pathway providers need effective and efficient language assessment tools. This report evaluates the effectiveness of an online vocabulary knowledge test as an index of English proficiency for university English pathway programme applicants (N = 177). The Timed Yes/No (TYN) test measures vocabulary recognition size and speed in a time- and resource-effective format. Test results were correlated with performance on a comprehensive placement test consisting of speaking, writing, reading and listening components. The predictive validity of word recognition accuracy (a proxy for size) and response time (a measure of efficiency) for placement test outcomes were examined independently and in combination. The TYN test scores’ sensitivity at predicting comprehensive placement test scores were assessed using a cut-score analysis resulting in an identification accuracy rate ranging from 76 to 86% for five critical band scores. The potential use of the online vocabulary-screening test for measuring international students’ English language proficiency is discussed in terms of reliability, validity, speed, usability and cost-effectiveness in onsite and offshore testing conditions.     

Do secondary school-leaving English examination results predict university students’ academic writing performance? A latent profile analysis

Abstract

Secondary school-leaving English examination results are often regarded as indicators of students’ competence to study in English-medium universities, which is usually demonstrated through source-based academic writing. In English as a second or foreign language (ESL/EFL) contexts, many English-medium universities require local undergraduates to enrol in an academic writing course, unless they received outstanding English results in secondary school-leaving examinations. This study investigates the relationship between ESL undergraduates’ secondary school-leaving English examination results and their academic writing performance through latent profile analysis. Results show that students can be grouped into four classes of academic writing performer (AWP), namely Complex-AWP, High-AWP, Medium-AWP and Low-AWP. Surprisingly, the Complex-AWP group had the highest means in structure, argument and language, but the lowest in citation. Secondary school-leaving English examination results can generally predict students’ class membership in language, argumentation and, to some extent, structure, but not citation. An important implication is that students with high English proficiency do not necessarily do well in all aspects of academic writing. This study can inform university senior management on how to set policies about who needs an academic writing course and provide appropriate training in various aspects of academic writing for university students with diverse English proficiency.     

Reading,Writing, and English Course Pathways when Developmental Education is Optional: Course Enrollment and Success for Underprepared First-time-in-College Students

Academic underpreparedness is an issue for many first-time-in-college students, particularly those entering community colleges. Whereas many underprepared students enroll in developmental education, research has indicated that traditional remediation may not increase students’ chances for success. Therefore, states and colleges have begun to implement new course placement strategies to increase the accuracy of initial course placement and new instructional approaches to better serve their developmental students. Specifically, in 2013, the state of Florida passed Senate Bill 1720 which redesigned developmental coursework and placement policies across the Florida College System. The reform lifted developmental education placement exam testing and course enrollment requirements for certain exempt students, irrespective of prior academic preparation or achievement. The current study focuses on these exempt students—those who had the option to bypass developmental education—who were also underprepared, and their initial course selection and subsequent success in their gateway (introductory college-level) English course. Using statewide student-level data and logistic regression techniques, the results indicated that level of preparation was related to students’ course enrollment and gateway English course success. Students slightly underprepared in reading or writing were more likely than severely underprepared students to enroll in the gateway English class, relative to a developmental reading or writing course. In reading and writing, slightly underprepared students were more likely to pass English, relative to severely underprepared students. The authors consider the findings in light of recent national changes to developmental education and offer recommendations for policy and practice.     

Achievement and Attitudinal Differences among Students in Regular,Remedial, and Advanced Classes

The collection of data by the National Center for Educational Statistics for the High School and Beyond study offered an opportunity to examine differences in achievement and attitudinal measures among students in regular, remedial, and advanced classes. Groups of low achieving and high achieving sophomores and seniors were identified on the basis of overall grades. Comparisons were made between students in regular and ability-grouped English and mathematics classes. The data were consistent with views that grouping leads to improved achievement and attitude toward subject matter for students in regular and remedial classes. The data were not consistent with a view that remedial group placement leads to poor self-concept or attitude toward school.     

Beyond English language proficiency scores: understanding the academic performance of international undergraduate students during the first year of study

ABSTRACT

Past research into the relationship between English proficiency test (EPT) scores and score profiles, such as the IELTS and the TOEFL, has shown that there is not always a clear relationship between those scores and students’ subsequent academic achievement. Information about students’ academic self-concept (ASC) may provide additional information that helps predict future academic success. Research has consistently shown a positive relationship between students’ ASC and subsequent academic achievement and educational attainment in both school and higher education settings. The purpose of the current study was to examine the relationship between the academic performance of international students and their language proficiency and academic self-concept as well as other characteristics related to academic success. The study focused on first year international students in undergraduate business programs at an English-medium university in Canada. The following information was collected about the student participants: grades in degree program courses, annual GPA, and EPT scores (including subscores). In addition, students completed an academic self-concept scale. To obtain additional information about success in first-year business courses, instructors in two required courses were interviewed about the academic and language requirements in their courses and the profile of successful students. Correlations between the students’ course grades, GPA, EPT scores, and ASC score were calculated. The instructor interviews were analyzed using a content analysis procedure. The findings from all data sources were triangulated and show that language ability, ASC, and other factors impact academic success during the first year in a business program. The implications of these findings are discussed.     

突破科类制约的高考平行志愿投档模型构建探析

新一轮高考综合改革提出探索综合评价录取机制的要求,但是在基于科类限制的总分投档录取模式下较难实现。为落实高校招生综合评价录取改革目标,必须突破科类制约,建立新的平行志愿投档模式。以云南省艺术类招生多科类兼报的实践为基础,构建优先队列平行志愿投档模型。该模型突破科类制约和总分束缚,遵循群体分数优先和个人志愿优先的投档原则,高校可自由设定考生成绩项要求和不同科目的权重要求,有利于增加学生选择权和高校招生自主权。     

Evaluating deaf students' readiness to meet the English language and literacy demands of postsecondary educational programs

The purpose of this study was to investigate alternative methods for evaluating deaf students' readiness to meet the English language and literacy demands of postsecondary educational programs. In the first part of the study, scores obtained by a large sample of deaf students on the ACT Assessment (ACT Composite score and scores on the ACT English and Reading tests) were compared to their scores on various measures of English language and literacy skills. In the second part of the study, the performance of a smaller sample of deaf students on the ESL Reading and ESL Grammar/Usage components of COMPASS/ESL was compared to their performance on a set of concurrent measures of English skills. The results of this investigation demonstrate that neither the ACT Assessment nor COMPASS/ESL are appropriate for the full range of deaf students seeking admission to postsecondary educational programs. However, the ACT Assessment is appropriate for deaf students seeking admission to transferable (BS and AAS) degree programs, and the ESL Reading and Grammar/Usage tests appear to be appropriate for deaf students seeking admission to nontransferable (AOS) degree programs. Taken together, the combination of the ACT Assessment and COMPASS/ESL appear able to provide a valid, reliable, and coherent approach to admissions screening assessment for the full range of deaf students seeking admission to postsecondary programs.     

Relative Effects of English Proficiency on General Admissions Tests Versus Subject Tests

The increasing linguistic diversity of the United States student population has brought to the forefront problems in the interpretation of test scores for non-native speakers of English in graduate admissions. The degree to which test scores reflect English proficiency was studied using data on N = 451 students whose native language was Spanish. They had taken the GRE, English proficiency tests, and the PAEG, a test in Spanish used for admission to graduate schools in Puerto Rico. Regression analyses revealed that the proportion of variance explained by the English proficiency terms (independent of developed skills measured in Spanish) was highest for the GRE verbal test (34%), lowest for the quantitative test (8%) and intermediate for the analytical test (16%), the Psychology (18%) and Biology (17%) Subject tests. These findings are discussed in light of efforts to increase access to higher education for Hispanic students.     

Psychodidactic approach in the development of language competences in university students within blended learning

Abstract

The paper discusses the deployment of cognitive and affective components for teaching languages in a blended learning university setting. A modified expectancy model of motivation was designed and applied. The usability testing of a language education website was used as a framework with affective and cognitive features. The selection of the education website was based on findings gained from the language needs analysis. The level of students’ language competence representing the cognitive component was diagnosed based on their results in the placement tests in the DIALANG language website. Many students showed progress in language knowledge by the end of the semester. Results were higher than students had expected and enough to encourage further research. The affective part is discussed in the modified expectancy model of motivation that was designed and applied. The psychodidactic approach used in the research met students’ motivational and emotional needs without sacrificing their improved competence in language development.     

Intervention Provided to Linguistically Diverse Middle School Students with Severe Reading Difficulties

This study investigated the effectiveness of a multicomponent reading intervention implemented with middle school students with severe reading difficulties, all of whom had received remedial and/or special education for several years with minimal response to intervention. Participants were 38 students in grades 6-8 who had severe deficits in word reading, reading fluency, and reading comprehension. Most were Spanish-speaking English language learners (ELLs) with identified disabilities. Nearly all demonstrated severely limited oral vocabularies in English and, for ELLs, in both English and Spanish. Students were randomly assigned to receive the research intervention (n = 20) or typical instruction provided in their school's remedial reading or special education classes (n = 18). Students in the treatment group received daily explicit and systematic small-group intervention for 40 minutes over 13 weeks, consisting of a modified version of a phonics-based remedial program augmented with English as a Second Language practices and instruction in vocabulary, fluency, and comprehension strategies. Results indicated that treatment students did not demonstrate significantly higher outcomes in word recognition, comprehension, or fluency than students who received the school's typical instruction and that neither group demonstrated significant growth over the course of the study. Significant correlations were found between scores on teachers' ratings of students' social skills and problem behaviors and posttest decoding and spelling scores, and between English oral vocabulary scores and scores in word identification and comprehension. The researchers hypothesize that middle school students with the most severe reading difficulties, particularly those who are ELLs and those with limited oral vocabularies, may require intervention of considerably greater intensity than that provided in this study. Further research directly addressing features of effective remediation for these students is needed.     

Assessing the Effectiveness of Remedial College Courses

Randomly selected students required to take a remedial English course at a community college were placed in a regular English course on an experimental basis. The experimentally placed students were compared with those who enrolled in a regular course after passing a remedial course and with those who did not require remediation. Comparisons were made on ability, persistence, performance, and satisfaction. The remedial course had no effect on student satisfaction and persistence but a modest effect on subsequent course performance. The experimental methodology described can provide the college researcher with a basis for determining whether there is a need to revise or eliminate current remedial courses.     

Chinese Women's Culture: From Tradition to Modernization

At the National Conference on the Work of College and University Admissions convened in Zhengzhou in early March of this year, the State Education Commission proposed that, in order to deepen the reforms of college and university tuition requirements, college and university admissions, and job placement for college and university graduates, those colleges and universities that have a feasible plan of action may, with approval, carry out reform spot experimentations. It also proposed that those colleges and universities carrying out these spot experiments will, when admitting students this year, no longer lower the enrollment qualification scores for students who are paying their own tuition and students who are being entrusted for education by enterprises or government units; instead, all students admitted by these colleges and universities will be expected to remit a certain amount of tuition for their education. At the same time, the colleges and universities must, by setting up scholarships for superior students, special-item scholarships, and student loans, further deepen the reform of the system of job placement for graduates. This is what is meant by what is commonly referred to as the joining the tracks between "publicly funded students" and "self-funded students."     

Cooperative Chemistry Tests

Abstract

In spite of the abundance of research reports in the field of instructor and course evaluation by students, the application of major theoretical psychological and sociological orientations to this field has been virtually ignored. This paper adopts the Ohio State University approach to leadership theory as an analytical tool for comprehending students’ ratings. Two main determinants of instructors’ scores are their instrumental contribution to the achievement of their classes’ goals and their success in enhancing their students’ interests. These two variables are claimed to resemble Initiating Structure and Consideration (14). The identification of leadership-bound components in faculty evaluation lends powerful theoretical integrity to the presently nontheoretical research of students’ evaluations. This paper expands such an approach which was developed at the Ben Gurion University of the Negev, Beer Sheva, Israel, and tests its applicability to another university, the University of Hawaii.     

Adapting Levels 1 and 2 of Kirkpatrick’s model of training evaluation to examine the effectiveness of a tertiary-level writing course

This study adapts Levels 1 and 2 of Kirkpatrick’s model of training evaluation to evaluate learning outcomes of an English as a second language (ESL) paragraph writing course offered by a major Asian university. The study uses a combination of surveys and writing tests administered at the beginning and end of the course. The survey evaluated changes in students’ perception of their skills, attitude, and knowledge (SAK), and the writing tests measured their writing ability. Rasch measurement was applied to examine the psychometric validity of the instruments. The measured abilities were successively subjected to path modeling to evaluate Levels 1 and 2 of the model. The students reported that the module was enjoyable and useful. In addition, their self-perceived level of skills and knowledge developed across time alongside their writing scores but their attitude remained unchanged. Limitations of Kirkpatrick’s model as well as lack of solid frameworks for evaluating educational effectiveness in applied linguistics are discussed.     

Teacher expectations in a university setting: the perspectives of teachers

ABSTRACT

This study was designed to investigate the bases of teacher expectations in higher education. The first author interviewed 20 university teachers from an English-as-a-foreign-language course, exploring their expectations for the first-year undergraduates in their classes. The grounded theory method was adopted to analyse the data that had been collected. The results showed that for this sample of 20 teachers, student characteristics were important contributing factors to their expectations in the teachers’ university settings. The factors the teachers considered important included students’ (a) prior academic achievement, (b) motivation, (c) study skills, and (d) academic discipline. Also, teacher characteristics were found to be another major source of these university teachers’ expectations, including teachers’ (a) past teaching and learning experience and (b) teaching self-efficacy. The findings suggested that the bases of teacher expectations in higher education may differ from those at the elementary or secondary school level.     

Academic Outcomes Among a Sample of Learning Support Community College Students

This research examined the relationship between placement in a learning support college program and subsequent academic outcomes. The sample consisted of 275 entering freshmen students who were enrolled in the Learning Support reading courses in the fall of 2005. Data were collected from the Gordon College Office of Institutional Research. The data showed that of the 275 students who enrolled in a Learning Support reading course in the fall 2005 semester, 189 returned for the spring 2006 semester. Data also showed that 58% of the 275 students enrolled in Learning Support reading during fall 2005 successfully completed a basic reading intensive course upon completion of their remedial reading class. One hundred eighty seven students who had previously completed Learning Support reading enrolled (spring 2006 or later) in Introductory English 101 and 121 passed. Fifty-five students who had completed Learning Support reading enrolled (spring 2006 or later) in History 1121, Western Civilization, and 20 students passed. Six of the 205 students who completed Learning Support reading graduated Gordon College within a three-year period. The results of the present study indicate that the Learning Support Reading Program in place at Gordon College has proven to be a beneficial tool for at-risk college students. It is assumed that programs such as the Learning Support Program described here may help students build a foundation that will aid them throughout their college career.