Accommodations and flags: Admissions testing and the Rights of Individuals With Disabilities

As the number of students with disabilities applying for admission and enrolling in educational institutions continues to increase, educators and measurement experts face the challenge of determining whether and how to offer accommodations in admissions tests and how to report and utilize the results of modified tests. This article discusses the provision of accommodations in admissions testing and in educational programs, the test score flagging practices that impact admissions testing, validity concerns, and issues surrounding fairness and compliance with the federal disability laws for such practices. It offers some conclusions about the legality of the use of flagged test scores, as well as a call for further research concerning testing and evaluating students with disabilities.     

The validity and comparability of entrance examination scores after accommodations are made for students with LD

Every year, thousands of college and university applicants with learning disabilities (LD) present scores from standardized examinations as part of the admissions process for postsecondary education. Many of these scores are from tests administered with nonstandard procedures due to the examinees' learning disabilities. Using a sample of college students with LD and a control sample, this study investigated the criterion validity and comparability of scores on the Miller Analogies Test when accommodations for the examinees with LD were in place. Scores for examinees with LD from test administrations with accommodations were similar to those of examinees without LD on standard administrations, but less well associated with grade point averages. The results of this study provide evidence that although scores for examinees with LD from nonstandard test administrations are comparable to scores for examinees without LD, they have less criterion validity and are less meaningful for their intended purpose.     

Entrance test accommodations,admission and enrollment of students with learning disabilities in teacher training colleges in Israel

The ‘Saf’ (threshold) exam is the entry exam taken by approximately 40% of the students enrolled in teacher training colleges in Israel. Students with learning disabilities may apply and be granted testing accommodations on this exam. This study examines the percentage of students with testing accommodations among the testees and those who began their studies in 2003. Their test and subtest scores were compared to those of students without accommodations as were grades on high school matriculation exams. Characteristics such as gender, age, difficulties as reported in assessments and assessment history were examined. Enrollment patterns in the various colleges departments were noted. Satisfaction with the testing accommodations process was looked at as well. Ramifications and recommendations are discussed vis a vis future research needed and policies regarding the admission of students with learning disabilities to institutions of higher learning.     

Differential Item Functioning Analysis for Accommodated Versus Nonaccommodated Students

The No Child Left Behind act resulted in an increased reliance on large-scale standardized tests to assess the progress of individual students as well as schools. In addition, emphasis was placed on including all students in the testing programs as well as those with disabilities. As a result, the role of testing accommodations has become more central in discussions about test fairness and accessibility as well as evidence of validity. This study seeks to examine whether there exists differential item functioning for math and language items between special education examinees receiving accommodations and those not receiving accommodations.     

Digital Module 31: Testing Accommodations for Students with Disabilities

Students with disabilities often take tests under different conditions than their peers do. Testing accommodations, which involve changes to test administration that maintain test content, include extending time limits, presenting written text through auditory means, and taking a test in a private room with fewer distractions. For some students with disabilities, accommodations such as these are necessary for fair assessment; without accommodations, invalid interpretations would be made on the basis of these students’ scores. However, when misapplied, accommodations can also diminish fairness, introduce new sources of construct-irrelevant variance, and also lead to invalid interpretation of test scores. This module provides a psychometric framework for thinking about accommodations, and then explicates an accommodations decision-making framework that includes a variety of considerations. Problems with current accommodations practices are discussed, along with potential solutions and future directions. The module is accompanied by exercises allowing participants to apply their understanding.     

Are separate room test accommodations effective for college students with disabilities?

Abstract

College students with attention-deficit/hyperactivity disorder (ADHD) and/or learning disabilities are frequently allowed to complete examinations in a separate, distraction-reduced setting. Although separate room test accommodations are believed to provide students with equal access to testing and thereby improve performance, little experimental research has examined their effects on actual test scores. We randomly assigned college students to complete a high-stakes Spanish language placement examination in either a group or separate room setting. Then, we categorized students based on their (1) disability status, (2) history of test accommodations, and (3) self-reported history of test anxiety. Results showed a significant setting x disability status interaction. Contrary to expectations, all students performed equally well in the group setting, but students with disabilities earned significantly lower scores than their classmates without disabilities when tested in a separate room. Similar results were found when we restricted our analyses to students with a history of test accommodations. Separate room testing had no effect on the scores of students with test anxiety. Altogether, our findings suggest that separate room testing does not mitigate the effects of ADHD, learning disabilities, and/or test anxiety on performance and, in some cases, may actually lower test scores.     

Evaluating Comparability in Computerized Adaptive Testing: Issues, Criteria and an Example

When a computerized adaptive testing (CAT) version of a test co-exists with its paper-and-pencil (P&P) version, it is important for scores from the CAT version to be comparable to scores from its P&P version. The CAT version may require multiple item pools for test security reasons, and CAT scores based on alternate pools also need to be comparable to each other. In this paper, we review research literature on CAT comparability issues and synthesize issues specific to these two settings. A framework of criteria for evaluating comparability was developed that contains the following three categories of criteria: validity criterion, psychometric property/reliability criterion, and statistical assumption/test administration condition criterion. Methods for evaluating comparability under these criteria as well as various algorithms for improving comparability are described and discussed. Focusing on the psychometric property/reliability criterion, an example using an item pool of ACT Assessment Mathematics items is provided to demonstrate a process for developing comparable CAT versions and for evaluating comparability. This example illustrates how simulations can be used to improve comparability at the early stages of the development of a CAT. The effects of different specifications of practical constraints, such as content balancing and item exposure rate control, and the effects of using alternate item pools are examined. One interesting finding from this study is that a large part of incomparability may be due to the change from number-correct score-based scoring to IRT ability estimation-based scoring. In addition, changes in components of a CAT, such as exposure rate control, content balancing, test length, and item pool size were found to result in different levels of comparability in test scores.     

Students with learning disabilities in the university environment: a study of faculty and student perceptions.

This study examines faculty and student perceptions regarding university students with learning disabilities, sensitivity to such students' special needs, accommodations, and the perceived impact of a learning disability. Results reveal a general sensitivity to the special needs of students with learning disabilities; however, group differences suggest several areas warranting further attention.     

Podcasts on Mobile Devices as a Read-Aloud Testing Accommodation in Middle School Science Assessment

The purpose of this study was to examine the effect of a digitized podcast to deliver read-aloud testing accommodations on mobile devices to students with disabilities and reading difficulties. The total sample for this study included 47 middle school students with reading difficulties. Of the 47 students, 16 were identified as students with disabilities who received special education services. Participants were randomly assigned to three experimental testing conditions, standard administration, teacher-controlled read-aloud in traditional group delivery format, and student-controlled read-aloud delivered as a podcast and accessed on a mobile device, and given sample end-of-year science assessments. Based on a factorial analysis of variances, with test conditions and student status as the fixed factors, both student groups demonstrated statistically significant gains based on their testing conditions. Results support the use of podcast delivery as a viable alternative to the traditional teacher-delivered read-aloud test accommodation. Conclusions are discussed in the context of universal design for learning testing accommodations for future research and practice.     

Instructors’ willingness to provide instructional accommodations for students with disabilities in selected universities of Ethiopia

The purpose of this study was to examine instructors’ willingness to provide instructional accommodations for students with disabilities in universities. Questionnaire was distributed to a total of 252 instructors from four universities and quantitative data were generated. Then appropriate quantitative methods of data analysis were employed. The results indicated that the majority of instructors participated in this study found to have positive willingness to provide instructional accommodations. Concerning the relationship between instructors’ willingness and background variables, the result revealed that, a statistically significant mean score difference existed between groups of background variables like location of university, age, Special Needs Education course, teaching methodology training, awareness raising training on Inclusive Education and experience in teaching students with disabilities. Finally, using exploratory factor analysis, this study showed that there were four components or factors that represent the underlying constructs of willingness to provide instructional accommodations items.     

The effect of extra time on reading comprehension scores for university students with and without learning disabilities

The purpose of this study was to examine the effects of extra time on the ability of university students with and without learning disabilities to complete a reading comprehension test under timed and extra-time conditions. The participants were 16 students identified as having learning disabilities and 15 normally achieving students, all attending the University of California. The Nelson-Denny Reading Comprehension and Reading Rate Test was used. Percentile ranks were obtained for reading rates on individuals, and for comprehension scores under timed and extra-time conditions. The major findings of this study were that there is a significant difference between scores obtained by students with learning disabilities and by normally achieving students under timed conditions and that there are no significant differences in test performance between students with learning disabilities and normally achieving university students when students with learning disabilities are provided extra time. Normally achieving students did not perform significantly better with extra time.     

‘What can I do to help?’: Postsecondary students with learning disabilities' perceptions of instructors' classroom accommodations

This qualitative research report adopts a critical pedagogy perspective to examine the provision of classroom accommodations for postsecondary students with learning disabilities. Although instructors in the United States are bound to abide by disability rights laws, we also believe instructors can act in ways that allow students to feel comfortable in disclosing their disabilities and in requesting and accessing accommodations for these disabilities. We engaged the voices of 10 university students living with learning disabilities through a series of semi‐structured interviews. These students offered a variety of statements on the ways that their disabilities were accommodated or not by their instructors. We classified these perceptions into three kinds of accommodation perceived by university students with learning disabilities: non‐accommodation, formal accommodation and accommodation for all students. We discuss the implications that these types of accommodations have for pedagogy and offer recommendations for effective techniques for accommodating for all. We hope the voices of these students will serve to enhance communication between students with learning disabilities and their professors.     

Do Proper Accommodation Assignments Make a Difference? Examining the Impact of Improved Decision Making on Scores for English Language Learners

Does it matter if students are appropriately assigned to test accommodations? Using a randomized method, this study found that individual students assigned accommodations keyed to their particular needs were significantly more efficacious for English language learners (ELLs) and that little difference was reported between students receiving incomplete or not recommended accommodations and no accommodations whatsoever. A sample of third and fourth grade ELLs in South Carolina (N = 272) were randomly assigned to various types of test accommodations on a mathematics assessment. Results indicated that those students who received the appropriate test accommodations, as recommended by a version of a computerized accommodation taxonomy for ELLs (the selection taxonomy for English language learners accommodations; STELLA), had significantly higher test scores than ELLs who received no accommodations or those who received incomplete or not recommended accommodation packages. Additionally, students who were given no test accommodations scored no differently than those students that received accommodation packages that were incomplete or not recommended, given the students' particular needs and challenges. These findings are important in light of research and anecdotal reports that suggest a general lack of systematicity in the current system of assigning accommodations and a tendency to give all available accommodations regardless of individual child characteristics. The results also have important implications for how future accommodation research should be structured to determine the benefits of particular accommodations and accommodation packages. This study would suggest that control and treatment groups should be assembled based on specific student needs in order for direct comparisons to be made.     

Faculty willingness to accommodate students with learning disabilities: a comparison among academic divisions

One hundred seven faculty members at a northwestern college responded to a questionnaire devised to assess faculty willingness to provide students with learning disabilities instructional, assignment, examination, and special assistance accommodations. Faculty responses to the questionnaire were analyzed to determine if differences existed among faculty in the colleges of Education, Business, and Arts and Sciences. Results indicate that, in general, faculty were willing to provide students with learning disabilities accommodations, but that differences exist among the three academic divisions as to faculty willingness to provide students accommodations. The implications of these results for colleges and universities and future research are discussed.     

Outreach and support for Australian university students with learning disabilities

Abstract

Although students with learning disabilities (LD) are increasing in Australian universities (Smith, Carroll, & Elkins, 1999), limited data is available about this group and the services available to them. This paper reports the results of a 1996 survey of university outreach, transition and orientation programs to attract potential students with LD and assist them in adjusting to higher education study. The availability of generic and specialist support services and accommodations was also investigated.

Universities promote awareness of disability support services widely in outreach to prospective students and at application and/or enrolment, although students with LD are seldom specifically targeted. Formal programs to assist students from equity groups or students with disabilities to consider tertiary study are most frequently directed at high school students; only one quarter of the universities had outreach programs which might include adults with LD. Most universities offer a comprehensive range of support to students with LD through both generic and disability services. Approaches to the documentation of diagnostic assessment and the establishment of need for accommodation are however variable, and raise issues of equity which are of concern to disability support staff.     

The Impact of Gender,Accommodations, and Disability on the Academic Performance of Canadian University Students with LD and/or ADHD

Academic accommodations for students experiencing disabilities are increasingly available at postsecondary institutions. More studies of the efficacy of accommodations for student success are warranted, however. Given the increased gender gap in university participation, more focus on the unique impact of gender is also needed. Using a sample of students registered with Access and Inclusion Services with learning disabilities (LD), attention-deficit/hyperactivity disorder (ADHD), and combined LD/ADHD at a Canadian undergraduate university (N = 661), we explored the impact of gender on academic performance and accommodation usage. Next, we examined how gender intersected with the impact of academic accommodations on academic performance. Women, on average, demonstrated better academic performance. Academic strategies and assistive technologies were not associated with higher academic performance. However, testing accommodations (extended time and environmental accommodations) were positively associated with academic performance for men with LD or ADHD, but not for the combined group LD/ADHD. For the former two, the more tests accommodated, the higher the academic performance. Furthermore, this gender association was most prominent for students experiencing ADHD. Interpretations and policy recommendations related to these findings are presented.     

Score Comparability of a State Reading Assessment Across Selected Groups of Students With Disabilities

This study investigated the factorial invariance of scores from a 7th-grade state reading assessment across general education students and selected groups of students with disabilities. Confirmatory factor analysis was used to assess the fit of a 2-factor model to each of the 4 groups. In addition to overall fit of this model, 5 levels of constraint, including equal factor loadings, intercepts, error variances, factor variances, and factor covariances, were investigated. Invariance across the factor loadings and intercepts was supported across the groups of students with disabilities and general education students. Invariance for these groups was not supported for the error variances. For the students with mental retardation, the lack of fit of the 2-factor model and the observed score results suggested a mismatch between the difficulty level of this test and the ability level of these students. Although the results generally supported the score comparability of the reading assessment across these groups, further research is needed into the nature of the larger error variances for the student with disabilities groups and into accommodations and modifications for the students with mental retardation.     

Development and validation of a scientific (formal) reasoning test for college students

We present a multiple-choice test, the Montana State University Formal Reasoning Test (FORT), to assess college students' scientific reasoning ability. The test defines scientific reasoning to be equivalent to formal operational reasoning. It contains 20 questions divided evenly among five types of problems: control of variables, hypothesis testing, correlational reasoning, proportional reasoning, and probability. The test development process included the drafting and psychometric analysis of 23 instruments related to formal operational reasoning. These instruments were administered to almost 10,000 students enrolled in introductory science courses at American universities. Questions with high discrimination were identified and assembled into an instrument that was intended to measure the reasoning ability of students across the entire spectrum of abilities in college science courses. We present four types of validity evidence for the FORT. (a) The test has a one-dimensional psychometric structure consistent with its design. (b) Test scores in an introductory biology course had an empirical reliability of 0.82. (c) Student interviews confirmed responses to the FORT were accurate indications of student thinking. (d) A regression analysis of student learning in an introductory biology course showed that scores on the FORT predicted how well students learned one of the most challenging concepts in biology, natural selection.     

Why are Older Faculty Members More Accepting of Students with Attention‐deficit Hyperactivity Disorder? A Life‐course Interpretation

The presence of university students in the United States with disabilities is not a new phenomenon. However, little is known about the attitudes of university faculty concerning less visible disabilities such as attention‐deficit hyperactivity disorder (ADHD). Using a sample of faculty at a university in the United States (n = 136), the impact of age on faculty’s acceptance of ADHD was examined. Results indicated a higher percentage of older faculty members, compared with middle‐aged and younger faculty, selected ADHD as a condition worthy of special instructional accommodations. Irrespective of age of the respondents, ADHD had the lowest acceptance as a condition deserving special accommodations. Finally, fewer middle‐aged and older faculty attributed difficulties experienced by a student with ADHD symptoms to “bad” character, a lack of discipline or a lack of motivation. These findings suggest more emphasis should be placed on disability‐related education and training for faculty members during early stages of their careers.     

Accommodations use for statewide standardized assessments: prevalence and recommendations for students who are deaf or hard of hearing

The Second Annual National Survey on Assessments and Accommodations for Students who are Deaf or Hard of Hearing investigated the types of testing accommodations used on 2004-2005 statewide standardized assessments as well as recommendations for best practices. A total of 444 participants who served over 9,000 students as teachers, administrators, or other educational professionals responded to the survey. The most widely used accommodations were small-group testing, interpreting test directions, and extended time. With the exception of interpreting or reading test items aloud, accommodations were largely used for both reading and math assessments. Participants perceived all listed accommodations as both valid and easy to use. Participants recommended that student academic level, communication mode, and additional disabilities be taken into account when choosing accommodations for students who are deaf or hard of hearing.