Threats to the validity of science performance assessments for English language learners

In recent years, at the same time that performance assessments in science have become more popular, the number of English language learners (ELLs) (i.e., students whose native language is other than English) served by the U.S. educational system has also increased rapidly. While the research base is growing in each of these areas independently, little attention has been paid to their intersection. This case study of the use of a science performance assessment with 96 ELLs in five high school science classes investigated the face, construct, and consequential validity of this intersection. Qualitative and quantitative data analyses showed that both teachers and students had an overall favorable response to the assessment, although students' English comprehension and expression skills were determining factors for certain items. While most responses were reliably scored, ELL spelling and syntax on certain responses were significant sources of error. The degree of specificity of teachers' guidance also significantly affected students' scores. Recommendations from this study include increasing the clarity of an assessment's design, allowing ELLs more time to complete assessments, and scoring by raters who are knowledgeable about typical patterns in written English for this student population. Furthermore, it is recommended that the use of performance assessments with ELLs be exploratory until such time as their validity and reliability with this population can be more adequately established. J Res Sci Teach 34: 721–743, 1997.     

Comparison of the slosson intelligence test,revised norms,and WISC-R for children with learning problems and for gifted children

The Slosson Intelligence Test (revised norms) (SIT) and the WISC-R were compared in two samples of children. In the first sample, there were 34 black and 27 white rural Southeastern Alabama children being considered for special education classes. In the second sample, there were 4 black and 81 white suburban Alabama children being considered for classes for the talented and gifted. In both samples, correlations between the SIT IQ and WISC-R Full Scale IQ were significant (rs of .70 and .48, respectively). However, in the special education sample, SIT IQs were significantly higher than WISC-R Full Scale IQs by about 7 points. The results from both samples provide a moderate degree of support for the concurrent validity of the revised SIT norms, using the WISC-R as the criterion. However, the IQs on the two tests may not be interchangeable.     

Benefits of assistive reading software for students with attention disorders

This study investigated how assistive reading software affected the reading performance of a group of 20 post-secondary students who had a primary diagnosis of attention disorder. These students used assistive reading software for most of a semester to read assignments for an English class and in testing sessions in which comparisons were made between normal, unassisted reading, and reading assisted by the soft ware. This software provides a synchronized visual and auditory presentation of text, and incorporates study skills tools for highlighting and note taking. Attention measures, reading speed, comprehension scores, and attitude questionnaire responses were obtained during these sessions. The principal findings were that the assistive software allowed the students to attend better to their reading, to reduce their distractibility, to read with less stress and fatigue, and to read for longer periods of time. It helped them to read faster and, thereby, to complete reading assignments in less time. It did not have a significant effect on comprehension, but it helped some students whose comprehension was very poor. The study results indicate that assistive reading software should be considered as a significant intervention to assist students who have attention disorders and as an accommodation to help them compensate for their disabilities.     

Grading as a Reform Effort: Do Standards‐Based Grades Converge With Test Scores?

Standards‐based progress reports (SBPRs) require teachers to grade students using the performance levels reported by state tests and are an increasingly popular report card format. They may help to increase teacher familiarity with state standards, encourage teachers to exclude nonacademic factors from grades, and/or improve communication with parents. The current study examines the SBPR grade–state test score correspondence observed across 2 years in 125 third and fifth grade classrooms located in one school district to examine the degree of consistency between grades and state test results. It also examines the grading practices of a subset of 37 teachers to determine whether there is an association between teacher appraisal style and convergence rates. A moderate degree of grade–test score convergence was observed using three agreement estimates (coefficient kappa, tau‐b correlations, and classroom‐level mean differences between grades and test scores). In addition, only small amounts of grade–test score convergence were observed between teachers; a much greater proportion of variance lay within classrooms and subjects. Appraisal style correlated weakly with convergence rates, but was most strongly related to assigning students to the same performance level as the test. Therefore using recommended grading practices may improve the quality of SBPR grades to some extent.     

Innovation in social networks: knowledge spillover is not enough

Knowledge Management Research & Practice - Knowledge has become increasingly specialized and thus trapped in discipline and sector silos. A rich exchange of ideas across disciplines and sectors...     

Experiences of instructors in online learning environments: Identifying and regulating emotions

In an effort to expand existing research on the barriers of instructors experience in online learning environments (OLEs), a qualitative study was conducted at a large mid-Atlantic university. Six instructors teaching in different OLE formats (e.g., asynchronous, hybrid, and synchronous via videoconferencing) participated in two focus groups in order to explore their emotional experiences and ways to regulate the emotions when teaching in OLEs. The overarching themes included emotions of feeling (a) restricted, (b) stressed, (c) devalued, (d) validated, and (e) rejuvenated. The article also provides practical strategies on how participating instructors attempted to manage the challenging emotions. A consensus among all participants is that continuous dialog in a community of practice about strategies to enhance OLEs is imperative.