The influence of question type,text availability,answer confidence and language background on student comprehension of an expository text

Reading is an essential activity for learning at university, but lecturers are not always experienced in setting appropriate questions to test understanding of texts. In other words, their assessments may not be ‘constructively aligned’ with the learning outcomes they hope their students to exhibit. In examination conditions, questions may be set with insufficient time for re-reading available texts, thus drawing more on students' powers of recall than on deeper learning and comprehension. Previous research has been undertaken on reading comprehension generally, but no research has yet explored the interaction of factors such as text availability (re-reading of texts), text layout, question type and respondents' language background. This study explores the correctness of 50 participants' responses to a set reading task based on an expository text, and participants' confidence in giving those answers, in relation to four factors: the effects of question type; text availability; text layout; and language background. The main findings are that non-native speakers of English have more difficulty and less confidence in answering implicit questions and that reviewing the text has a significant effect on response correctness for implicit questions. The form of text layout did not show a significant effect, however. Our results have implications for lecturers who set readings and questions for comprehension and others who use reading comprehension as part of their ‘hidden curriculum’. Further research in this area is required to determine more precisely the effects of language background.     

Feature-positive discriminations during a spatial-search task with humans

During feature-positive operant discriminations, a conditional cue, X, signals whether responses made during a second stimulus, A, are reinforced. Few studies have examined how landmarks, which can be trained to control the spatial distribution of responses during search tasks, might operate under conditional control. We trained college students to search for a target hidden on a computer monitor. Participants learned that responses to a hidden target location signaled by a landmark (e.g., A) would be reinforced only if the landmark was preceded by a colored background display (e.g., X). In Experiment 1, participants received feature-positive training (+←YB/ XA→+/A?/B?) with the hidden target to the right of A and to left of B. Responding during nonreinforced transfer test trials (XB?/YA?) indicated conditional control by the colored background, and spatial accuracy indicated a greater weighting of spatial information provided by the landmark than by the conditional cue. In Experiments 2a and 2b, the location of the target relative to landmark A was conditional on the colored background (+←YA/ XA→+/ ZB→+/ +←C /A?/B?). At test, conditional control and a greater weighting for the landmark’s spatial information were again found, but we also report evidence for spatial interference by the conditional stimulus. Overall, we found that hierarchical accounts best explain the observed differences in response magnitude, whereas spatial accuracy was best explained via spatial learning models that emphasize the reliability, stability, and proximity of landmarks to a target.     

Assessment matters: The why and how of cracking open and using assessment results

The authors interviewed two dozen educators at several institutions to better understand how data from the National Survey of Student Engagement were (or were not) being used. Their results offer guidance to those with dusty data binders on their shelves.     

Determining Sufficient Measurement Opportunities When Using Multiple Cut Scores

Many educational testing programs report examinee performance at more than two levels of proficiency. Whether these assessments have the capacity to support these multiple inferences, though, is a topic that has not been widely discussed. This study proposes a method for evaluating the minimum number of measurement opportunities for reporting students' performance at multiple achievement levels and describes an application of the method for reading and mathematics assessments that are used by some school districts in Nebraska. Analyses were based on judgments collected from 110 teachers about characteristics of items and tasks from multiple assessments in reading and mathematics at grades 4 and 8, and in high school. Results suggested that there were generally enough items on the mathematics assessments to classify students into two or three performance levels, but rarely enough to make the four classifications that the state reported. Items on the reading assessments were generally distributed across the proficiency levels and tended to allow reporting for all four classification levels. These findings have implications for both practitioners and policymakers in how scores are interpreted.     

Measuring teachers’ self-efficacy beliefs: Development and use of the TEBS-Self

This paper distinguishes between teacher efficacy and teacher self-efficacy beliefs and describes a need for theory and research-based measures of teachers’ self-efficacy beliefs that are grounded in the context of the classroom. To meet this need, a new measure of teacher self-efficacy beliefs, the Teachers’ Efficacy Beliefs System-Self (TEBS-Self), is described by the authors. Principal components analysis results are presented from three independent studies performed in the United States (n=2373 K-6 teachers) using the TEBS-Self.