Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire

The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n?=?633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity.     

Effect on subsequent fixed-interval schedule performance of prior exposure to ratio and interval schedules of reinforcement

In three experiments, we examined the effect on the patterns of responding noted on fixed interval (FI) schedules of prior exposure to a range of interval and ratio schedules. Rats leverpressed for food reinforcement on random ratio (RR), random interval (RI), or variable interval (VI) schedules prior to transfer to FI schedules. In Experiment 1, prior exposure to an RR schedule retarded the development of typical FI patterns of responding. Exposure to a yoked RI schedule produced even greater retardation of typical FI performance. This effect was replicated in Experiment 2, using a within-subjects design. Rats responded on a multiple RR-RI schedule prior to a multiple FI-FI schedule. Typical FI performance emerged more slowly in the component previously associated with the RI than with that associated with the RR. In Experiment 3, exposure to an RR schedule retarded the development of FI performance to a greater extent than did exposure to a VR schedule. The latter schedule was programmed to allow the possibility that inhibitory control would develop after reinforcement. These results confirm that ratio schedules independently result in the disruption of FI responding. This effect was not long lasting and cannot be used plausibly to explain species differences in responding to FI schedules. However, it does suggest that temporal control—as manifested by the transfer of inhibitory control from one schedule to another—could facilitate movement between interval schedules.     

Temperamental Origins of Child and Adolescent Behavior Problems: From Age Three to Age Fifteen

We assessed relations between early temperament and behavior problems across 12 years in an unselected sample of over 800 children. Temperament measures were drawn from behavior ratings made by examiners who observed children at ages 3, 5, 7, and 9. Factor analyses revealed 3 dimensions at each age: Lack of Control, Approach, and Sluggishness . Temperament dimensions at ages 3 and 5 were correlated in theoretically coherent ways with behavior problems that were independently evaluated by parents and teachers at ages 9 and 11, and by parents at ages 13 and 15. Lack of Control was more strongly associated with later externalizing behavior problems than with internalizing problems; Approach was associated with fewer internalizing problems among boys; and Sluggishness was weakly associated with both anxiety and inattention, especially among girls. Lack of Control and Sluggishness were also associated with fewer adolescent competencies. These results suggest that early temperament may have predictive specificity for the development of later psychopathology.     

Changes in science classrooms after experiencing an international professional staff development program

This professional development program was designed to prepare science teachers to be more student-centered and to implement newer goals for science instruction. These goals are to improve science teaching in ways that promote broader and longer-lasting learning. Secondary school science teachers in Korea are expected to follow a rigid national curriculum with large classes - often with more than 50 students. This study focuses on feedback and follow-up interaction with teacher participants who were enrolled in a month-long workshop in the U.S. before returning to Korea to implement the new ideas. Assistance was offered to help teachers develop teaching modules which were more constructivist while also assisting with assessment efforts that provided further evidence of use of the new teaching practices and their effect on student learning. Student mastery of concepts and improvement in student creativity were two aspects of the summer workshop experiences and these were evaluated to illustrate workshop effects on teacher participants in their actual classrooms. An erratum to this article is available at .     

Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task

Four experiments examined the influence of a stimulus presented after one response in a two-lever choice task. In Experiment 1, food-deprived rats trained on a concurrent variable-interval extinction schedule responded more often on the extinction lever when such responding periodically produced a visual stimulus than when it did not. In Experiments 2 and 3, a similar signal-induced enhancement effect was found even when food was delivered randomly with respect to responding on both levers or when no food was presented. In Experiment 4, a response-contingent visual stimulus elevated responding to the lever on which it was presented, but an auditory cue suppressed responding. These findings indicate that visual stimuli may possess intrinsically reinforcing properties for rats.     

Trends in the Educational Placement of Students with Disabilities in New South Wales

This paper reports the results of an analysis of trends in the placement of students with intellectual, physical, sensory, or behavioural disabilities in New South Wales for the period 1986 to 1994. Although there was a general trend of movement of students from special schools to support classes, there were some major differences across disability groups. The results are discussed in relation to current special education policy in New South Wales and the philosophy of including students with a disability in regular schools and classes.     

Judgments of successful inclusion by education service personnel

Three different methods were used to investigate the basis of judgments about the success of inclusion made by key staff in an education service in the UK. First, a structured questionnaire was used by staff to rate the pupil social and learning skills needed for success in mainstream classes. Second, an open-ended elicitation technique was used to identify criteria for successful inclusion that are spontaneously generated by staff. Third, a scenario rating scale was constructed to assess experimentally the relative priority accorded by staff to each success criterion. A substantial degree of consensus across methods was identified in the specific skills and key success criteria considered important by different groups of staff. Parallels with previous questionnaire-based research conducted in the US are discussed. Some differences across methods and respondent groups are also identified, and the potential advantages of multi-perspective, multi-method approaches to assessing inclusion success criteria are considered.     

Impact of intervening learning on resurgence in humans with Autism Spectrum Disorders

In the present study, we investigated the degree to which responding would resurge in children diagnosed with Autism Spectrum Disorders (ASD) following an intervening training period comprising different schedules of reinforcement. Twenty-four children of the ages 7–15, with a diagnosis of an ASD, were taught a play a sequence on a variable ratio- (VR) 3 schedule of reinforcement, during a 30-min session. The play sequence was then extinguished before the participants were taught a second play sequence, using a VR-4 schedule for 30 min, a VR-4 schedule for 60 min, or a VR-2 schedule for 30 min. A 5-min extinction session was then conducted to determine the impact that the intervening schedules had on the resurgence of the original behavior. The original sequence resurged to a greater extent for Group VR-4 30 min than it did for the other two groups. The results provide evidence that the length of time between initial training and testing is not a prime determinant of the level of resurgence, but that the amount of conditioning may play a stronger role: The greater the number of reinforcers received, the smaller the resurgence effect.     

Course ratings as measures of instructional effectiveness

This study assesses the validity of instructor ratings as measures of instructional effectiveness. Multiple regression analysis was used to assess the relationship between ratings of classroom practices, instructor characteristics and student commitment to the course and an overall rating of the instructor. Sixty-four percent of the variance in instructor ratings could be explained by variance in students' ratings for eleven course-related items. It was concluded that variance in instructor ratings reflected variance in classroom and instructional practices.