Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a pilot testing protocol, item parameters for 110 life science questions are estimated from 4,043 crowdsourced adult subjects and then compared with those from 20,937 middle school science students. In terms of item discrimination classification (high vs. low), classical test theory yields an acceptable level of agreement (C-statistic = 0.755); item response theory produces excellent results (C-statistic = 0.848). Item response theory also identifies potential anchor items without including any false positives (items with low discrimination in the targeted population). We conclude that the use of crowdsourcing subjects is a reasonable, efficient method for the identification of high-quality items for field testing and for the selection of anchor items to be used for test equating.     

Executive functions and pragmatics in children with high-functioning autism

Children with deficits in executive functions (EFs) and impairments in pragmatic language have a range of cognitive and language difficulties that affect their literacy and educational achievements. As deficits in EFs and pragmatic impairments are characteristics of autism spectrum disorders, this study examined the associations between EFs and pragmatic skills in children with high-functioning autism (HFA). Fifteen children with HFA (5–9 years; M?=?7.44, SD 1.21), matched to 15 typically developing peers on age, gender, and non-verbal intelligence participated in the study. Children completed a pragmatic language assessment protocol, and a rating scale of EFs was administered to parents. Our results point to two main findings: children with HFA presented pragmatic difficulties and EFs impairments when compared with typically developing peers; and, as shown by a significant indirect effect of group on pragmatics via EFs, the poor pragmatics skills of HFA children were associated with their EFs difficulties. These findings may be of clinical relevance for children with pragmatic impairments, such as autism spectrum disorders. Future studies are crucial to further investigate the relationship between impaired pragmatics and EFs.

     

Using cultural historical activity theory to uncover praxis for inclusive education

This paper explores ways in which cultural historical activity theory (CHAT) provides a useful framework for examination of reflection and action during inclusive education fieldwork. Deeper understanding of combined reflection and action – praxis – is needed for researchers and teacher educators to support teacher candidates’ implementation of inclusive practices. We present a framework that includes core components of CHAT and potential insights these elements can bring to describing, analysing, or facilitating praxis during fieldwork. In particular, we discuss affordances of identifying activity systems, examining tool appropriation, and discovering tensions in teacher fieldwork. Examples based on evidence from two studies applying a CHAT lens to inclusive education fieldwork are embedded throughout the paper to illustrate the utility of this approach.     

Effects of elements or compound preexposure on conditioned taste aversion as a function of retention interval

The effects of element or compound preexposure and retention interval were examined in three experiments with the taste-aversion paradigm. In Experiment 1, preexposure to the elements of a compound flavor produced less latent inhibition to the compound than did preexposure to the compound itself when a 1-day preexposure-conditioning interval was used. However, preexposing the elements or the compound resulted in equivalent latent inhibition effects when a 21-day retention interval was used. In Experiment 2, a similar pattern of results was observed when the conditioning-test interval was manipulated. Experiment 3 explored the effect of element or compound preexposure when preexposure and test were carried out in different contexts. Attenuated latent inhibition following preexposure to the elements was found when preexposure and test were carried out in the same context. In contrast, preexposure to the elements resulted in as much latent inhibition as did preexposure to the compound when the context was switched from preexposure to testing. The implications of these findings for a retrieval-oriented view of latent inhibition are discussed.     

Students’ understanding of the number line / Estudiantes pensando en la recta numérica

We studied the conceptions of students coming from secondary education and university regarding the number line as a representation of real numbers. In the context of a wider questionnaire, 307 students were presented with a task consisting of two verbal items and one graphic item related to the number line. The students were all at different levels in their study of mathematics (in the third, fourth or fifth year of secondary education, or at the beginning or advanced stage of a university degree in mathematics, biology or physical education). A gradient in the depth of the students’ conceptions, associated with the level of their studies in mathematics, was found. This gradient extends from the estrangement of facing the problem or a conception of a drawn or physical matter line, which was associated with students with a lower level of mathematical studies, passing through a vision centred around potential numeric density or a line containing points (discrete), up to an instrumental conception of the line as supportive of magnitudes in advanced students of biology and focusing on continuity sustained by advanced students of mathematics.     

Developing a standardized comprehensive health survey for use with deaf adults

THERE IS LIMITED INFORMATION on how communication barriers impact on the health of deaf individuals. The present article describes the development of a standardized interview tool to collect health-related information from deaf adults via face-to-face interviews in American Sign Language (ASL). Questions were selected largely from existing standardized questionnaires. Key steps in standardizing the instrument included the creation of an ASL gloss version of the survey and extensive interviewer training. The instrument was pilot-tested and revised prior to implementation. There were 139 questions on the final instrument. A total of 203 interviews were conducted between November 2002 and March 2003. A standardized interview survey administered in ASL proved an effective and well-accepted means of collecting health-related information from a diverse sample of deaf individuals. Several challenges were encountered throughout the process, and the resulting lessons will be useful to future research efforts.