How Days Between Tests Impacts Alternate Forms Reliability in Computerized Adaptive Tests

An essential question when computing test–retest and alternate forms reliability coefficients is how many days there should be between tests. This article uses data from reading and math computerized adaptive tests to explore how the number of days between tests impacts alternate forms reliability coefficients. Results suggest that the highest alternate forms reliability coefficients were obtained when the second test was administered at least 2 to 3 weeks after the first test. Even though reliability coefficients after this amount of time were often similar, results suggested a potential tradeoff in waiting longer to retest as student ability tended to grow with time. These findings indicate that if keeping student ability similar is a concern that the best time to retest is shortly after 3 weeks have passed since the first test. Additional analyses suggested that alternate forms reliability coefficients were lower when tests were shorter and that narrowing the first test ability distribution of examinees also impacted estimates. Results did not appear to be largely impacted by differences in first test average ability, student demographics, or whether the student took the test under standard or extended time. It is suggested that for math and reading tests, like the ones analyzed in this article, the optimal retest interval would be shortly after 3 weeks have passed since the first test.     

ISPCAN Child Abuse Screening Tools Retrospective version (ICAST-R): Delphi study and field testing in seven countries

ObjectivesTo gain consensus among an ethnically and linguistically diverse group of international child protection experts on the structure and content of a new survey tool for retrospective measurement of child abuse, and to determine the performance of the instrument through an international field trial with young adults.MethodsThe questionnaire was developed through focus group discussions with international experts, and then subjected to a Delphi study in two waves to determine the perceived importance and translatability of items. The resultant questionnaire was translated into six languages and field tested in seven countries with convenient samples of young adults aged 18–26 years (N = 842).ResultsChild maltreatment experts from 28 countries provided input to questionnaire development. Satisfactory agreement on draft item inclusion and exclusion and the translatability of items was gained. The tool includes 15 primary questions about potentially abusive physical, sexual and emotional events, with follow-up questions about perpetrator characteristics, frequency of acts and periods in childhood when the recalled abuse occurred. The field test revealed lifetime prevalence per item usually exceeded 10% (11/15 items; range 2.1–49.5%). Internal consistency (Cronbach's alpha) was moderate to high for each of three item sub-sets (between .61 and .82) and the rates of missing data were low (less than 1.5% for 14 of 15 items). The great majority of respondents nominated either peer and/or adult perpetrators (between 82.3% and 98.2% depending upon the item), and among these, child/adolescent peers and non-family adults (including teachers for emotional and physical acts) were nominated often.ConclusionsThe ICAST-R is based on consensus from international experts, translates clearly and has satisfactory properties for adoption as a survey tool to estimate prevalence and describe perpetrators and other contextual aspects of child abuse.Practice implicationsThis tool can be utilized in a broad range of cultures and languages and may contribute to improved research practice. Although the core items are limited to just 15 acts of maltreatment, if these behaviorally specific questions are adopted as key indicators and incorporated into comprehensive local, national or regional surveys, eventually there should be greater comparability in survey estimates.     

The development and piloting of the ISPCAN Child Abuse Screening Tool—Parent version (ICAST-P)

ObjectiveChild maltreatment is a problem that has longer recognition in the northern hemisphere and in high-income countries. Recent work has highlighted the nearly universal nature of the problem in other countries but demonstrated the lack of comparability of studies because of the variations in definitions and measures used. The International Society for the Prevention of Child Abuse and Neglect has developed instrumentation that may be used with cross-cultural and cross-national benchmarking by local investigators.Design and samplingThe instrument design began with a team of expert in Brisbane in 2004. A large bank of questions were subjected to two rounds of Delphi review to develop the fielded version of the instrument. Convenience samples included approximately 120 parent respondents with children under the age of 18 in each of six countries (697 total).ResultsThis paper presents an instrument that measures parental behaviors directed at children and reports data from pilot work in 6 countries and 7 languages. Patterns of response revealed few missing values and distributions of responses that generally were similar in the six countries. Subscales performed well in terms of internal consistency with Cronbach's alpha in very good range (0.77–0.88) with the exception of the neglect and sex abuse subscales. Results varied by child age and gender in expected directions but with large variations among the samples. About 15% of children were shaken, 24% hit on the buttocks with an object, and 37% were spanked. Reports of choking and smothering were made by 2% of parents.ConclusionThese pilot data demonstrate that the instrument is well tolerated and captures variations in, and potentially harmful forms of child discipline.Practice implicationsThe ISPCAN Child Abuse Screening Tool – Parent Version (ICAST-P) has been developed as a survey instrument to be administered to parents for the assessment of child maltreatment in a multi-national and multi-cultural context. It was developed with broad input from international experts and subjected to Dephi review, translation, and pilot testing in six countries. The results of the Delphi study and pilot testing are presented. This study demonstrates that a single instrument can be used in a broad range of cultures and languages with low rates of missing data and moderate to high internal consistency.     

An intervention for relational and physical aggression in early childhood: A preliminary study

A preventive intervention for reducing physical and relational aggression, peer victimization, and increasing prosocial behavior was developed for use in early childhood classrooms. Nine classrooms were randomly assigned to be intervention rooms (N = 202 children) and nine classrooms were control rooms (N = 201 children). Classroom was the unit of analysis and both observations and teacher-reports were obtained at pre and post-test. Focus groups were used to develop the initial program. The 6-week program consisted of developmentally appropriate puppet shows, active participatory sessions, passive concept activities and in vivo reinforcement periods. Preliminary findings suggest that the “Early Childhood Friendship Project” tended to reduce physical and relational aggression, as well as physical and relational victimization and tended to increase prosocial behavior more for intervention than control classrooms. Teachers and interventionists provided positive evaluations of the program and there is evidence for appropriate program implementation.     

Changing student expectations and graduate employment: Case studies from Xi��an, Shaanxi Province

This paper addresses the issue of students’ employment expectations, considered a key factor in alleviating graduate unemployment in China. This empirical investigation surveyed students at two higher education institutions in Xi’an, Shaanxi Province, to analyze how expectations were changing. The results contrasted with earlier studies that reported unrealistically high expectations, discovering instead that most respondents were aware of the difficulties of finding work and were revising their expectations accordingly. The results also revealed important variations in attitude between higher vocational students and university undergraduates, and between urban and rural students. Overall, the paper contends that although students are becoming more realistic, the complexity of graduate unemployment will prevent this change in attitude from making a major improvement to the overall situation.     

Mediating Voices: Community Participation in the Design of E-Enabled Community Care Services

In the United Kingdom, information and communication technologies are being used to e-enable multiagency community services for children. Public policy advocates that practitioners as well as users should be involved in the shaping of services including the information systems used in their delivery. This article discusses how a group of social and computer scientists developed the social formation methodology to facilitate nonexpert community participation in the design of e-enabled community care services. The longitudinal study adapts qualitative methods to understand community welfare and to foster participation in the design of communication systems. By exploring the perspectives of welfare practitioners and families, the importance of situated and mediated conversations in community care is identified. The facilitative conversation approach of the study then brings these community perspectives, as well as ICT perspectives, into design processes of e-enabled services.