Reporting Quality of Single-Case Research Published in Learning Disabilities Journals

Single-case research designs are useful for learning disability researchers interested in refining novel interventions (e.g., new mathematics intervention) before scaling, small n populations (e.g., students with comorbid learning and emotional and behavioral disabilities), and testing unique conditions (e.g., remote locales). Much attention has been devoted to developing research quality standards, which is essential for replication and implementation fidelity; however, little is known about the reporting quality of single-case design studies. To gain insight into the quality of learning disability single-case research design study reporting, we analyzed 72 articles published between 2010 and 2021 in six learning disability-focused journals using the Single-Case Reporting Guideline In BEhavioral interventions (SCRIBE) standards. Findings suggest that reporting quality has remained stagnant, and none of the studies reviewed met all of the reporting standards. Alignment with standards ranged from 33% to 77%. Implications for researchers and practitioners are discussed.     

Evaluation of the benefits of laboratory research and information services

The authors examine the problems of ex-post evaluation of the benefits deriving from services provided by Government Laboratories. They concentrate on the difficulties of conducting meaningful ex-post studies since they feel that too many claims are made on the basis of inadequate, incomplete economic assessments using data that would not be substantiated if probed deeply. Their views are based on a review of nine years' practical evaluation experience.The paper defines three ways in which services/information sources can link up with intended recipients, and discusses the practical problems associated with assessing the impact of services in each case. These problems range from sampling errors and sample bias in questionnaire approaches, to limited respondent knowledge and perspective. Critical probing can overcome these difficulties in some, though not all, instances, since there are issues of principle that prohibit unique attribution of benefits to specific initiatives in many ex-post analyses. The use of cost recovery as a proxy measure of worth is reviewed.The authors point out that ex-ante appraisal of profits is not subject to the same constraints and avoids many of the pitfalls of ex-post evaluation.     

Effect of binocular disparity on learning anatomy with stereoscopic augmented reality visualization: A double center randomized controlled trial

Binocular disparity provides one of the important depth cues within stereoscopic three-dimensional (3D) visualization technology. However, there is limited research on its effect on learning within a 3D augmented reality (AR) environment. This study evaluated the effect of binocular disparity on the acquisition of anatomical knowledge and perceived cognitive load in relation to visual-spatial abilities. In a double-center randomized controlled trial, first-year (bio)medical undergraduates studied lower extremity anatomy in an interactive 3D AR environment either with a stereoscopic 3D view (n = 32) or monoscopic 3D view (n = 34). Visual-spatial abilities were tested with a mental rotation test. Anatomical knowledge was assessed by a validated 30-item written test and 30-item specimen test. Cognitive load was measured by the NASA-TLX questionnaire. Students in the stereoscopic 3D and monoscopic 3D groups performed equally well in terms of percentage correct answers (written test: 47.9 ± 15.8 vs. 49.1 ± 18.3; P = 0.635; specimen test: 43.0 ± 17.9 vs. 46.3 ± 15.1; P = 0.429), and perceived cognitive load scores (6.2 ± 1.0 vs. 6.2 ± 1.3; P = 0.992). Regardless of intervention, visual-spatial abilities were positively associated with the specimen test scores (η² = 0.13, P = 0.003), perceived representativeness of the anatomy test questions (P = 0.010) and subjective improvement in anatomy knowledge (P < 0.001). In conclusion, binocular disparity does not improve learning anatomy. Motion parallax should be considered as another important depth cue that contributes to depth perception during learning in a stereoscopic 3D AR environment.     

Multi-informant assessment of maltreated children: convergent and discriminant validity of the TSCC and TSCYC

OBJECTIVE: This study examined the convergent and discriminant validity of two trauma symptom measures, the Trauma Symptom Checklist for Children (TSCC) [Briere, J. (1996). Trauma Symptom Checklist for Children (TSCC). Odessa, FL: Psychological Assessment Resources] and the Trauma Symptom Checklist for Young Children (TSCYC) [Briere, J. (2005). Trauma Symptom Checklist for Young Children (TSCYC). Odessa, FL: Psychological Assessment Resources]. METHODS: Children's scores on the TSCC and their caretakers' ratings on the TSCYC were analyzed in a study of 310 children presenting to one of two child abuse treatment centers. RESULTS: TSCC and TSCYC scales generally converged in their assessment of symptomatology in maltreated children. Equivalent scales measuring anxiety, depression, anger, dissociation, and sexual concerns were generally most correlated with one another. Similarly, the Posttraumatic Stress-Intrusion (PTS-I) scale of the TSCYC correlated highest with the Posttraumatic Stress (PTS) and Anxiety (ANX) scales of the TSCC, the TSCYC Posttraumatic Stress-Arousal (PTS-AR) scale was correlated with the TSCC ANX scale, and the TSCC PTS scale was most correlated with the TSCYC ANX, PTS-I, and Sexual Concerns (SC) scales. The TSCYC Posttraumatic Stress-Avoidance scale was unrelated to any TSCC scale. Discriminant function analysis revealed that the TSCC PTS scale was the best single predictor of sexual abuse-related PTSD status as identified by the TSCYC. CONCLUSIONS: The TSCC and TSCYC display moderate convergent and discriminant validity with respect to one another, despite different information sources. Nevertheless, the relatively small association between relevant TSCC and TSCYC scales indicates that different symptom informants may have different perspectives on the child's symptomatology; an outcome that may be beneficial when both measures are administered simultaneously. PRACTICE IMPLICATIONS: These results reinforce the notion that both child- and parent/caretaker report measures should be used in the evaluation of traumatized children, so that multiple sources of information can be considered simultaneously. In the current context, administration of the TSCC to the child and the TSCYC to the caretaker, when appropriate (i.e., in children 8-12 years of age) may yield more clinical information on the child's symptomatology than either measure would alone-perhaps especially in cases when one of the two respondents under- or over-reports the child's distress.     

Touch your toes! Developing a direct measure of behavioral regulation in early childhood

Behavioral aspects of self-regulation, including controlling and directing actions, paying attention, and remembering instructions, are critical for successful functioning in preschool and elementary school. In recent years, several direct assessments of these skills have appeared, but few studies provide complete psychometric data and many are not easy to administer. We developed a direct measure of children's behavioral regulation, the Head-to-Toes Task, and report performance of participants aged 36–78 months, including a group of Spanish-speaking children, from two different sites (N = 353; N = 92). We examined construct validity, examiner reliability, sources of variation, and associations between task scores and background characteristics. Results showed that the task was valid, reliable, and demonstrated variability in children's scores. A cross-classified hierarchical growth curve analysis indicated that girls, participants assessed in English, and higher-socioeconomic status (SES) children achieved slightly higher average scores than did boys, Spanish-speaking and lower-SES children, but effect sizes were small. Older participants achieved higher scores than did younger children, and there were no effects for site. Results suggest that the Head-to-Toes Task is an informative and easy-to-administer direct assessment of children's behavioral regulation. We discuss implications for its use in early childhood settings.     

Child peer sexual abuse: preliminary data on outcomes and disclosure experiences

OBJECTIVE: This study compared experiences of children sexually abused by peers to those of children abused by adolescents/adults. Variables examined included perceived negativity of the abuse, self-reported outcomes, overall psychological functioning, and disclosure. METHOD: An archival data set containing retrospective reports of childhood sexual experiences was culled for instances of sexual abuse by child peers and adolescents/adults. An equivalent nonabused comparison group was identified. The Self-Report Outcome Checklist (SROC; Gilbert, 1994b), the MMPI-Hugo Short Form (Hugo, 1971) and a disclosure survey were also retrieved from these data. RESULTS: Compared to abuse by peers, abuse perpetrated by adolescents/adults was more intrusive and intrafamilial. Both groups rated their experiences as equally negative, and reported equally pervasive outcomes. Those abused by adolescents/adults reported significantly higher scores on the Psychopathic Deviate, Psychasthenia, and Schizophrenia scales compared to nonabused controls; similar findings did not emerge for those abused by child peers. Less than a fourth in either abuse group reported disclosing their experience to a parent. Among those who did not disclose, participants abused by child peers anticipated less support from both parents and more anger from their mothers. CONCLUSIONS: The findings suggest that child peer sexual abuse may be associated with adverse outcomes.     

Implications of legal and organizational issues for urban digital government development

This paper discusses implications of the convergence of legal and organizational issues in the context of developing and implementing digital government projects in large urban settings. By the convergence of legal and organizational issues we refer to two important aspects of urban government: (1) the close relationship between legal/policy structures and the way government is organized and functions, and (2) the way the legal/policy elements interact with organizational dynamics and work cultures to influence digital government projects (and government activities generally). It is our contention that convergence in the organizational and legal/policy context is a powerful determinant of how these projects develop and how likely they are to succeed. Therefore the understanding of this convergence and related dynamics is critically important to planning and designing both policy to promote digital government and particular digital government projects themselves. Illustrations of this convergence and its consequences are presented. They are based on research involving two digital government projects in urban settings: development of a management information system for homeless shelter administration and a developing a system for sharing information among New York City agencies.