Support for assessment practice: developing the Assessment Design Decisions Framework

There are many excellent publications outlining features of assessment and feedback design in higher education. However, university educators often find these ideas challenging to realise in practice, as much of the literature focuses on institutional change rather than supporting academics. This paper describes the conceptual development of a practical framework designed to stimulate educators’ thinking when creating or modifying assessments. We explain the concepts that underpin this practical support, including the notions of ‘assessment decisions’ and ‘assessment design phases’, as informed by relevant literature and empirical data. We also present the outcome of this work. The Assessment Design Decisions Framework. This provides key considerations in six categories: purposes, contexts, tasks, interactions, feedback processes and learning outcomes. By tracing the development of the Framework, we highlight complex ways of thinking about assessment that are relevant to those who design and deliver assessment to tertiary students.     

School-based assessment of attention deficit-hyperactivity disorder

Schools are uniquely situated to provide information relevant to the assessment and treatment of Attention Deficit-Hyperactivity Disorder (ADHD) across a variety of tasks, settings, and observers. The importance of the school setting to the assessment and treatment of ADHD has resulted in the development of numerous measures appropriate for such assessment, but few guidelines for their use. The purpose of this article is to describe school-based assessment procedures and their relationship to ADHD. These procedures include teacher rating measures, direct observations in classrooms and on playgrounds, peer rating and sociometric measures, and permanent product measures such as academic performance. It is recommended that school-based assessment of ADHD involve the concurrent use of multiple measures to assess adequately the wide variety of symptoms associated with this disorder. It is further recommended that assessment serve the purpose of determining treatment efficacy to avoid unwarranted preoccupation with diagnostic issues that are as yet unresolved. The components of a comprehensive school-based assessment of ADHD are described, and their relationship to school-based treatment is discussed.     

School psychologists and autism identification: Present challenges and potential solutions

Although federal law has provided guidelines for autism eligibility for special education, school-based autism assessment and eligibility vary widely across states and identification continues to lag behind national prevalence data. The main role of the school psychologist continues to be conducting evaluations for special education eligibility, and given current barriers, some school psychologists do not feel equipped to make a recommendation for autism eligibility. This article summarizes the barriers school psychologists face when conducting autism assessments in the schools, including systemic barriers, lack of training or professional development, resulting lack of confidence, among others. We conclude by highlighting recommendations for multipronged systemic changes that will improve the capacity of special education teams and specifically support the pivotal role of the school psychologist in conducting autism eligibility evaluations in the schools.     

Assessing anxiety in youth with autism spectrum disorder

Anxiety is now recognized as one of the most common co-occurring conditions in youth diagnosed with autism spectrum disorder (ASD). Despite the prevalence of this comorbid condition, accurate assessment and diagnosis of anxiety in ASD has proven difficult. This paper will address the considerable research literature on assessing anxiety in youth with ASD, including difficulties related to assessment and differential diagnosis. In addition, this paper will describe relevant tools and methods for assessing anxiety in this complex population.     

Assessment of Attention‐Deficit/Hyperactivity Disorder (ADHD): A comparative evaluation of five,commonly used,published rating scales

ADHD is one of the most common referrals to school psychologists and child mental health providers. Although a best practice assessment of ADHD requires more than the use of rating scales, rating scales are one of the primary components in the assessment of ADHD. Therefore, the goal of this paper is to provide the reader with a critical and comparative evaluation of the five most commonly used, narrow‐band, published rating scales for the assessment of ADHD. Reviews were conducted in four main areas: content and use, standardization sample and norms, scores and interpretation, and psychometric properties. It was concluded the rating scales with the strongest standardization samples and evidence for reliability and validity are the ADDES, the ADHD‐IV, and the CRS‐R. In determining which of these to use, the prospective users may want to reflect on their goals for the assessment. The ACTeRS and the ADHDT are not recommended for use because they are lacking crucial information in their manuals and have less well‐documented evidence of reliability and validity. Conclusions and recommendations for scale usage are discussed. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 341–361, 2003.     

Educating children on the autism spectrum: preconditions for inclusion and notions of ‘best autism practice’ in the early years

This article draws together findings from expert evidence and empirical studies to identify the preconditions for developing inclusive learning environments for young children on the autism spectrum. It concludes that in order to develop ‘best practice’, practitioners need to adapt interventions to the unique needs of the individual child, work in partnership with parents and other professionals, create enabling environments and be informed by a developmental approach to learning. Practitioners need to have knowledge of the autism spectrum and how it impacts on the child. Careful assessment of the individual child is also crucial. Finally, it is important to ensure that these young children receive direct teaching in communication and language, social understanding and skills, as well as learning with and through peers.     

A contemporary review of the assessment,diagnosis and treatment of ADHD

Attention-deficit/hyperactivity disorder (ADHD) is a neuro-behavioural disorder that presents frequently in paediatric and mental health settings. Children with ADHD present with symptoms of hyperactivity, inattention, distractibility and impulsivity. The purpose of this paper is to provide clinicians with a summary of contemporary issues relevant to their clinical understanding, assessment, diagnosis and treatment of the disorder. Issues discussed include the primary and secondary symptoms of the disorder, developmental course, underlying causes, recognition in a clinical setting, diagnosis and treatment.     

成人注意力缺陷多动障碍研究的文献计量分析

采用VOSviewer软件分析2015-2019年Web of Science平台核心合集中成人注意力缺陷多动障碍文献,发现研究集中于症状表现、诊断及评量、病理与治疗,热点为成人注意力缺陷多动障碍与共病障碍的相互作用、儿童研究产生之诊断评量工具对于成人的适用性、药物和心理治疗对成人的应用效果。未来研究可集中在探索该障碍在整个生命周期的变化、后果及干预,建立多维诊断评量模式,加强成人患者的治疗及效果等方面。     

Grounding Turbulent Minds: The Challenges of Mindfulness-Based Interventions for College Students With ADHD and How to Overcome Them

College can be difficult for students with attention-deficit/hyperactivity disorder (ADHD). Inattention and impulsivity are not conducive to academic success. Individuals with ADHD often experience difficulties with time management, organization, social adjustment, and psychological distress. One possible treatment approach for individuals with ADHD is mindfulness-based interventions, which lead to symptom reductions and increases in mindfulness skills. However, there are challenges in conducting such treatments on college campuses. This article outlines some of those challenges and highlights ways to overcome them using intervention research, more specifically clinical behavior analysis. The qualitative experience of conducting two mindfulness meditation interventions for college students with ADHD is discussed, and recommendations for conducting similar campus-based interventions are made.     

Motor correlates of ADHD: contribution of reading disability and oppositional defiant disorder

This study investigated whether the likelihood of motor impairment in children with attention-deficit/hyperactivity disorder (ADHD) increases with the presence of other disorders, and whether the co-occurring diagnoses of reading disability (RD) and oppositional defiant disorder (ODD) account for the motor deficits seen in ADHD. A total of 291 children (218 boys, 73 girls) participated. Six groups of children were compared: ADHD only (n = 29); RD only (n = 63); ADHD and RD (n = 47); ADHD and ODD (n = 19); ADHD, RD, and ODD (n = 21); and typically developing control children (n = 112). Motor skills were assessed with the Bruininks-Oseretsky Test of Motor Proficiency and the Beery Test of Visual-Motor Integration. We found that the motor skills of the ADHD-only group did not differ from the typical control group. Furthermore, motor impairment in ADHD increased as a function of co-occurring disorders, and the presence of RD rather than ADHD predicted motor impairment.     

Multi-Method Assessment of ADHD Characteristics in Preschool Children: Relations between Measures

Several forms of assessment tools, including behavioral rating scales and objective tests such as the Continuous Performance Test (CPT), can be used to measure inattentive and hyperactive/impulsive behaviors associated with Attention-Deficit/Hyperactivity Disorder (ADHD). However, research with school-age children has shown that the correlations between parent ratings, teacher ratings, and scores on objective measures of ADHD-characteristic behaviors are modest at best. In this study, we examined the relations between parent and teacher ratings of ADHD and CPT scores in a sample of 65 preschoolers ranging from 50 to 72 months of age. No significant associations between teacher and parent ratings of ADHD were found. Parent-ratings of both inattention and hyperactivity/impulsivity accounted for variance in CPT omission errors but not CPT commission errors. Teacher ratings showed evidence of convergent and discriminant validity when entered simultaneously in a hierarchical regression. These tools may be measuring different aspects of inattention and hyperactivity/impulsivity.     

美国循证实践在自闭症谱系障碍儿童干预中的应用及其对我国的启示

国际趋势表明自闭症谱系障碍儿童干预方法的有效性需循证实践来检验。美国自闭症干预方法的循证实践过程经历了研究文献筛选、建立证据强度分类系统、干预次级分类系统三个阶段,循证实践结果将当前的自闭症干预方法划分为已经证实有效的方法、正在形成有效的方法、尚未证实的方法。我国自闭症教育研究者及临床工作者应遵循循证实践,科学选择干预方法。     

Why children with ADHD do not have low IQs

The major cognitive deficit of children with attention-deficit/hyperactivity disorder (ADHD) is impaired executive function (EF), a cognitive component that some theorists believe to be the primary substrate for the general intelligence (g) factor. We review the constructs of g and EF and the relevant research findings on ADHD. We then analyze the results of a battery of diverse tests, including measures of EF, administered to 123 boys with ADHD. The correlations among the EF measures, two well-accepted measures of IQ, and the g factor extracted from the entire battery are trivial at best. These results are discussed in the context of collateral evidence supporting the independence of g and EF and its clinical and theoretical implications.     

Attention‐Deficit/Hyperactivity Disorder (ADHD): A national survey of training and current assessment practices in the schools

The primary purpose of this research was to survey school psychologists to investigate their training and current assessment practices for attention‐deficit/hyperactivity disorder (ADHD) in the schools. The survey consisted of 38 questions regarding participant characteristics and three main areas relevant to ADHD: (a) training, (b) caseloads/referral patterns, and (c) assessment. The respondents reported receiving adequate training in the assessment of ADHD, with doctorate‐level psychologists self‐reporting being better trained than nondoctorate psychologists. Results confirmed a substantial caseload of ADHD referrals. In the assessment of ADHD, the results indicated school psychologists are using multiple informants, methods, and settings for the assessment of ADHD with rating scales, observations, and interviews the most common methods identified. Limitations of current practices will be discussed. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 583–597, 2003.     

Working Memory and Reading Difficulties: What We Know and What We Don’t Know About the Relationship

This paper examines the role of Working Memory (WM) in developmental reading problems, considering: 1) The operationalization of WM; 2) The unique contribution of WM to reading; 3) Domain-general or -specific explanations of decoding and reading comprehension deficits; and 4) The capacity of WM constructs to distinguish between reading disabilities and attention-deficit/hyperactivity disorder (ADHD). It is concluded that: 1) Significant problems operationalizing working memory measures remain; 2) No clear unique role for WM is evident in longitudinal studies of reading acquisition; 3) Existing evidence concerning the domain-specificity or generality of WM problems is hard to interpret given problems in identification and sampling of poor readers and operationalization of WM constructs; 4) Further work is required to specify the nature of WM problems in samples of poor readers, as distinct from other co-occurring problems such as ADHD. Additional research is suggested to address these issues more fully.     

Examining increased flexibility in assessment formats

There have been calls in the literature for changes to assessment practices in higher education, to increase flexibility and give learners more control over the assessment process. This article explores the possibilities of allowing student choice in the format used to present their work, as a starting point for changing assessment, based on recent studies and current examples of flexible assessment practice in higher education. The benefits of this flexible assessment format approach are highlighted, along with a discussion of classic assessment considerations such as validity, reliability and marking concerns. The role of technology in facilitating assessment method choice is considered, in terms of new opportunities for providing student choice in the way they evidence their learning and present their work. Considerations for implementing flexible assessment choices into the curriculum are presented, along with a call that further research into such practice is needed to develop a comprehensive set of practical recommendations and best practice for the implementation of flexible assessment choice into the curriculum. The article should be of interest to curriculum developers and academics considering implementing changes to the assessment process to increase student ownership and control.     

Mathematics assessment scenarios for at-risk students

In this paper, we describe the work by a team of university and public school mathematics educators to design mathematics assessment tasks that are effective for students who have been identified at risk in mathematics, through their failure on a state mathematics assessment. We have developed assessment tasks that have the very best chance to elicit the most mathematical knowledge possible, but are closely tied to the school curriculum and practical enough to be administered by classroom teachers. We offer some perspectives on the need for alternative mathematics assessment for at-risk students, along with the dangers inherent in this undertaking. Some practical design considerations are discussed and examples of student responses to a mathematics assessment scenario are given. Finally, policy issues related to authentic assessment are discussed.     

Autism spectrum disorder assessment and evaluation research in 10 school psychology journals from 2007 to 2017

School psychologists are increasingly engaged in service provisions for students eligible for special education services under the eligibility category of autism, including conducting school‐based assessments and evaluations. Evaluations occur for a variety of reasons such as special education eligibility decision‐making, treatment and intervention planning, and progress monitoring. Publications in school psychology journals emphasizing autism spectrum disorder (ASD) assessment and evaluation are vital to quality training and practitioner utilization of quality practices. In the current study, researchers conducted a systematic review of publicaftions in 10 school psychology journals from 2007 to 2017 to assess the current state of ASD assessment and evaluation research in the field of school psychology. Implications for researchers, trainers, and practitioners are discussed.     

Postsecondary attention-deficit/hyperactivity disorder and deliberate practice: Study time,study quality,and self-perceptions

The current study examined study habits of postsecondary students with attention-deficit/hyperactivity disorder (ADHD) through the theoretical context of deliberate practice. The responses of participants with and without ADHD were compared on a survey of study time, study quality, and self-perceptions of study habits, as well as a measure of test anxiety. Groups were equivalent on reports of study time and time spent in other activities, percentage of classes they attend, use of conducive study environments, and planning of studying. Despite similar study behaviors, ADHD participants were more likely to feel unprepared for tests, reported significantly higher test anxiety, and had lower grade point averages. Regardless of ADHD status, the majority of study participants were not implementing deliberate practice behaviors, with the exception of class attendance, and study times fell far below recommended levels. Findings provided evidence that emulating the study behaviors of peers is not sufficient for students with ADHD to experience similar outcomes.     

Executive impairment determines ADHD medication response: implications for academic achievement

Methylphenidate (MPH) often ameliorates attention-deficit/hyperactivity disorder (ADHD) behavioral dysfunction according to indirect informant reports and rating scales. The standard of care behavioral MPH titration approach seldom includes direct neuropsychological or academic assessment data to determine treatment efficacy. Documenting "cool" executive-working memory (EWM) and "hot" self-regulation (SR) neuropsychological impairments could aid in differential diagnosis of ADHD subtypes and determining cognitive and academic MPH response. In this study, children aged 6 to 16 with ADHD inattentive type (IT; n = 19) and combined type (n = 33)/hyperactive-impulsive type (n = 4) (CT) participated in double-blind placebo-controlled MPH trials with baseline and randomized placebo, low MPH dose, and high MPH dose conditions. EWM/ SR measures and behavior ratings/classroom observations were rank ordered separately across conditions, with nonparametric randomization tests conducted to determine individual MPH response. Participants were subsequently grouped according to their level of cool EWM and hot SR circuit dysfunction. Robust cognitive and behavioral MPH response was achieved for children with significant baseline EWM/SR impairment, yet response was poor for those with adequate EWM/ SR baseline performance. Even for strong MPH responders, the best dose for neuropsychological functioning was typically lower than the best dose for behavior. Findings offer one possible explanation for why long-term academic MPH treatment gains in ADHD have not been realized. Implications for academic achievement and medication titration practices for children with behaviorally diagnosed ADHD will be discussed.