Assessment practices of professionals serving students who are deaf or hard of hearing: an initial investigation

Assessment currently plays a critical role in American schools and society, in tasks ranging from ranking schools' effectiveness, to determining individual placement, to planning instruction. The purpose of the study was to gather data about the formal and informal assessment instruments and processes used by professionals in deaf education. Respondents indicated that statewide annual assessments are the most frequently used measures, followed by the Stanford Achievement Test series and the Woodcock-Johnson III Test of Achievement. Commonly used assessment instruments and procedures for each academic area are reported in rank order. Issues about current practices are raised, and suggestions for additional research related to assessment practices in deaf education are provided.     

The impact of sub-skills and item content on students’ skills with regard to the control-of-variables strategy

The so-called control-of-variables strategy (CVS) incorporates the important scientific reasoning skills of designing controlled experiments and interpreting experimental outcomes. As CVS is a prominent component of science standards appropriate assessment instruments are required to measure these scientific reasoning skills and to evaluate the impact of instruction on CVS development. A detailed review of existing CVS instruments suggests that they utilize different, and only a few of the four, critical CVS sub-skills in the item development. This study presents a new CVS assessment instrument (CVS Inventory, CVSI) and investigates the validity of student measures derived from this instrument utilizing Rasch analyses. The results indicate that the CVSI produces reliable and valid student measures with regard to CVS. Furthermore, the results show that the item difficulty depends on the CVS sub-skills utilized in item development, but not on the item content. Accordingly, previous instruments that are restricted to a few CVS sub-skills tend to over- or underestimate students’ CVS skills. In addition, these results indicate that students are able to use CVS as a domain general strategy in multiple content areas. Consequences for science instruction and assessment are discussed.     

A National Survey of Assessment Instruments Taught by Counselor Educators

This study reports results of a questionnaire of 210 counselor educators regarding assessment instruments covered in their assessment courses. Instruments are ranked on how extensively they are covered, and comparisons of coverage are made by assessment category (e.g., educational, clinical) and by instructor and program characteristic (e.g., Council for Accreditation of Counseling and Related Educational Programs [CACREP] vs. non‐CACREP). Suggestions regarding which assessment techniques to cover in a basic counselor education testing and assessment course are made.     

Models and measures of learning outcomes for non-technical skills in simulation-based medical education: Findings from an integrated scoping review of research and content analysis of curricular learning objectives

Simulations are increasingly used to enhance ‘non-technical’ skills (NTS) in medical education but little is known about the effectiveness of many simulations. The field lacks robust outcome measures and there is lack of clarity about educationally relevant conceptual and operational dimensions of NTS to support instrument development and testing. Our study addresses this dual gap through a multi-component design focusing on three key NTS: interprofessional teamwork, communication and decision-making. A Scoping Review (ScR) was utilised to synthesise instruments used in recent publications on medical/clinical simulations targeting NTS. Full-text analysis identified a sub-set of robust instruments for further analysis. Systematic qualitative content analysis of learning objectives (LOs) in UK medical education curricula identified and synthesised the conceptual dimensions underlying NTS. Finally, identified measures’ dimensions were systematically compared with the dimensions of curricular LOs to establish the extent to which instruments used in current SBL-research address desired learning goals, and to identify relevant measures and gaps. The ScR identified 225 studies from 2018−20 of which 72 met the inclusion criteria. 31/72 studies referred to a named instrument in their abstract, including 27 unique instruments. The curriculum analysis identified a set of key conceptual dimensions of each of the target NTS. Finally, comparative analysis found that while the outcome measures used in the SBL-studies addressed many of the identified curricular LO-dimensions, there are significant gaps, notably relating to evidence use and inclusive practice. Moreover, it revealed there is little conceptual overlap between the instruments, highlighting the need for further research to ensure comparability of different studies. This study contributes to our understanding and evaluation of learning outcomes in, and our readiness to generate a rigorous evidence base for, NTS-focused SBL, by describing conceptual and operational constructs of NTS-learning outcomes in medical education and identifying appropriate validated assessment instruments to evaluate SBL.     

Stress in school-aged children and youth

This article reviews the literature on stress in students of grades 1–12. A model to understand stress as the inequality between perceived demands and perceived resources is presented. Student stressors are identified in the family and school environments. Coping with these stressors is conceptualized as problem-focused, emotion-focused, or appraisal-focused strategies that make use of personal, social, and cognitive resources. Physical, emotional, and behavioral symptoms of ineffectual coping efforts are then identified. After gender differences in stressors and coping are noted, instruments measuring stressors, coping strategies, and coping resources in children and youth are reviewed. Finally, representative intervention programs developed for school-aged youth are described and evidence of their efficacy is presented. The article concludes that there is a paucity of research on stress in children as compared to research on stress in adults.     

北京市属高校仪器设备共享机制探索

促进市属高校大型仪器设备开放共享,必须解决其中的几个关键的瓶颈性问题,包括理念上、体制上、机制上、管理上的以及经费上的问题。通过建立开放实验室、配备完善的开放共享网络化信息管理平台及高素质的专业实验技术队伍来保障大型仪器设备的开放共享;设立大型仪器设备开放维修基金,维持开放实验室的开放运行;配套成立大型仪器设备开放共享管理委员会,加强设备购置论证、合理配置大型仪器设备资源,并以科学规范大型仪器设备的效益评价体系来鼓励和督促大型仪器设备开放共享等,是促进北京市属高校大型仪器设备的开放使用的有效措施。     

Assessment of Children's Social Skills: Recent Developments,Best Practices,and New Directions

This article provides an overview of some of the recent developments in assessing social skills of children and youth, as well as a discussion of "best practices" in conducting assessment and linking assessment to effective intervention. Naturalistic behavioral observation and behavior rating scales are proposed as the 2 assessment methods that should be considered primary or "first-line" choices for social skills assessment. A review of some specific tools that have been developed within these 2 assessment methods is provided. Interviewing and sociometric techniques, although not necessarily primary methods of assessment for children's social skills, sometimes may be an important part of an assessment design, or "second-line" choices. Projective-expressive techniques or objective self-report instruments for assessing children's social skills sometimes may help illuminate the overall assessment results but should never be used as primary assessment methods for social skills; thus, these methods are considered "third-line" methods for this purpose. Six best-practices recommendations, all of which are supported by previous empirical research, are offered for improving social skills assessment efforts. Finally, conclusions are drawn regarding the current state of the art in social skills assessment, as well as implications for future directions in this area. Clearly, the challenge facing researchers and practitioners who are concerned with this area will be to make assessment "functional" and link it to intervention more effectively.     

Disseminating Standards in Higher Order Learning: Systemically Valid Instruments for Standards-Based Education Reform

A decade of British experience in assessing and reporting higher order learning using a scale of national standards has important lessons for countries currently embarking on programmes of standards-based education reform. The architects of the British National Curriculum envisaged that the reliability of measures of higher order learning could be assured through a comprehensive auditing programme involving expert teachers. However, plans for a national auditing programme in Britain were never realised for financial reasons. This article argues that, in the absence of orthodox auditing procedures, modern information handling techniques have an important role to play in enhancing the technical fidelity of instruments for measuring higher order learning, by making the combined professional wisdom of experienced teachers available to the assessor at the time of marking. The higher order skill of creative writing is used to illustrate the calibration of a systemically valid computerised assessment tool, applicable to any standards-based assessment framework.     

Autism Spectrum Disorders: Neurobiology and current assessment practices

This study reviews recent research related to the neurobiology of Autism Spectrum Disorders (ASDs) an provides an empirical analysis of current assessment practices. Data were collected through a survey of 117 school psychologists. The Childhood Autism Rating Scale (CARS), Gilliam Autism Rating Scale (GARS), and Gilliam Asperger's Disorder Scale (GADS) were the most frequently used measures. Among the less popular, but more intensive instruments, the Autism Diagnostic Observation Schedule (ADOS) appears to be gaining popularity within school‐based evaluations. Generally, respondents approached the assessment of ASDs from a traditional psychoeducational perspective and reported the use of a very narrow range of ASD‐specific instruments. Concerns are raised regarding the inconsistent inclusion of developmental questionnaires, parent/guardian interviews, and medical professionals in the ASD evaluation process. Implications for practice and the training of school psychologists are discussed. © 2008 Wiley Periodicals, Inc.     

Assessing Quality in Early Childhood Education and Care

Evaluating quality in early childhood education and care (ECEC) service internationally is increasingly important. Research to date indicates that it is ‘high-quality’ programmes that boost and sustain children's achievement outcomes over time. There is also growing interest in the accountability of public funds used for ECEC programmes and the types of measures that assess ECEC quality. This article reviews eleven existing instruments that were designed to assess global ECEC programmes and examines them in terms of their strengths and weaknesses as quality measurement tools and the adequacy of the measures to sufficiently reflect the context and purposes of the assessment. Through this process the authors identify directions for the development of new measures that are both theoretically and psychometrically sound.     

Critical review of the TEMAS: A step within the development of thematic apperception instruments

The TEMAS (acronym for Tell‐Me‐a‐Story)—an objectively scored, projective thematic personality instrument for children and adolescents—is analyzed, reviewed, and critiqued with regard to theoretical underpinnings and rationale for development, administration, scoring, psychometric properties, and research to date. The TEMAS appears to be an improvement over existing projective personality measures used by school psychologists. Although it requires more training than other projective techniques, competency in administration, scoring, and interpretation can be achieved within a one semester course in personality assessment. The test has evidence of reliability and validity, and it is a multicultural alternative to the TAT and other thematic apperception instruments. The use of the TEMAS by psychologists may achieve more accurate assessment of Black and Hispanic children. Limitations include geographically limited standardization samples and little research conducted by individuals other than the authors. © 1999 John Wiley & Sons, Inc.     

Exploring the boundaries: A study of multiple classroom learning environments

The study of learning environments has developed into a productive field of research in science education. Initially, the design and application of classroom perceptual measures of particular dimensions of science classrooms attracted much attention. More recently, such instruments have been used alongside of qualitative techniques to provide a richer understanding of sub-environments. We continue this trend in the present interpretive study by exploring the nature of multiple environments within a middle school classroom from the different perspectives of teacher, student and participant observer. In particular, we examine the activity settings of lectures and group work, as well as the issues of learning and assessment. We conclude by arguing that teachers need to adopt procedures that enable them to identify and plan for multiple environments.     

Cross-cultural instrument translation: assessment, translation, and statistical applications

This article has four major sections: (a) general issues of assessment; (b) assessment of ethnic-group members, including those who are deaf; (c) translation of assessment tools, emphasizing translation into American Sign Language (ASL); and (d) statistical applications for translated instruments. The purpose of the article is to provide insight into and guidelines for translating instruments into another language and using the results for practice or research purposes. The use of translated instruments with deaf individuals is highlighted. A protocol for translating a scale into ASL is offered. Statistical applications for examining internal consistency and component structure are discussed. Finally, implications for practice and research are addressed.     

Approaches to measuring use of research evidence in K-12 settings: A systematic review

An increased focus on the use of research evidence (URE) in K-12 education has led to a proliferation of instruments measuring URE in K-12 education settings. However, to date, there has been no review of these measures to inform education researchers’ assessment of URE. Here, we systematically review published quantitative measurement instruments in K-12 education. Findings suggest that instruments broadly assess user characteristics, environmental characteristics, and implementation and practices. In reviewing instrument quality, we found that studies infrequently report reliability, validity, and demographics about the instruments they develop or use. Future work evaluating and developing instruments should explore environmental characteristics that affect URE, generate items that match up with URE theory, and follow standards for establishing instrument reliability and validity.     

Assessment and intervention practices with second‐language learners among school psychologists

This paper describes assessment and intervention practices with second‐language learners among practicing school psychologists in one southwestern state. A 10‐item survey was used to gain information about the assessment instruments and procedures and intervention practices used with linguistically different children by school psychologists. Surveys were mailed to all members of the state professional organization. Thirty‐three percent of the surveys were returned and considered usable for analyses. An analysis of the returned surveys revealed that a number of school psychologists are using alternative assessment techniques, such as curriculum‐based measurement, dynamic assessment, and portfolio assessment with this population. The majority, however, continue to use traditional cognitive tests, such as the Weschler Scales, and traditional interventions, such as resource room service delivery. Results of the survey are discussed in terms of best practices with linguistically different children. © 2000 John Wiley & Sons, Inc.     

Assessing Children’s Social Functioning and Reading Proficiency: A Systematic Review of the Quality of Educational Assessment Instruments Used in Norwegian Elementary Schools

Social functioning and reading proficiency are critical for success in school and society. Therefore, identifying children with such problems is important. This study had 2 parts: first, a random sample of 234 elementary schools was surveyed about which instruments they use to assess reading proficiency and social functioning. Second, a systematic review of the quality of these instruments was conducted using international standards for examining the quality of assessment instruments. The survey showed that schools more often assessed and had more instruments available for reading than for social functioning. The systematic review of the assessment instruments used revealed that the psychometric qualities of many was weak or undocumented, while the dimensions of test material quality were generally good. The findings demonstrate a need for a more thorough examination of the psychometric properties of assessment instruments to be used in school.     

Coping strategies at the ages 8, 10 and 12

The aim of the cross-sectional study was to reveal what coping strategies 8, 10- and 12-year-old Hungarian students (N?=?167) use in situations that are frustrating, either for themselves or their peers. The coping strategies in school situations were assessed by our own questionnaires. The instrument enables the investigation of the following behaviourally observable strategies: physical aggression, verbal aggression, resistance, venting/crying, avoidance, teacher-seeking, peer-seeking, following the norms and following teacher’s instructions. The coping strategies were assessed by teacher-report and self-report questionnaires developed especially for this purpose. The most important finding of this study is that the occurrence of overt aggression increases with age, which is supported by the results of both the self-report and the teacher-report questionnaires. Results obtained by the self-report and teacher-report instruments correlated significantly in all three cohorts (p?相似文献   

提高院级实验中心大型仪器使用效益的实践与探索

分析了当代中国高校院级实验中心大型仪器设备管理存在的问题;以天津科技大学包装工程实验中心为例,从大型仪器的采购计划、管理平台建设、制度建设、实验技术队伍建设、考核体系等方面提出了提高院级实验中心大型仪器使用效益的几点措施;并简述了该措施产生的效益。     

Classroom management and teachers’ coping strategies: Inside classrooms in Australia, China and Israel

This paper discusses the degree to which recently reported relationships between the classroom management techniques and coping styles of Australian teachers apply in two other national settings: China and Israel. Little is known about which teacher characteristics relate to their approach to classroom management, although researchers in Australia have recently found that teachers’ coping styles appear to predict the management techniques they utilize in classrooms. In this study, 772 teachers from a range of schools in Australia, China, and Israel completed questionnaires asking how frequently they use six classroom management techniques—hinting, discussion, involvement, recognition and reward, punishment, and aggression—and how often they use a range of coping behaviours. The analysis showed that some of the Australian findings were replicated only in Israel and others only in China, revealing national variations in the links between management techniques and coping styles, which have wider implications for investigations in this area. The implications of these findings are discussed, as are their potential ramifications for future research.     

Data Collection Strategies and Measurement Tools for Assessing Academic and Therapeutic Outcomes in Recovery Schools

Accurate evaluation and documentation of the efficacy of recovery schools can be vital to the continuation and expansion of these beneficial resources. A very limited data set currently exists that examines the value of specific schools established to support adolescents and young adults in recovery; additional research is necessary. The following article outlines the methodology utilized in a current quasi-experimental study evaluating both academic and therapeutic outcomes of adolescents attending recovery high schools as compared to traditional (non-recovery-based) high schools. The developmental considerations in assessing adolescents in recovery and their parents is delineated in this article, which underscores the need for extensive knowledge of adolescent substance abuse and other mental health issues. In addition, sensitivity around privacy among adolescents, parents, schools, and health providers is highlighted, as well as the validity of assessment. Key assessment strategies, including protocol of recruitment and interviewing techniques, are also presented along with a list of parent and adolescent assessment instruments and their corresponding interpretive variables. Protocol recommendations for future research are also outlined.