基于课程标准的学业成就评价:韦伯模式之研究

学业成就评价必须基于课程标准,这是国家对基础教育整体质量卓越的诉求。韦伯博士是美国"基于标准的评价"运动的重要代表人物,他提出了学业成就评价与课程标准保持一致性的分析维度、分析程序、分析方法等一整套一致性框架,并开发了基于网络的评价与标准一致性工具。全面深入研究韦伯模式,对我国基础教育阶段学生学业成就评价改革具有重要意义。     

Articulating the validity evidence for a science alternate assessment

Students with the most significant cognitive disabilities (SCD) are the 1% of the total student population who have a disability or multiple disabilities that significantly impact intellectual functioning and adaptive behaviors and who require individualized instruction and substantial supports. Historically, these students have received little instruction in science and the science assessments they have participated in have not included age‐appropriate science content. Guided by a theory of action for a new assessment system, an eight‐state consortium developed multidimensional alternate content standards and alternate assessments in science for students in three grade bands (3–5, 6–8, 9–12) that are linked to the Next Generation Science Standards (NGSS Lead States, 2013 ) and A Framework for K‐12 Science Education (Framework; National Research Council, 2012 ). The great variability within the population of students with SCD necessitates variability in the assessment content, which creates inherent challenges in establishing technical quality. To address this issue, a primary feature of this assessment system is the use of hypothetical cognitive models to provide a structure for variability in assessed content. System features and subsequent validity studies were guided by a theory of action that explains how the proposed claims about score interpretation and use depend on specific assumptions about the assessment, as well as precursors to the assessment. This paper describes evidence for the main claim that test scores represent what students know and can do. We present validity evidence for the assumptions about the assessment and its precursors, related to this main claim. The assessment was administered to over 21,000 students in eight states in 2015–2016. We present selected evidence from system components, procedural evidence, and validity studies. We evaluate the validity argument and demonstrate how it supports the claim about score interpretation and use.     

Considerations for Equating Alternate Assessments: Two Case Studies of Alternate Assessments Based on Alternate Achievement Standards

The development of alternate assessments for students with disabilities plays a pivotal role in state and national accountability systems. An important assumption in the use of alternate assessments in these accountability systems is that scores are comparable on different test forms across diverse groups of students over time. The use of test equating is a common way that states attempt to establish score comparability on different test forms. However, equating presents many unique, practical, and technical challenges for alternate assessments. This article provides case studies of equating for two alternate assessments in Michigan and an approach to determine whether or not equating would be preferred to not equating on these assessments. This approach is based on examining equated score and performance-level differences and investigating population invariance across subgroups of students with disabilities. Results suggest that using an equating method with these data appeared to have a minimal impact on proficiency classifications. The population invariance assumption was suspect for some subgroups and equating methods with some large potential differences observed.     

The Changing Landscape of Alternate Assessments Based on Modified Academic Achievement Standards: An Analysis of Early Adopters of AA-MASs

Several states had an assessment that they considered to be an alternate assessment based on modified academic achievement standards (AA-MAS) in place, or in development, when the April 2007 federal regulations on modified achievement standards were finalized. This article uses publicly available information collected by the National Center on Educational Outcomes to analyze changes in states' AA-MAS between 2007 and 2008. The article compares across the 2 years the number of states that had an assessment they considered to be an AA-MAS, states' participation guidelines, and the characteristics of these assessments. We also provide information about the number of students who participated in this assessment option during the 2006–07 school year. In 2007, six states (Kansas, Louisiana, Maryland, North Carolina, North Dakota, Oklahoma) either had or were in the process of developing an assessment they considered to be an AA-MAS. In 2008, California, Connecticut, and Texas also offered this assessment option. Six of the nine states that have been early implementers of the AA-MAS were states that had offered an out-of-level testing option until federal policies required that option to be phased out. Most states had fewer items on their AA-MAS than on their regular assessment. States that had participation guidelines for the AA-MAS in 2007 developed them prior to finalization of the federal regulations, and some changes between 2007 and 2008 in states' participation guidelines appear to have been made to better align the guidelines with the regulations. The characteristics of the assessments states consider to be AA-MASs are changing rapidly and will probably continue to change rapidly over the next few years as more is learned about the advantages and limitations of this assessment.     

The Multiple‐Use of Accountability Assessments: Implications for the Process of Validation

Implications of the multiple‐use of accountability assessments for the process of validation are examined. Multiple‐use refers to the simultaneous use of results from a single administration of an assessment for its intended use and for one or more additional uses. A theoretical discussion of the issues for validation which emerge from multiple‐use is provided focusing on the increased stakes that result from multiple‐use and the need to consider the interactions that may take place between multiple‐uses. To further explore this practice, an empirical study of the multiple‐use of the Education Quality and Accountability Office Grade 9 Assessment of Mathematics, a mandatory assessment administered in Ontario, Canada, is presented. Drawing on data gathered in an in‐depth case study, practices associated with two of the multiple‐uses of this assessment are considered and evidence of ways these two uses interact is presented. Given these interactions, the limitations of an argument‐based approach to validation for this instance of multiple‐use are demonstrated. Some ways that the process of validation might better address the practice of multiple‐use are suggested and areas for further investigation of this frequently occurring practice are discussed.     

学生学业成绩分析、反馈与指导系统:基于课程标准的中学生英语学习诊断性评价

改革课程评价是基础教育新一轮课程改革的重要组成部分,而且急需一个能够帮助人们形成以评价促学习理念的模式。本文介绍的“学生学业成绩分析、反馈与指导系统(SAAE)”的构建契合这一重要需求。SAAE以国家课程标准为参照标准,采用诊断性评价方法,检测初中八年级学生学业成绩发展过程。项目任务是根据检测成绩以及相关因素问卷调查数据的分析结果,给参测地区提供有益于教育教学管理、课堂教学改进和教师发展的反馈信息。这个评价系统还对提高各级教研员的教学评价能力有所帮助。本评价指标体系的建立能够为保障中学英语课程教育质量做出贡献。同时,它也是诊断性语言测试理论的有益实践。     

Teaching-for-Learning (TFL): A Model for Faculty to Advance Student Learning

In light of the widespread recognition of the enduring challenge of enhancing the learning of all students—including a growing number of students representing diverse racial, ethnic, and socioeconomic backgrounds—there has been an explosion of literature on teaching, learning, and assessment in higher education. Notwithstanding scores of promising new ideas, individual faculty in higher education need a dynamic and inclusive model to help them engage in a systematic and continuous process of exploring and testing various teaching and assessment practices to ensure the learning of their students. This paper introduces a model—Teaching-for-Learning (TFL)—developed to meet this need. Clifton F. Conrad received his bachelor’s degree in History and his master’s degree in Political Science from the University of Kansas and his Ph.D. in Higher Education from the University of Michigan. He is Professor of Higher Education at the University of Wisconsin-Madison; and his research focus is on college and university curricula with particular emphases on program quality, liberal education, and teaching and learning. Jason Johnson received his bachelor’s degree in Comparative History of Ideas and his master’s degree in Educational Leadership and Policy Studies at the University of Washington. He is nearing completion of his Ph.D. and working as a Teaching Assistant in Higher Education at the University of Wisconsin-Madison, and his research focuses on rhetoric in higher education. Divya Malik Gupta received her bachelor’s and master’s degrees in Human Development and Family Studies from Maharaja Sayajirao University in Gujarat, India. She is currently a Ph.D. student at the University of Wisconsin-Madison.     

融合教育背景下特殊需要幼儿发展评估的特点及趋势——基于美国加利福尼亚州预期发展结果档案的分析

随着特殊教育政策重点转移以及融合教育的发展,特殊需要幼儿评估逐渐由诊断性评估转向发展性评估。在这一背景下形成的美国加利福尼亚州幼儿发展评估工具以进程监控为目的,通过多元动态的方式评估特殊需要幼儿关键领域能力的发展。在评估目的、内容、方式和人员方面各具特点,体现出融合教育背景下特殊需要幼儿发展评估的趋势:监控特殊需要幼儿的进步与发展;多元动态评估方式;评估与教育(干预)实践相结合。     

Validation of the Wider Outcomes Survey for Teachers (WOST): a measure for assessing the behaviour,relationships and exposure to bullying of children and young people with special educational needs and disabilities (SEND)

The Wider Outcomes Survey for Teachers (WOST) is a teacher informant‐report questionnaire developed to aid the assessment of behaviour difficulties, quality of relationships and exposure to bullying among students identified with special educational needs and disabilities (SEND). This study examines the psychometric properties of the WOST in a validation sample representing 6164 students with SEND (mean age 12 years) drawn from 481 primary and secondary schools across England. Results showed favourable internal consistency using Cronbach's alpha and acceptable model fit using confirmatory factor analysis, both of which were invariant to broad categorisations of SEND. Practical utility and construct validity were also established by testing two theoretically derived hypotheses. The measure is therefore tentatively supported as a useful tool for assessing the wider outcomes of students with SEND.     

1:1 (Dis)section ‐ Learning through Full‐Scale Dissection and Transformations of Abandoned Buildings

The section is an essential tool for understanding, exploring, representing and communicating spatial relations, structure and materiality in architecture, design and engineering, and therefore a recurring topic in the curricula. The section itself is destructive of nature and incompatible with a built environment in use or under construction. Hence, students throughout their education meet the section in the form of diagrammatic representations, that is, as forms of meaning emptied from scale, spatiality and materiality. This article reports on a series of four workshops, held in the spring semesters from 2011 to 2014 for first‐year students at Aarhus School of Architecture. The aim was to provide first‐year students with an experience of the relation between the section as a diagrammatic representation and the materiality, structure and spatial relations of a concrete building. The climax of each workshop was a full‐scale dissection and transformation of an abandoned house. As we shall see, the workshops fulfilled not only the intended learning goals, but created an initially unforeseen and unique context for learning about the relations between building and place and introduced the question regarding depopulation of rural areas as a pertinent processional challenge. Beyond an educational value, the research project ‘Transformation on abandonment, a new critical practice?’ transpired from the workshops. This research project and the interplay between teaching and research are discussed in the last part of the article.     

The Need and Use of Process Recording in Policy Practice: A Learning and Assessment Tool for Macro Practice

This article proposes the use of a structured process recording format for policy practice students, field instructors, and social work faculty as a learning, teaching, and assessment tool. Traditionally, casework and group work have used process recording to facilitate students learning in the field practicum to assess both the process and content of student‐client interactions. Since policy practice is concerned with achieving a preferred course of action to shape policies and interactions affecting large numbers of people, process recordings offer a method to assess tasks, competency skills, and learning needs while examining process and conscious use of self in action.     

A Guided Problem‐Based Learning (PBL) Approach: Impact on Critical Thinking

The impact of the Guided Problem Based Learning (Guided PBL) approach on Critical Thinking (CT) skills in a core business analysis course was examined. The implementation of this approach included using a textbook created for this purpose, which presents problems first, with blank spaces for students to work them out. Discussion of the concepts and theory needed to understand and solve the problems, as well as the solutions, come later in the book. This book is referred to as the Reversed Textbook. Students attempt to answer questions or solve problems in class with instructor guidance as needed, before discussion of theory. Student learning in sections taught prior to implementing the Guided PBL method was compared with student learning in sections taught with the method. Results indicate that the approach motivated learning and improved student performance on a departmental final exam by an average of 9%. When measured on CT questions alone, the improvement was on average 24%. Finally, the Guided PBL approach also improved group task performance by 6%. All the improvements were statistically significant.     

面向教师的美国国家教育技术标准新旧版对比研究

继2007年美国国际教育技术协会(ISTE)颁布面向学生的国家教育技术标准(NETS·S)第二版之后,2008年6月,ISTE在全美教育信息化年会上正式发布了面向教师的国家教育技术标准(NETS·T)的第二版.本文就NETS·T新旧两版的能力维度和绩效指标进行了对比研究,并就新版NETS·T出台的内在动因和外部条件及其对我国教师教育技术能力标准建设乃至教育信息化的价值与意义进行了探讨.     

Mindfulness‐Based Design Practice (MBDP): A Novel Learning Framework in Support of Designers within Twenty‐First‐Century Higher Education

While the interconnected and technological nature of the twenty‐first century can bring about many positive global connections, the importance of prioritising the development of the ‘inner world’ of designers is receiving less attention; similarly, time for contemplation, reflection and stillness is becoming scarcer. This article discusses mindfulness training from the Buddhist perspective, and how it can act as a pathway to personal introspection and as a supportive method for mental illnesses. With a special focus on design education, it discusses a novel framework, Mindfulness‐Based Design Practice (MBDP), and how it can potentially offer opportunities for design students to foster positive mind qualities such as mindfulness, compassion, resilience, and recognising the true nature of phenomena for becoming more ethical designers. Therefore, this article looks to bridge the gap between the significant lack of contemplative mindfulness‐based methods within the higher design education sector and the increasing mental health crisis within that sector. Thus, the primary concern of the MBDP is to advance both the individual and the collective development of the contemporary designer’s mind. Referring to the mind of the designer as the ‘inner designer’, this article forms an unfolding dialogue of the novel framework MBDP in support of mindful learning within twenty‐first‐century design education.     

基于资源学习的专门用途英语网络教育探讨——以《旅游英语》课程为例

网络环境下的专门用途英语外语教学发生了巨大的变化。如何有效利用网络学习资源开展专门用途英语教学,如何整合资源架构有效的知识平台成为语言学者及外语教师关注的问题。     

History and the study of ‘administration’ (LAMPS) in education: a reflection on an editorial for a special issue

The special edition of JEAH published in August 2006 on ‘Administration and Leadership in Education: A Case for History?’ argued that history has been seriously undervalued in the study of administration and leadership in education. My introductory editorial explained why this mattered and outlined the framework in which the papers it contained were set. It then examined the concepts of administration and leadership in education and considered them as a field (or fields) of knowledge. In an exploration of how knowledge is produced, it discussed history as a form of knowledge and considered the contribution it could make to the study of the field. This was followed by a review of what was asked of the contributors and their response. The editorial concluded with ideas for future work. At the request of the new editors of the journal, this paper is a revised and extended version of my earlier editorial. Some aspects have been shortened (e.g., the review of contributions), others extended (e.g., views on history and its role), and some new material has been added (e.g., a discussion of the history of the field in the UK as represented in attempts to review the field since George Baron’s ground‐breaking keynote given at the first research conference of the British Educational Administration Society held in Birmingham in 1979).     

美国中学实施混合学习的特点与启示——基于《在学校层面实施混合学习的路线图》的分析

为顺应疫情防控常态化,我国中学阶段实施混合学习,成为复学后的新型学习方式。美国在混合学习研究与实践领域具有很强的影响,国际K-12在线学习协会与纽约市实验学校合作实施混合学习,并制定了《在学校层面实施混合学习的路线图》,提出了实施混合学习的六个要素:领导力、专业发展、教学、运营、内容、技术,设计了混合学习质量的评估原则。美国中学实施混合学习体现出突出特点:中学领导定期视察实施混合学习状况,及时交流反馈;多维度制订实施混合学习计划,不同阶段任务明确具体;强调混合学习中的个性化学习,培养学生自主学习能力;实行跨校合作,多校协同推进实施混合学习。对我国中学实施混合学习的启示:提升校长信息化领导力,统筹混合学习的规划与发展;提高教师技术与资源应用能力,发挥混合学习引导者的作用;提升学生信息素养,发挥混合学习的主体性;实现资源普及与共享,优化混合学习的环境;因地制宜,采取差异化的方式进行评估。     

Validity evidence for the Experiences of Teaching and Learning Questionnaire (ETLQ) in evaluations of quality learning: A systematic critical literature review

The use of the Experiences of Teaching & Learning Questionnaire (ETLQ) for the evaluation of learning quality in higher education has been expanding during the last decade, thus a review of the instrument’s validity evidence is warranted. The design of the study was a systematic critical literature review. We evaluated the strength of the validity evidence of 17 included studies with a quality appraisal framework reflecting current standards for educational testing. The evidence supporting the central validity assumptions of the ETLQ scales is currently weak to moderate and incomplete. Thus, caution against the uncritical use of ETQL scores for high-stakes educational decisions is warranted. The appraisal framework used was useful for creating an overview of the evidence. However, attention to more general aspects of study quality, and consensus deliberations with three to four raters was also important for sufficiently reliable appraisal of the evidence.     

国外教育研究方法的应用特征--基于2000-2019年34本教育学SSCI收录期刊的文献计量分析

以2000-2019年间34本教育学SSCI收录期刊发表的学术论文为研究对象,对国外教育研究方法的应用特征进行文献计量分析,结果发现,21世纪以来,国外教育研究方法的应用基本形成了以定量研究为主、质性研究紧随其后、混合研究占有一席之地的格局;因研究议题和学术共同体偏好的差异,具体方法的应用在教育研究的不同领域呈现不同样态;"方法从之于问题"的实用主义导向不断驱动国外教育研究方法应用的多样化。     

基于灰色关联度与TOPSIS法的养老机构评价模型分析——以合肥市为例

随着老龄化趋势加重,社会对养老机构的需求不断增加,养老机构的选择成为一个核心问题。文章在分析养老机构影响因素的基础上,构建了养老机构评价指标体系,并利用灰色关联度与TOPSIS相结合的方法,建立了养老机构评价模型。以合肥市8家养老机构为例进行模型验证,结果表明,利用模型能够选择出综合条件最优的养老机构,并且灰色关联度法与TOPSIS法联合使用比两种方法单独使用评价结果更准确可靠。