过程性评价对学生学业成绩影响研究——基于63项实证研究的元分析

随着基础教育评价改革的全面深化,过程性评价受到越来越多的重视,然而有关过程性评价对学生学业成绩的实际影响如何仍存在不同看法。为深入探究过程性评价对学习效果的影响,采用元分析方法对已有63项相关主题的实验和准实验研究进行系统定量分析。结果显示,随机效应模型得到的合并效应值为0.964,表明过程性评价对提高学生学业成绩具有显著的正面影响;此外,不同国别、学科、学段和评价方式对学业成绩的影响存在显著差异,不同实验时长的影响差异不显著。今后应注重过程性评价在课堂教学中的有效实施策略,加强对教师和学生评价素养的培养,以推动过程性评价在教育实践中的广泛应用。     

智适应学习系统的学习效果及其影响因素研究 ——基于2000—2020年60项实验与准实验研究的元分析

智适应学习系统究竟是否会对学习效果产生积极影响?哪些关键因素会影响智适应学习系统的学习效果?研究采用量化元分析的方法,对近20年来国际上有关智适应学习系统的学习效果的60项实验与准实验研究进行分析和评价.研究发现:(1)智适应学习系统提升学习效果的综合效应值为0.560,即智适应学习系统对学习具有中等程度的正向促进作用...     

基础教育阶段网络作业与在线考试的现状分析

在国家层面,把教育信息化纳入国家信息化发展整体战略、基本建成覆盖城乡各级各类学校的数字化教育服务体系,是本次<国家中长期教育改革和发展规划纲要>的改革创新点.网络作业与在线考试的技术与实施正是教育信息化进程中的一个组成部分.基于此,本文结合课题研究和有关调研,就网络作业与在线考试的技术与实施的研究现状做些分析,提出存在的主要问题,并就实施中需要注意的问题提供一定的参考.     

新时代教育考试评价改革的理路与实践——基于社会文化响应性评价理论的启示

如何提升教育评价尤其是标准化考试的科学性与有效性、设计指向核心素养的考试评价,是新时代背景下教育评价改革面临的重点与难点问题。当前标准化考试面临诸多困境,包括难以考查学生核心素养、应试导向加剧等。为解决上述问题,社会文化响应性评价提出应依据学生的社会文化特征为学生设计更加科学、有效、公平的评价,明确文化背景相关性、呈现与表达多样性、深入学习指导性、个体特征适应性、结果分析交互性等五大实践原则。文章着重阐述社会文化响应性评价的内容特征与实践原则,并依据这一理论对我国新时代教育考试评价改革提出建议。     

基于WEB的高等数学在线考试系统的分析与设计

高等数学是大学生必修的重要基础课．提高高等数学教学效果有着非常深刻的意义。本文详细阐述了基于WEB的高等数学在线考试系统的分析思路和设计思想．为系统的开发提供了有力的理论依据。     

基于网络的形成性考核与终结性考试研究

中央广播电视大学基于网络的课程考核,从2005年试点以来,规模不断扩大,其所采用的形成性考核与终结性考试一体化设计,考核方法、效果与以往的传统考核存在一定差异。我们采用线性回归的方法研究了形成性考核和终结性考试成绩之间的关系,发现基于网络的形成性考核和终结性考试成绩之间存在正相关关系,并且与传统的考核方式有着相同的规律性和有效性。     

我国开放大学学历教育课程考试改革的趋势——基于政策文本的分析

从政策文本分析的视角出发,运用质性研究软件Nvivo11对我国开放大学考试改革的相关政策文本进行研究。结果显示:发挥考试评价的功效、保障人才培养的质量、满足利益相关者的需求是我国开放大学考试改革的目标追求;由终结到过程、由纸笔到网络、由知识到能力、由常规到预约、由单一到多元是我国开放大学考试改革的主要趋势。进一步思考得出:统筹不同利益相关者的诉求,遵循学科发展逻辑,与现代信息技术深度融合,提升质量与特色是我国开放大学考试改革的重要基点,也将有助于厘清我国开放大学考试改革的目标与趋势。     

开放教育终结性考试的调查与分析

采用定量分析法、问卷法以及实地调查法等,考察了江苏电大开放教育省管课程终结性考试的相关情况。结果表明,从目前的实际情况看,省管课程终结性考试的质量在总体上是值得肯定的,但在试卷质量等方面尚有提高和改进之处。分析认为,要进一步提高试卷和命题的科学性,关注成人学习的特殊性,注意与形成性考核的相关性,以充分发挥终结性考试在保证开放教育教学质量中的重要作用。     

形成性网络考试与大学英语自我调节学习——不同成绩报道形式对自我调节学习的影响

项目研究基于网络考试中的形成性评价与反馈机制,设计出一种新型大学英语网考成绩报道单,既告知考生总分,又提供各题型的分数和百分位,以及相应的自我调节策略反馈。新的成绩报道形式以结构方程模型分析得出的认知调节策略使用与各题型成绩间的关系为基础,辅之以定性访谈分析为补充。结果表明,新型网考成绩报道形式较之传统的总分报道形式能更有效地促进学生的英语自我调节学习。     

Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020

Education and Information Technologies - As online learning has been widely adopted in higher education in recent years, artificial intelligence (AI) has brought new ways for improving instruction...     

Learning from failure: a meta-analysis of the empirical studies

The authors searched five scholarly databases for a decade of research publications examining learning from failure as an instructional strategy. Out of 187 publications, 62 were found to be relevant to the topic from which only 12 used experimental design to examine the issue and reported statistics appropriate for meta-analysis. The studies also represented only two of our search domains-productive failure and failure-driven memory. The small number of experimental studies on this topic is a telling indication of the state of experimental research in this area. However, they revealed a moderately positive result for the effect of learning from failure. An examination of moderating variables indicated that participants’ grade level, subject matter domain, and study’s duration, while not significant in explaining the differences across the examined studies, showed positive medium effect sizes. Instructional design implications of our findings and limitations of the study are discussed.     

The equivalence of online and traditional testing for different subpopulations and item types

A trial of pen‐and‐paper and online modes of a computing skills test was conducted for volunteer students of ages 15–16 in New South Wales, Australia. The tests comprised Matching, True/False and 4‐option Multiple‐Choice items. The aims were to determine whether gender, socioeconomic status (SES), or the type of item interacted with testing mode. No interactions were found for gender and item type, but the SES interaction was statistically significant. For low SES students, the online mode mean was 1 percent lower than the pen‐and‐paper mean, whereas high SES students had near equivalent means. These findings should be treated with caution as the groups in the study were self‐selected, rather than random samples from the student population.     

从高考评价体系管窥2020年北京物理高考——以“四层”视角为例

中国高考评价体系的“四层”包括:核心价值、科学素养、关键能力、必备知识,把握四层的涵义能高效引导课堂教学.2020年北京新高考改革,物理学科变为“学业水平等级性考试”,试题紧密围绕四个层次的要求进行命题,极佳地体现了等级划分能力,充分落实了课程标准的各项要求以及高校人才选拔要求,取得了北京新高考改革的“开门红”.     

A meta-analysis on the relationship between school characteristics and student outcomes in science and maths – evidence from large-scale studies

ABSTRACT

In the present meta-analysis, we examine how secondary school characteristics – such as schools’ academic press, school climate, material resources, personnel resources, classroom climate, instructional practices, out-of-school activities, and socioeconomic status (SES) composition – provide opportunities for students to engage in science and maths, and how these matter with regard to students’ cognitive and motivational-affective outcomes. The meta-analysis includes 71 (international) articles from large-scale studies with a total of 3,960,281 students, 260,390 schools, and 285 effect sizes that were transformed to correlation coefficients. Multilevel meta-analyses were performed. Results identified a number of school variables that can be regarded as relevant for making a difference in student outcomes and at the same time be influenced by education. These refer to school variables such schools’ academic press, classroom climate, instructional practices, and out-of-school activities. Moreover, SES composition was significantly related to student outcomes. Material and personnel resources as well as school climate yielded a close to zero effect. No differences were found between cognitive and motivational-affective outcome variables or between science and maths. The results point to the most promising school characteristics for promoting students’ outcomes and emphasise schools’ potential for students’ engagement in science and maths.     

An examination of the relationship between technology problems and teaching evaluation of online instruction

To address faculty members' concern that teaching evaluation in the online environment might be lowered because of technology problems students experience in online courses, a sample of 202 undergraduate students enrolled in an introductory statistics course in a college of business administration was surveyed. Students' evaluation of their instructors and the course and their experiences with technology problems when taking the course were measured. As expected, a negative correlation between teaching evaluation and experience of technology problems was observed. Based on the finding, it is suggested that, to encourage faculty members to teach online, universities need to examine the relationship between teaching evaluation and technology problems experienced by students in the online environment and adjust the evaluation skewed by problems that are out of instructors' control. Measurement instruments used in the study and a suggested formula for adjusting teaching evaluation are provided.     

Effects of online peer assessment on higher-order thinking: A meta-analysis

Online peer assessment (OPA) has been increasingly adopted to develop students' higher-order thinking (HOT). However, there has not been a synthesis of research findings on its effects. To fill this gap, 17 papers (published from 2000 to 2022) that reported either a comparison between a group using OPA (n = 7; k = 22) and a control group or a pre–post comparison (n = 10; k = 17) were reviewed in this meta-analysis. The overall effect of OPA on HOT was significant (g = 0.76). Furthermore, OPA exerted more significant effects on convergent HOT (eg, critical thinking, reasoning and reflective thinking; g = 0.97) than on divergent HOT (eg, creativity and problem-solving; g = 0.38). Reciprocal roles and anonymity were found to positively moderate the impacts of OPA on HOT, although their moderating effects were not statistically significant because of small sample size of studies in the analysis. The results of the meta-analysis reinforce the arguments for regarding OPA as a powerful learning tool to facilitate students' HOT development and reveal important factors that should be considered when adopting OPA to enhance students' HOT.

Practitioner notes

What is already known about this topic

• Online peer assessment (OPA) has significant positive impacts on learning achievement.
• OPA has been regarded as a potential approach to cultivating students' higher-order thinking (HOT) but has not been proved by meta-analysis.
• OPA should be carefully designed to maximise its effectiveness on learning.

What this paper adds

• OPA has been proved to significantly positively influence students' HOT via meta-analysis.
• OPA exerted more significant effects on convergent HOT than on divergent HOT.
• The potential of reciprocal roles and anonymity for moderating the impacts of OPA on HOT should not be underestimated.

Implications for practice and/or policy

• OPA could be a wise choice for practitioners when they help students to achieve a balanced development of HOT dispositions and skills.
• Students' divergent HOT can be encouraged in their uptake of peer feedback and by allowing them autonomy in deciding assessment criteria.
• OPA with design elements of reciprocal roles and anonymity has great potential to promote students' HOT.

     

Examining research on the impact of distance and online learning: A second-order meta-analysis study

Distance learning has evolved over many generations into its newest form of what we commonly label as online learning. In this second-order meta-analysis, we analyze 19 first-order meta-analyses to examine the impact of distance learning and the special case of online learning on students’ cognitive, affective and behavioral outcomes. We examine to what extent distance learning generation level, and instructional setting moderate the influences of distance learning on cognitive, affective and behavioral outcomes. This second-order meta-analyses also analyzes the first-order meta-analyses for methodological quality and robustness. The findings revealed a statistically significant overall average effect size (g = 0.156, p < .001 with a 95% confidence interval of 0.087–0.224) of distance learning impacting cognitive, affective and behavioral outcomes in comparison to face-to-face learning. Meta-analyses on higher education had a statistically significant larger effect size than K-12 education. Limitations, implications, and directions for future research are discussed.     

Science-based laboratory comprehension: an examination of effective practices within traditional,online and blended learning environments

An increase in online education is causing science educators to evaluate student cognitive understanding after completing virtual, computer-simulated laboratories. Online education has demonstrated comparable learning gains when analysed to those of the traditional classroom, but research is mixed when reviewing students’ ability to manipulate tangible laboratory equipment after participating in online experimentation. The question remains, are students who are exclusively enrolled in online science courses equipped with the cognitive ability to operate laboratory equipment within a physical laboratory? When considering the optimal learning environment for science majors, educators have discovered the blended classroom may provide the perfect opportunity to combine the benefits of face-to-face instruction and feedback with the reinforcement of scientific theory through technology integration. New advances in virtual education provide promising examples of enhancing the online classroom laboratory in all scientific disciplines. Further insight into the blended classroom has the potential to influence the field of education towards an optimal learning environment for science majors in colleges and universities.     

两个猜想等价性的一个新的证明

为了研究四色猜想与无桥三正则平面图的一因子分解猜想,利用任意三角剖分上一族直线段构成该剖分上S_1~0-分片代数曲线的充要条件,给出了这2个猜想等价性的1个新的证明。并在四色猜想成立的前提下给出了三角剖分的几个新的性质。