共查询到20条相似文献，搜索用时 15 毫秒
1.
Edys S. Quellmalz Michael J. Timms Matt D. Silberglitt Barbara C. Buckley 《科学教学研究杂志》2012,49(3):363-393
This article reports on the collaboration of six states to study how simulation‐based science assessments can become transformative components of multi‐level, balanced state science assessment systems. The project studied the psychometric quality, feasibility, and utility of simulation‐based science assessments designed to serve formative purposes during a unit and to provide summative evidence of end‐of‐unit proficiencies. The frameworks of evidence‐centered assessment design and model‐based learning shaped the specifications for the assessments. The simulations provided the three most common forms of accommodations in state testing programs: audio recording of text, screen magnification, and support for extended time. The SimScientists program at WestEd developed simulation‐based, curriculum‐embedded, and unit benchmark assessments for two middle school topics, Ecosystems and Force & Motion. These were field‐tested in three states. Data included student characteristics, responses to the assessments, cognitive labs, classroom observations, and teacher surveys and interviews. UCLA CRESST conducted an evaluation of the implementation. Feasibility and utility were examined in classroom observations, teacher surveys and interviews, and by the six‐state Design Panel. Technical quality data included AAAS reviews of the items' alignment with standards and quality of the science, cognitive labs, and assessment data. Student data were analyzed using multidimensional Item Response Theory (IRT) methods. IRT analyses demonstrated the high psychometric quality (reliability and validity) of the assessments and their discrimination between content knowledge and inquiry practices. Students performed better on the interactive, simulation‐based assessments than on the static, conventional items in the posttest. Importantly, gaps between performance of the general population and English language learners and students with disabilities were considerably smaller on the simulation‐based assessments than on the posttests. The Design Panel participated in development of two models for integrating science simulations into a balanced state science assessment system. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 363–393, 2012 相似文献
2.
对学生的核心素养和高阶能力的培养是当前教育领域的热点话题。项目式学习是培养学生的核心素养和高阶能力的一种有效学习方式,深受基础教育者的青睐。然而,项目式学习在实践过程中面临着项目设计形式单一、过程性数据的收集与评价时间成本高且滞后、缺乏有效评价等诸多问题。基于证据的教与学强调教育教学活动的设计要遵循已被证实的研究规律;关注学生的学习过程,将学习证据与学生的学习状态建立联系;培养学生基于证据推理的能力,为解决当前项目式学习中存在的问题提供了一个思路。同时,证据中心的设计理论是指导众多高阶能力测评设计的理论基础,与项目式学习的目标相契合。因此,该研究结合大数据技术,将基于证据的相关理念引入项目式学习中,从教、学、评三个角度出发构建了证据导向的项目式学习模式,并以此为理论基础设计开发了证据导向的项目式学习系统,旨在为高水平的项目式学习的设计与实施提供支持,促进学生核心素养的发展。 相似文献
3.
4.
5.
Jonathan C. Hilpert Jeffrey A. Greene Matthew Bernacki 《British journal of educational technology : journal of the Council for Educational Technology》2023,54(5):1204-1221
Capturing evidence for dynamic changes in self-regulated learning (SRL) behaviours resulting from interventions is challenging for researchers. In the current study, we identified students who were likely to do poorly in a biology course and those who were likely to do well. Then, we randomly assigned a portion of the students predicted to perform poorly to a science of learning to learn intervention where they were taught SRL study strategies. Learning outcome and log data (257 K events) were collected from n = 226 students. We used a complex systems framework to model the differences in SRL including the amount, interrelatedness, density and regularity of engagement captured in digital trace data (ie, logs). Differences were compared between students who were predicted to (1) perform poorly (control, n = 48), (2) perform poorly and received intervention (treatment, n = 95) and (3) perform well (not flagged, n = 83). Results indicated that the regularity of students' engagement was predictive of course grade, and that the intervention group exhibited increased regularity in engagement over the control group immediately after the intervention and maintained that increase over the course of the semester. We discuss the implications of these findings in relation to the future of artificial intelligence and potential uses for monitoring student learning in online environments.
Practitioner notes
What is already known about this topic- Self-regulated learning (SRL) knowledge and skills are strong predictors of postsecondary STEM student success.
- SRL is a dynamic, temporal process that leads to purposeful student engagement.
- Methods and metrics for measuring dynamic SRL behaviours in learning contexts are needed.
- A Markov process for measuring dynamic SRL processes using log data.
- Evidence that dynamic, interaction-dominant aspects of SRL predict student achievement.
- Evidence that SRL processes can be meaningfully impacted through educational intervention.
- Complexity approaches inform theory and measurement of dynamic SRL processes.
- Static representations of dynamic SRL processes are promising learning analytics metrics.
- Engineered features of LMS usage are valuable contributions to AI models.
6.
随着大学教学信息化进程的不断深化与发展,如何测量、挖掘、分析与利用在学习平台中积累的大量数据,以更好地支持教学与学习,进而改善和提升教与学的质量与效能,已成为摆在大学教学信息化研究者与实践者面前的现实课题。学习分析的兴起则为解决这一难题,提供了一系列的方法、工具和手段。文章将基于国内外学者的已有研究,通过对学习分析的发展脉络的梳理,对学习分析的内涵、过程、工具和方法作较为深入的解读,并尝试从推动大学教学创新的视角,阐释学习分析对促进大学教学信息化深入发展的重要价值和深远影响。 相似文献
7.
The Bases of Competence model provides a general framework for learner‐centred skill development and programme‐focused outcomes assessment. Based on previous research, the Bases of Competence model describes 17 skills and four base competencies important to graduates to achieve high performance in the workplace. Taking this work from research to relevant educational application as a tool for student self‐assessment and institutional outcomes assessment is the focus of this paper. Results from a multi‐year, multi‐course assessment initiative indicate that students rate themselves stronger in the foundation base competencies of Communicating and Managing Self, and weaker in more complex competencies of Managing People and Tasks and Mobilising Innovation and Change. Comparisons of skill confidence within each base competence as well as between year, student level, gender and beginning versus end of semester are presented as well. These results are discussed and suggestions made for programme design. 相似文献
8.
An undergraduate social work program developed a service‐learning experience in partnership with a local United Way organization to complete a community needs assessment project. The experience integrated the curricula of a social work research methods course and a generalist‐macro practice course with the principles and actions of experiential and service‐ learning, evidence based practice, and civic responsibility. This integrated curricula project yielded practical, “real world” outcomes for the local community and learning outcomes for the students. Needs assessments conducted by social students resulted in particular groups of community citizens receiving targeted services from agencies receiving funding from United Way. Evidence obtained from the students who participated in this experience indicates that two important learning outcomes were achieved; a heightened awareness of the local community's resource system and a sense of connection to the local community, along with the enhancement of students ‘self‐esteem and increased self‐confidence in their abilities. 相似文献
9.
Peter Williams 《Assessment & Evaluation in Higher Education》2017,42(6):978-989
Assessment in higher education has focused on the performance of individual students. This focus has been a practical as well as an epistemic one: methods of assessment are constrained by the technology of the day, and in the past they required the completion by individuals under controlled conditions of set-piece academic exercises. Recent advances in learning analytics, drawing upon vast sets of digitally stored student activity data, open new practical and epistemic possibilities for assessment, and carry the potential to transform higher education. It is becoming practicable to assess the individual and collective performance of team members working on complex projects that closely simulate the professional contexts that graduates will encounter. In addition to academic knowledge, this authentic assessment can include a diverse range of personal qualities and dispositions that are key to the computer-supported cooperative working of professionals in the knowledge economy. This paper explores the implications of such opportunities for the purpose and practices of assessment in higher education, as universities adapt their institutional missions to address twenty-first century needs. The paper concludes with a strong recommendation for university leaders to deploy analytics to support and evaluate the collaborative learning of students working in realistic contexts. 相似文献
10.
Hatim Lahza Tammy G. Smith Hassan Khosravi 《British journal of educational technology : journal of the Council for Educational Technology》2023,54(1):335-354
Traditional item analyses such as classical test theory (CTT) use exam-taker responses to assessment items to approximate their difficulty and discrimination. The increased adoption by educational institutions of electronic assessment platforms (EAPs) provides new avenues for assessment analytics by capturing detailed logs of an exam-taker's journey through their exam. This paper explores how logs created by EAPs can be employed alongside exam-taker responses and CTT to gain deeper insights into exam items. In particular, we propose an approach for deriving features from exam logs for approximating item difficulty and discrimination based on exam-taker behaviour during an exam. Items for which difficulty and discrimination differ significantly between CTT analysis and our approach are flagged through outlier detection for independent academic review. We demonstrate our approach by analysing de-identified exam logs and responses to assessment items of 463 medical students enrolled in a first-year biomedical sciences course. The analysis shows that the number of times an exam-taker visits an item before selecting a final response is a strong indicator of an item's difficulty and discrimination. Scrutiny by the course instructor of the seven items identified as outliers suggests our log-based analysis can provide insights beyond what is captured by traditional item analyses.
Practitioner notes
What is already known about this topic- Traditional item analysis is based on exam-taker responses to the items using mathematical and statistical models from classical test theory (CTT). The difficulty and discrimination indices thus calculated can be used to determine the effectiveness of each item and consequently the reliability of the entire exam.
- Data extracted from exam logs can be used to identify exam-taker behaviours which complement classical test theory in approximating the difficulty and discrimination of an item and identifying items that may require instructor review.
- Identifying the behaviours of successful exam-takers may allow us to develop effective exam-taking strategies and personal recommendations for students.
- Analysing exam logs may also provide an additional tool for identifying struggling students and items in need of revision.
11.
高校教师授课的满意度以学生评价为第一的哲学思考 总被引：1，自引：0，他引：1
随着中国高校市场化的加快,学生的弱势群体地位已有改变,教师的服务本位正在加强,二者的对立统一关系处于历史上最好时期。许多高校面对校际之间的激烈竞争,坚持学生第一的评价倾向。但是教师授课的复杂性、学科趣味的差异性、学科设置的科学性,决定了高校对之的评价体系应坚持以教师和学生的满意度和学科设置的科学性并重的方针。 相似文献
12.
Sophie H. Cormack Laurence A. Eagle Mark S. Davies 《Assessment & Evaluation in Higher Education》2020,45(7):1046-1059
AbstractMany studies have found a relationship between students’ self-reported procrastination and their grades. Few studies have used learning analytic data as a behavioural measure of procrastination in order to predict performance, and there is no systematic research on how this relationship may differ across assessments or disciplines. In this study we analyse nine years’ worth of institutional electronic submission records, a total of 73,608 assignment submissions, to examine the relationship between submission time and grades across assignments, students, courses, and disciplines in higher education. A significant negative relationship was found overall, with students who submitted closer to the deadline obtaining lower grades, however the size of the relationship was negligible, accounting for less than 1% of the variance in grades. The relationship varied significantly depending on student, assignment, course and discipline. 相似文献
13.
14.
Joyce Bedi 《Human Behavior and Emerging Technologies》2019,1(1):18-25
Ralph Baer (1922–2014) and his family fled Nazi Germany in 1938 and immigrated to New York. He served in the U.S. Army during World War II and became an expert in foreign small arms. After his discharge from the military, Baer trained for an engineering career in electronics, radio, and television. Fascinated by television, he came to think of it as an underused technology. He believed that television owners should be able to do more than change channels and turn the set on or off—he wanted people to interact with their sets, playing games like ping pong, tennis, and checkers. In 1966, he began experimenting with ways to realize his vision. The video game industry for the home market launched in 1972 when Magnavox debuted the Odyssey game console, based on Baer's inventions. In the course of his long career, Baer invented myriad electronic toys and games, illustrating a commitment to interactivity that continues in video games today. 相似文献
15.
Mohammed Saqr Ward Peeters 《British journal of educational technology : journal of the Council for Educational Technology》2022,53(5):1283-1303
Social Network Analysis (SNA) has enabled researchers to understand and optimize the key dimensions of collaborative learning. A majority of SNA research has so far used static networks, ie, aggregated networks that compile interactions without considering when certain activities or relationships occurred. Compressing a temporal process by discarding time, however, may result in reductionist oversimplifications. In this study, we demonstrate the potentials of temporal networks in the analysis of online peer collaboration. In particular, we study: (1) social interactions by analysing learners' collaborative behaviour, part of a case study in which they worked on academic writing tasks, and (2) cognitive interactions through the analysis of students' self-regulated learning tactics. The study included 123 students and 2550 interactions. By using temporal networks, we show how to analyse the longitudinal evolution of a collaborative network visually and quantitatively. Correlation coefficients with grades, when calculated with time-respecting temporal measures of centrality, were more correlated with learning outcomes than traditional centrality measures. Using temporal networks to analyse the co-temporal and longitudinal development, reach, and diffusion patterns of students' learning tactics has provided novel insights into the complex dynamics of learning, not commonly offered through static networks. 相似文献
16.
学习分析是“大数据”在教育领域的应用,引发了教育技术发展的第三次浪潮,并获得学术界的广泛关注。本文梳理了学习分析的形成过程,然后从利益相关者、研究目标、研究对象、技术方法四个维度,回顾了近五年来国内外学者在学习分析方面的研究成果,并提出未来发展趋势和可能遇到的挑战,便于相关人员制定教育决策、优化教育管理过程以及完善学习过程。研究结果表明,学习分析研究主题主要涵盖学习者知识建模、学习情绪建模、学习行为特征抽取、学习活动跟踪、学习者建模、学位获取分析、教学资源和教学策略优化、自适应学习系统和个性化学习、在线学习影响因素分析九个方面;分析数据主要来源于集中式学习环境、分布式学习环境以及身体活动数据;常用分析方法包括统计分析、信息可视化、数据挖掘、社会网络分析、话语分析和网站分析。目前,学习分析研究遇到的挑战包括教育数据预处理难度大、数据访问权限不明确、学习分析适用性有限。虽然学习分析尚处于发展初期,但由于能够为教育系统各级决策提供科学参考,已经成为教育信息化的重要内容之一。 相似文献
17.
韩晓东 《河北广播电视大学学报》2012,17(3):90-93
课程考核是远程开放教育质量保证体系的重要组成部分,不断深化考试改革,不断探索适合远程教育的课程考核模式,是远程开放教育持续、健康发展的有力保障。基于网络的课程考核系统以其组卷的科学性、操作的简便性、评分的可靠性和高效率正在成为远程教育考试模式中不可或缺的组成部分。与传统的课程考核相比,对网络考试的实施、监控与管理需要作进一步的研究和探讨。 相似文献
18.
Dirk Tempelaar 《Assessment & Evaluation in Higher Education》2020,45(4):579-593
AbstractHow can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile. 相似文献
19.