Supporting the less-adaptive student: the role of learning analytics,formative assessment and blended learning

Abstract

How can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile.     

Threats to student evaluative judgement and their management

ABSTRACT

Students’ capacity for making evaluative judgements of their own work is widely acknowledged as central to their learning within programmes as well as being vital to their subsequent professional practice. In higher education literature, the act of evaluative judgement is usually portrayed as a process of deliberative, analytical reasoning requiring student agency and objectivity, typically scaffolded by points of reference such as explicit criteria, rubrics or exemplars. This article challenges this common portrayal of judgement by drawing attention to research from outside higher education on the role of unconscious factors in judgement and decision-making. Drawing from the field of heuristics and bias studies, the article outlines six unconscious factors that have the potential to distort students’ analytical judgement of their work. A recent challenge to the heuristics and bias approach that radically repositions the place of reasoning in judgement is also considered. Since these unconscious factors have received scant attention in higher education literature, the purpose of this article is to draw attention to them, to identify the challenges they pose to current understandings of evaluative judgement, and to outline their implications for enhancing assessment practice.     

Informal formative assessment: The role of instructional dialogues in assessing students’ learning

This paper focuses on an unceremonious type of formative assessment - informal formative assessment - in which much of what teachers and students do in the classroom can be described as potential assessments that can provide evidence about the students’ level of understanding. More specifically, the paper focuses on assessment conversations, or dialogic interactions or exchanges, which continuously happen in the classroom and that are at the center of informal formative assessment. It is argued that assessment conversations make students’ thinking explicit in an unobtrusive manner, and when students’ thinking is explicit, it can be examined, questioned, and shaped as an active object of constructive learning. The paper conceptualizes informal formative assessment at the center of effective instructional activities with the use of instructional dialogues as assessment conversations, a typical informal formative assessment practice. The paper then presents a discussion about the evidence on the effect of assessment conversations on student learning.     

加强形成性评价 提高英语学习成效——探索提高英语B级测试成绩的途径

形成性评价是以学生为中心、注重能力培养的一种教学方式。在高职英语教学中,通过实施对学生课堂学习行为、课堂活动参与及作业的评价,建立学生学习档案,实行以评价学习过程为主的评价标准,能有效地提高学生英语B级测试成绩,极大地调动学生学习的积极性。     

Assessment for learning: Developing formative assessment in the classroom

This article reports on a research project designed to investigate and develop formative classroom assessment in primary schools. The project was a collaborative one, involving two university based researchers and a team of teacher researchers. It used an action research approach to try to bring about changes in classroom assessment practices. The article reports on changes in practice particularly involving the clarification and communication of assessment criteria to pupils.     

Assisting transition to university: using assessment as a formative learning tool

This study explores the effectiveness of an intervention involving formative assessment in a first‐year core business subject. Students were invited to receive feedback on a draft of their first written assessment during the early weeks of the semester. Consideration is given to the economic and ethical issues raised by the intervention. A multi‐method approach of qualitative and quantitative data collection and analysis is used. The research finds that the intervention facilitates significantly higher marks in assessments and grades, while assisting student learning overall. Findings are reinforced by comparison with a subject where the intervention was not offered.     

Students’ assessment preferences and approaches to learning: can formative assessment make a difference?

The purpose of this paper is to gain insight into the relationships between hands‐on experiences with formative assessment, students’ assessment preferences and their approaches to learning. The sample consisted of 108 university first‐year Bachelor’s students studying criminology. Data were obtained using the Revised two‐factor study process questionnaire (R‐SPQ‐2F) and the Assessment preferences inventory (API). The study shows that differences in assessment preferences are correlated with differences in approach to learning. Students’ preferences for assessment methods with higher‐order thinking tasks are significantly lower after actual experience with a formative assessment. Moreover, students also changed their approaches to learning after hands‐on experience with a formative mode of assessment. Surprisingly, this change evinced a more ‘surface approach’ to learning. Nevertheless, this is in line with other recent research findings. The paper ends with some possible explanations, and new directions for research are proposed.     

形成性评价对大学生英语学习能力培养的作用

形成性评价注重学习过程,能够培养学生的良好的自主学习意识和习惯、提高自我效能感、优化自主学习策略、把教与学引入良性发展的轨道,从而提高英语能力。     

Investigating the dynamics of formative assessment: relationships between teacher knowledge,assessment practice and learning

This exploratory study of elementary school science examines questions central to policy, practice and research on formative assessment: What is the quality of teachers’ content-pedagogical and assessment knowledge? What is the relationship between teacher knowledge and assessment practice? What is the relationship between teacher knowledge, assessment practice and student learning? Drawing on multiple measures, hierarchical linear modelling and path analysis, results suggest that despite weaknesses in teachers’ content-pedagogical and assessment knowledge, teachers’ formative assessment practices are positively related to student learning. Relationships between teachers’ knowledge and assessment practices are mixed. Findings underscore both the potential and challenge of bringing effective formative practice to fruition as well as the need for continued research.     

Developing evaluative judgement: enabling students to make decisions about the quality of work

Evaluative judgement is the capability to make decisions about the quality of work of oneself and others. In this paper, we propose that developing students’ evaluative judgement should be a goal of higher education, to enable students to improve their work and to meet their future learning needs: a necessary capability of graduates. We explore evaluative judgement within a discourse of pedagogy rather than primarily within an assessment discourse, as a way of encompassing and integrating a range of pedagogical practices. We trace the origins and development of the term ‘evaluative judgement’ to form a concise definition then recommend refinements to existing higher education practices of self-assessment, peer assessment, feedback, rubrics, and use of exemplars to contribute to the development of evaluative judgement. Considering pedagogical practices in light of evaluative judgement may lead to fruitful methods of engendering the skills learners require both within and beyond higher education settings.     

Using digital technology to enhance formative assessment in mathematics classrooms

In this paper, which is based on research from the EU-funded project Improving Progress through Formative Assessment in Science and Mathematics Education, we explore how iPads are used within formative assessment processes by six mathematics teachers and their classes in two secondary comprehensive schools in the Midlands of England. A design research approach is first used to develop and trial six lessons in which iPads are used in different ways within formative assessment processes. Through lesson observations, video analysis and teacher interviews we then examine how iPad technology contributes to these processes, the functions it performs and the distribution of activity between the main actors (teacher, technology and student). An analytic approach is developed which captures the interactions in visual representations, showing how the technology is often used as a form of communication but also performs more active functions which affect the role taken by the teacher in formative processes. The study offers insight into ways in which iPad technology contributes to effective student learning through formative assessment and introduces an analytic approach that may be useful for further studies.     

形成性评价在大学英语合作学习中的应用

评价方法是合作学习中的一个重要环节,在大学英语阅读合作学习中应用形成性评价,通过"评估-反馈-调整-改进"的模式,帮助学生及时了解并反思学习过程,激发学生合作学习的主动性和积极性,促进合作学习的有效开展,从而逐步提高学生的英语阅读能力和自主学习能力。     

Supporting student learning: the use of computer–based formative assessment modules

This paper describes the development of a variety of computer–based assessment opportunities, both formative and summative, that are available to a large first year biology class at The University of Sydney. These materials include: weekly quizzes; a mock exam; quiz sections in tutorials; and special self–assessment modules (SAMs). The weekly quiz is password protected and secure but the remaining materials are available on–line from a Virtual Learning Environment (http://FYBio.bio.usyd.edu.au/VLE/L1/). Evaluations over a number of years of the use and usefulness of the formative assessment materials indicate that the student population is making significant use of materials and that these materials are helping students in their learning     

形成性评价在小组合作学习中的实施

在英语教学中,阅读和听力是直接获得知识的重要方式。听力是很难只通过教学而熟练掌握的,而阅读则可以通过有效的学习方式而达到最佳的学习效果。在课堂教学中,采用小组合作学习的方式,可以通过学生间的集思广益,扩大彼此的知识面,并引起学习兴趣,进而达到最佳的学习效果。本文主要从形成性评价的基本含义出发,探讨了其在小组合作学习中的实施。     

Views and practices from the chalkface: development of a formative assessment multimedia learning environment

Recently, technology-supported formative assessment has caught researchers’ increasing attention. Most of the relevant studies have been carried out in experimental situations to demonstrate the effectiveness of technology-supported formative assessment for learning. However, little is still known about how technology-supported formative assessment is viewed and experienced by teachers in their classrooms. To fill this gap, this study investigated teachers’ voices and practices when they used a formative assessment multimedia learning environment (FAMLE) in their classrooms during three semesters, which involved continuous platform refinement. The findings show that the teachers encountered a number of problems in four major aspects, namely students’ engagement, assessment task design, feedback and follow-up issues. FAMLE went through corresponding refinement in two rounds. A change was evident in teachers’ pedagogical practice of FAMLE from summative and revision use, diagnostic use, to integrative use.     

Linking a learning progression for natural selection to teachers' enactment of formative assessment

Learning progressions, or representations of how student ideas develop in a domain, hold promise as tools to support teachers' formative assessment practices. The ideas represented in a learning progression might help teachers to identify and make inferences about evidence collected of student thinking, necessary precursors to modifying instruction to help students advance in their learning. The study reported in this article took the novel approach of using a learning progression for natural selection to support teachers' enactment of formative assessment. Sources of data include interviews and videotapes of six high school biology teachers leading assessment conversations around the same formative assessment questions. Results indicate that while teachers picked out and made inferences about student ideas related to the learning progression during assessment conversations, they did not use all parts of the learning progression in the same way. Furthermore, several of the teachers seemed to use the learning progressions simply as catalogs of misconceptions to be “squashed” rather than drawing upon the developmental affordances offered by a learning progression. Results are framed in terms of the utility of learning progressions as supports for classroom practice. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1181–1210, 2012     

A model formative assessment strategy to promote student-centered self-regulated learning in higher education

Adult learners are already involved in the process of self-regulation; hence, higher education institutions should focus on strengthening students＇ self-regulatory skills. Self-regulation can be facilitated through formative assessment. This paper proposes a model formative assessment strategy that would complement existing university teaching, and can be used in higher education to promote student-centered self-regulated learning with minimal effort and time input from teachers. Based on this model, a real-world teaching example on writing an essay as a challenge task has also been developed. This model strategy incorporates Nicol and Macfarlane-Dick＇s seven principles of good feedback practice that promotes self-regulation.