Perceived teacher feedback and academic performance: the mediating effect of learning engagement and moderating effect of assessment characteristics

Abstract

The aim of this study was to determine the mediating effect of learning engagement on the relationship between perceived teacher feedback and college students’ academic performance, and the moderating effect of assessment characteristics on the relationship between perceived teacher feedback and learning engagement. A sample of 2,458 students in a university in mainland China was studied. Results indicated that perceived teacher feedback had a positive impact on students’ academic performance; learning engagement had a mediating effect on the relationship between perceived teacher feedback and students’ academic performance; and assessment frequency, difficulty and diversity had moderating effects between perceived teacher feedback and learning engagement. With the three factors of high frequency, difficulty and diversity assessment, perceived teacher feedback was more likely to improve students’ learning engagement. In contrast, feedback without these three factors could decrease or have no impact on students’ learning engagement. This indicates that teacher feedback indirectly affects college students’ academic performance by promoting their learning engagement, and is more effective when the frequency, difficulty or diversity of assessments is high.     

Improving engagement: the use of ‘Authentic self-and peer-assessment for learning’ to enhance the student learning experience

Innovative assessment practices have the potential to shift the way universities function. By focusing on well-designed assessment tasks, where students are expected to work collegially and are actively involved in self- and peer-assessment, the opportunity to engage students in the assessment process is realised. This article contends that students are significantly and detrimentally disengaged from the assessment process as a result of traditional assessments that do not address key issues of learning. Notable issues that arose from observations and questioning of students indicated that vast proportions of students were not proofreading their own work were not collaborating on tasks; had not been involved in the development of assessment tasks; and that students had insufficient skills in relation to their ability to evaluate their own efforts. These facts led the author to conceptualise new models of assessment focusing on authentic learning and the authentic assessment of that learning through self- and peer-assessment. Authentic assessment for sustainable learning (AASL) and Authentic self-and peer-assessment for learning (ASPAL) were trialled with approximately 300 undergraduate education students at the University of Notre Dame Australia. This article explains the conceptual development of the models and provides justification for their implementation.     

The dynamic relationship between response processes and self-regulation in critical thinking assessments

Our aim was to explore higher education students’ response and self-regulatory processes plus the relationship between these, as evidenced in two types of performance-based critical thinking tasks included in the Collegiate Learning Assessment (CLA+) International instrument. The data collection consisted of 20 cognitive laboratories. The data were analyzed using a qualitative approach. The tasks were found to trigger different response and self-regulatory processes. Overall, the performance task evoked more holistic processes than the selected-response questions, in which students’ processes were more question-oriented. The results also indicated the entanglement of students’ response and self-regulation processes. Three self-regulation groups were identified. Students with versatile self-regulation skills were able to complete the task thoroughly, whereas students with moderate self-regulation skills faced challenges in monitoring and evaluating their performance. Students who were lacking in self-regulation struggled both with the task as a whole and their own progress. Implications for higher education are discussed.     

Bridging assessment and achievement: Repeated practice of self-assessment in college english classes in Taiwan

Abstract

Grounded on the notion of observational learning in social cognitive learning theory, this study evaluated the effectiveness of repeated self-assessment on English-as-a-foreign-language learners’ oral performance and the perceptions of the students and the instructor of this practice. Ninety-seven students from three classes in a Taiwanese college participated in this study. The classes experienced five trials of self-assessment in which they used cell phones to record their oral responses. Instead of simply rating their own recordings, the students were provided questions to guide their examination of key components of their own talk. The results show that the students’ oral performance and evaluation abilities both improved over time, and they highly valued opportunities to detect their errors and observe their real learning outcomes. The findings suggest that self-assessment bridged the gap between repeated practice and English learning by allowing the students to reflect upon their performance, find their weaknesses, adjust their following talk, and recognize their learning outcomes.     

Calibration to Task Complexity: The Role of Epistemic Cognition

Abstract

We examined the role of epistemic cognition in calibration to task complexity before and during learning. Sixty-six undergraduate students were presented with two learning tasks—a simple task and a more complex task—in random order. Prior to learning, offline measures of learners’ epistemic beliefs about climate change were taken. An open-ended questionnaire was then used to capture task definitions, goals, and plans. To assess online epistemic cognition and learning strategies used during learning, a think-aloud protocol was employed. Results showed that epistemic beliefs before learning predicted epistemic cognition during learning. Further, results demonstrated that calibration to task complexity before learning was not related to epistemic beliefs but was related to epistemic cognition during learning. These findings suggest that individuals engage in epistemic cognition during learning to better understand the nature of the knowledge to be learned and that this results in better calibration of learning processes to task complexity.     

Self-assessment of writing in independent language learning programs: The value of annotated samples

The availability of multi-media technologies in education has made the option of independent learning increasingly attractive. Whilst independent learning presents learners with a more flexible learning context, it also presents new challenges in assessment in that the onus is placed upon the learners themselves to monitor and evaluate their own learning.This paper reports on the development of an approach to learner self-assessment which aims to facilitate the self-assessment of performance on extended-response writing tasks. Whilst such tasks are typical within current approaches to communicative language learning, a review of the self-assessment literature reveals no precedent for how actual task performance might be effectively and reliably self-assessed. A methodology was therefore developed which used annotated samples of learner-produced texts, where the annotations would elucidate both the criteria by which performance should be judged and the standards expected, thus enabling learners to assess their own performances by comparing their work with these samples. The methodology was trialled on a small sample of students. It was found to be both reliable and useful, allowing students not only to accurately evaluate their own performance but also to learn new language skills from the samples.     

A large-scale test of the relationship between procrastination and performance using learning analytics

Abstract

Many studies have found a relationship between students’ self-reported procrastination and their grades. Few studies have used learning analytic data as a behavioural measure of procrastination in order to predict performance, and there is no systematic research on how this relationship may differ across assessments or disciplines. In this study we analyse nine years’ worth of institutional electronic submission records, a total of 73,608 assignment submissions, to examine the relationship between submission time and grades across assignments, students, courses, and disciplines in higher education. A significant negative relationship was found overall, with students who submitted closer to the deadline obtaining lower grades, however the size of the relationship was negligible, accounting for less than 1% of the variance in grades. The relationship varied significantly depending on student, assignment, course and discipline.     

Instructional Tasks and the Development of Student Capacity to Think and Reason: An Analysis of the Relationship between Teaching and Learning in a Reform Mathematics Project

Abstract

In the present study the relationship between teaching and learning was examined using a conceptual framework that links dimensions of instructional tasks with gains in student learning outcomes. The greatest student gains on a performance assessment consisting of tasks that require high levels of mathematical thinking and reasoning were related to the use of instructional tasks that engaged students in the “doing of mathematics” or the use of procedures with connections to meaning. In addition, student performance gains were greater for those sites whose tasks were both set up and implemented to encourage the use of multiple solution strategies, multiple representations, and explanations. Whereas, student performance gains were relatively small for those sites whose tasks tended to be both set up and implemented in a procedural manner and that required a single solution strategy, single representations, and little or no mathematical communication.     

Educational Aims,Ideals, and Activities

Abstract

The effects on student performance and student attitudes of varying the instructional locus of control between students and teachers were investigated. A 2 X 2 factorial design was used that included either teacher regulation or student regulation of 1) the setting of weekly learning goals, and 2) the evaluation of weekly work. After a 4-week period, a mathematics achievement test and a student attitude survey were administered. Results indicated that although teachers set more individual learning goals for students, students who set their own learning goals attained more of them. Students tended to evaluate their work more favorably than teachers, and work evaluations from both teachers and students were higher for students who initially set their own learning goals. In addition, students who were given the opportunity to set their own learning goals reported better goal-setting ability than those for whom goals were externally imposed by the teacher. As predicted, the self-regulated goal setting and evaluation were found to be significantly related to attitudes, but not to mathematics achievement.     

Thinking Through Computing: The Power of Learning Communities

This paper describes an empirical study that investigated the knowledge that Computer Science students have about the extent of their own previous learning. The study compared self-generated estimates of performance with actual performance on a data structures quiz taken by undergraduate students in courses requiring data structures as a prerequisite. The study was contextualized and grounded within a research paradigm in Psychology called calibration of knowledge that suggests that self-knowledge across a range of disciplines is highly unreliable. Such self-knowledge is important because of its role in meta-cognition, particularly in cognitive self-regulation and monitoring, as well as in the credence that instructors give to student self-reports. Our results indicated that Computer Science student self-estimates are highly correlated with performance, more so for estimates provided after the performance than before. This high level of calibration, however, was likely the result of a number of conditions that do not always hold: that the students already had domain expertise, that the quiz had unambiguous and verifiable answers, and that students expected their estimates to be validated. When these conditions are not met, it becomes more important for students to have direct feedback about their performance so as to uncover those areas where their intuitions might mislead them. Students also had weak knowledge about their standing relative to their peers, particularly those in the lower performance quartiles, exhibiting the well known better-than-average heuristic. There was, additionally, no correlation between calibration ability and degree of liking or difficulty with the data structures material, suggesting that instructors and researchers should not treat liking or difficulty as reliable indicators of the learning that has occurred.     

The differential effects of task complexity on domain-specific and peer assessment skills

In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial design with the between-subjects factor task complexity (simple, n?=?51; complex, n?=?59) and within-subjects factor task type (domain-specific, peer assessment), secondary school students studied four integrated study tasks, requiring them to learn a domain-specific skill (i.e. identifying the six steps of scientific research) and to learn how to assess a fictitious peer performing the same skill. Additionally, the students performed two domain-specific test tasks and two peer assessment test tasks. The interaction effect found on test performance supports our hypothesis. Implications for the teaching and learning of peer assessment skills are discussed.     

Assessing students’ performance by measured patterns of perceived strengths: does preference make a difference?

This paper is an empirical field study of whether college students’ preferences for assessment type correspond to their performance in assessment that tests that particular strength. For example, if students say they prefer assessment that tests their creativity, do they actually perform better on assessment tasks requiring the use of creativity? Seventy-eight students in three different courses were surveyed to determine their preferences in four types of assessment: memorisation, analysis, creativity and practical application. These preferences were then compared to student grades on corresponding forms of assessment to see if the preferences corresponded to actual performance. The study found that, while students had a clear preference for memorisation, they were not likely to deliver their best performances on memorisation tasks. There was no relationship at all between student preferences in assessment type and their performance in the respective assessments. These results indicate that, while in theory assessing students based on their preferences is reasonable for improved learning, we were not able to find evidence that it actually leads to higher performance.     

Transforming collaborative writing tasks into opportunities for learning: educational assistance and the use of rubrics in Higher Education / Transformando las tareas de escritura colaborativa en oportunidades para aprender: ayuda educativa y uso de rúbricas en la Educación Superior

Abstract

This study, framed within a socio-cultural perspective of teaching that sees collaborative writing as a learning instrument, presents an innovative teaching experience related to the use of collaborative writing tasks to foster learning, combining face-to-face and online group work sessions. The study was conducted with the participation of 13 students — organised into three different groups — taking a subject of a Master’s degree in Psychology of Education, and the two teachers responsible for delivering the subject. The results of the experience have highlighted the need to provide different learning assistance which is not solely aimed at managing meaning, but also at managing the task itself and the participation in it. The results also show the importance of embedding such assistance in the design as well as the development of the instructional process. Among the different forms of assistance available, the data show the benefits of using rubrics as tools to support the shared understanding of tasks by teachers and students and as a tool to support learning. Finally, results show that the collaborative writing tasks carried out throughout the course have been useful both for learning the content and for developing the abilities required for managing the students’ own joint activity.     

Beyond the tools: analysing personal and group learning environments in a university course / Más allá de la tecnología: análisis de los entornos de aprendizaje personales y grupales de estudiantes en una asignatura universitaria

Abstract

In this paper we present the results of a naturalistic study carried out with higher education students which describes their learning environments when working on academic tasks in groups and individually. In this study we want to analyse how they organize their learning activities and knowledge processes (reading, reflecting and sharing) and how these learning processes are integrated into their Personal Learning Environments (PLE). In order to achieve that, students had to reflect about the basic ‘components’ that make up their learning process: reading (using not only by text but also multimedia), doing/reflecting (creating cognitive artefacts) and sharing (discussing, showing, and offering and receiving feedback from and to a community of reference). Students formed relationships between those components and any technological tools they used and created mind maps to represent their PLEs. The main objective is to try to understand how PLEs are organized and how they are perceived by learners, not from a technological perspective but from a learning perspective. The main results confirm the strong nature of PLEs as a pedagogical approach with a strong technological base. In addition, those results suggest a close relationship between students’ beliefs and expectations regarding academic tasks as well as the importance they give to each component in their learning process.     

Exceeding expectations: scaffolding agentic engagement through assessment as learning

Background: The active involvement of learners as critical, reflective and capable agents in the learning process is a core aim in contemporary education policy in Australia, and is regarded as a significant factor for academic success. However, within the relevant literature, the issue of positioning students as agents in the learning process has not been fully examined and needs further exploration.

Purpose: This study aims to explore ways in which aspects of self-regulated learning theory may be integrated with the concept of agentic engagement into classroom practice. Specifically, the study seeks to scaffold students’ self-assessment capabilities and self-efficacy by using a formative assessment-as-learning process. The research examines how scaffolded planning, as part of the forethought phase in the Assessment as Learning (AaL) process, influences self-regulation and student agency in the learning process.

Sample: 126 students from school years two, four and six (student age groups 7, 9 and 11 years), and 7 teachers at an independent (co-educational, non-religious) primary school in the Northern Territory, Australia, participated in the study.

Design and methods: Conducted as a one-setting, cross-sectional practitioner research study, the data sources included students’ planning templates, writing samples, interviews with students and teachers and email correspondence with teachers. The data were analysed for emerging themes and interpreted from a framework of social cognitive theory.

Findings: In this study, students were given the opportunity and support to exercise agentic engagement. Findings suggested that, in particular, students who were identified by their teachers as low-achieving and/or with poor motivation, were perceived by the teachers as exceededing expectations by demonstrating relatively greater motivation, persistence, effort and pride in their work than would be the case usually.

Conclusions: The findings from this formative AaL study suggest that AaL has the potential to help scaffold primary students’ development of assessment capabilities.     

Formative assessment of students from a Confucian heritage culture: Insights from Japan

Abstract

Since the turn of the century there has been increasing interest in educational assessment and the ways in which it can encourage or discourage effective learning processes. Much of this interest has centered around formative assessment and those practices which can promote student learning through the act of being assessed. Societies that have a Confucian heritage culture are widely believed to prioritize summative assessment at the expense of formative assessment. This will inevitably impact the ways in which students from these countries approach and engage with assessment tasks. The present study seeks to understand the dispositions of students from one Confucian heritage culture though the analysis of quantitative and qualitative data. The conceptions and experiences of university students in Japan were studied in order to provide direction for the development of formative assessment practice. Two data collection instruments were used: a self-report survey and a narrative frame task. The results indicate that students from Japan approach assessment tasks in a way that is at odds with some popular Confucian categories, such as intense competition, a desire to please the family, and the priority of book knowledge above practical skill. The paper concludes with pedagogical implications for teachers.     

Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning

For self-regulated learning to be effective, students need to be able to accurately assess their own performance on a learning task and use this assessment for the selection of a new learning task. Evidence suggests, however, that students have difficulties with accurate self-assessment and task selection, which may explain the poor learning outcomes often found with self-regulated learning. In experiment 1, the hypothesis was investigated and confirmed that observing a human model engaging in self-assessment, task selection, or both could be effective for secondary education students’ (N = 80) acquisition of self-assessment and task-selection skills. Experiment 2 investigated and confirmed the hypothesis that secondary education students’ (N = 90) acquisition of self-assessment and task-selection skills, either through examples or through practice, would enhance the effectiveness of self-regulated learning. It can be concluded that self-assessment and task-selection skills indeed play an important role in self-regulated learning and that training these skills can significantly increase the amount of knowledge students can gain from self-regulated learning in which they choose their own learning tasks.     

Cognitive-motivational variables of beginner university students in the first year of adaptation to the European Higher Education Area / Variables cognitivo-motivacionales del alumnado de nuevo ingreso en el primer año de adaptación al Espacio Europeo de Educación Superior

Abstract

Within the European Higher Education Area (EHEA) the student is the main protagonist of the learning process. This means that teachers must be aware of the cognitive-motivational aspects that influence their learning. This study analyses the academic goals, learning strategies and levels of academic engagement shown by university students in their first year of adaptation to the European Higher Education Area, as well as the relationship between these variables. The results indicate that most students are averagely oriented towards learning goals and highly oriented towards achievement goals, regularly use a wide variety of learning strategies, and show average levels of academic engagement. The correlations between some of these variables are positive and significant. Further research needs to be carried out to understand the role played by different variables in constructing quality autonomous learning processes, not only in relation to students, as in the case of this study, but also in relation to teachers, tasks, contexts, and academic institutions, as well as the different interactions between them.     

Teachers’ use of learning progression-based formative assessment to inform teachers’ instructional adjustment: a case study of two physics teachers’ instruction

ABSTRACT

To explore the affordances of learning progressions (LP) in support of teachers’ formal and informal formative assessment (FFA and IFA) practices, we conducted a case study with a fine-grain-sized energy LP. The study first theorises an LP-based formative assessment model, which proposes the use of LPs in clarifying learning objectives, eliciting and interpreting students’ understanding, and acting in instruction. Then, we examine multiple iterations of two high-school teachers’ lesson plans and their enactment of the lessons to identify the instructional adjustments teachers made as part of the LP-based FFA and IFA after professional training. We found that both teachers refined the learning objectives and activities and most of their adjustments promoted students’ learning progression; their adjustments have an interdependency between objectives and activities. Both made more adjustments in the IFA than in the FFA, but the alignment with the LP was higher in FFA than in IFA. Contrary to the researchers’ expectations, both teachers perceived the LP as a content structure. However, in practice, both employed it as a reference to interpret students’ responses by comparing these responses against their own expectations. The teachers also reported collecting assessment information during teacher-student interactive activities and using this material to infer the level of students’ understanding in order to decide on the next instructional activities. Both teachers reported that the process of directly engaging with the LP formatively resulted in their having a much more nuanced sense of students’ understanding when they revisited and altered the sequence of the learning activities.