Effects of feedback on collaborative writing in an online learning environment

The need for supporting student writing has received much attention in writing research. One specific type of support is feedback—including peer feedback—on the writing process. Despite the wealth of literature on both feedback and academic writing, there is little empirical evidence on what type of feedback best promotes writing in online environments. This article reports on research that tries to determine what type of feedback best improves the quality of collaborative writing and what the effects of feedback are on student learning in an environment based on asynchronous written communication. The results reveal that concerning the type of feedback, epistemic feedback or epistemic and suggestive feedback best improve the quality of collaborative writing performance. The nature of the feedback-giver (whether teacher feedback or teacher and peer) makes a difference to the final text only when the feedback is epistemic, or epistemic and suggestive.     

Reading and writing to learn in secondary education: online processing activity and written products in summarizing and synthesizing tasks

The research reported here employed a multiple-case study methodology to assess the online cognitive and metacognitive activities of 15-year-old secondary students as they read informational texts and wrote a new text in order to learn, and the relation of these activities to the written products they were asked to generate. To investigate the influence of the task, students were required to perform two different tasks which differed in complexity and familiarity. The first task was reading a single text and making a written summary of it, while the second consisted in reading two texts and making a written synthesis of them. To gather information about how students construct meaning from informational texts, we asked students to think aloud as they read and wrote in order to provide us with information about their comprehension and composition processes. We also examined their reading and writing activities during the tasks. The results show that to a large extent secondary school students lack the cognitive and metacognitive processes that would enable them to make strategic use of reading and writing. They also show that, although there are no major differences in the way secondary school students tackle these different tasks, those who create the most elaborate products evidence a more recursive and flexible use of reading and writing. The most obvious conclusion as far as the repercussions of these findings are concerned is that there is an urgent need for work on tasks of this kind in the classroom.     

Engagement with online self-tests as a predictor of student success

Online self-testing as part of the online learning environment (OLE) provides practice questions on key concepts with immediate feedback – in a ‘no-risk’ environment. OLE activity was analysed for 471 on-site and distance students enrolled in health science courses to determine total activity on the OLE and usage of online self-tests. The study also aimed to determine whether utilisation of self-tests differed by final grade, particularly between students who just pass (C grades and Restricted pass) and those who fail (D and E grades). Results indicated that on-site students were significantly more active on the OLE compared to distance students. However, these groups engaged similarly with self-tests and achieved a similar distribution of grades. A significant positive relationship was found between final grade achieved and percentage of self-tests attempted. This relationship was significant regardless of study status (on-site or distance), course studied or total activity logged. A more targeted analysis of C?+?R vs. D?+?E students showed that although these two groups were similar on overall usage of the OLE, C?+?R students utilised self-tests to a significantly greater extent. Recommendations from this study are that students (particularly those struggling to achieve academic success) should be directed towards online self-tests.     

When is the best time to use rubrics in flipped learning? A study on students’ learning achievement,metacognitive awareness,and cognitive load

ABSTRACT

Rubrics can guide teachers to provide effective feedback and students’ peer- and self-assessment. This paper examines the effect of rubric use in flipped learning activities on students’ learning achievement, metacognitive awareness, and cognitive load through a quasi-experiment. A total of 83 university students were randomly assigned to an experimental group or a control group. The students in the experimental group were given rubrics in performing pre-class learning activities on the cloud platform, while those in the control group used rubrics in post-class assessment and modification of their finished works. The results show that rubric use can assist flipped learning by improving students’ learning achievement and metacognitive awareness, while reducing their cognitive load. Using rubrics before in-class work can yield stronger benefits in raising metacognitive awareness and lessening cognitive load. Moreover, the study reveals that students tend to hold a generally favorable attitude toward rubric use. These findings imply that appropriate use of rubrics in flipped learning has the potential to create a more efficient and learner-friendly condition to enhance self-regulated learning.     

The modality effect on reading literacy: perspectives from students’ online reading habits,cognitive and metacognitive strategies,and web navigation skills across regions

This study tested the effects of the modality of reading formats (electronic vs. print), online reading habits (engagement in different online reading activities), use of cognitive strategies, metacognitive knowledge, and navigation skills on printed and electronic reading literacy across regions. Participants were 31,784 fifteen-year-old students (50.78% female) from 19 countries and economies in the 2009 Programme for International Student Assessment database. Results showed that students exhibited better reading literacy in the print environment. Moreover, information-seeking activities, control strategies, knowledge of metacognitive strategies, and navigation skills positively predicted reading literacy in both print and electronic formats for all regions, whereas social reading activities negatively predicted reading literacy in print and were most harmful for the Asian region in both formats. Memorization strategies were negatively associated with reading literacy in both formats for Australasian, Western and Eastern EU, and South American regions, but not for the Asian region. Online reading habits, regardless of types, had no impact on reading literacy in both formats for the South American region. The study findings provided suggestions for literacy instruction in the e-learning era across different regions.     

Developing Student Metacognition through Reflective Writing in an Upper Level Undergraduate Anatomy Course

Incorporating metacognitive strategies in the classroom helps students monitor and adjust their learning strategies throughout the semester, and helps students progress from novice to expert learners in a subject. Journaling (i.e., reflective writing) is one metacognitive task that allows students to contemplate and articulate their skill development as they learn a new subject. The research reported here examines the use of ‘blogs’ (i.e., online journals) in an upper level undergraduate human anatomy course. The blogs both facilitated development of students' metacognitive skills and provided researchers insight into student metacognitive process. Data were examined from 92 students from three successive semesters (spring 2010, 2012 and 2014). Each student reviewed 10 radiology online cases throughout the semester and then reflected on their understanding of anatomy and radiology in an online blog for each case. A total of 927 blogs were examined for this research. The researchers used a grounded theory approach to analyze the blog narratives and develop a codebook based on common themes. The 927 blogs yielded 11,082 statements that were coded with the codebook. As the semester progressed, the blog entries showed that students demonstrated greater self-confidence in their abilities to understand the subject matter, expressed greater enthusiasm for anatomy in general, and they improved their metacognitive skills. This research illustrates that reflective writing in an undergraduate anatomy course not only facilitates improvement in student metacognitive skills, but also provides the instructor with evidence how a student progresses from novice to more experienced learner in anatomy.     

Fostering learners’ metacognitive skills of keyword reformulation in image seeking by location-based hierarchical navigation

It is critical that students learn how to retrieve useful information in hypermedia environments, a task that is often especially difficult when it comes to image retrieval, as little text feedback is given that allows them to reformulate keywords they need to use. This situation may make students feel disorientated while attempting image searching. This study thus designed an image navigation tool, location-based hierarchical navigation support (LHINS), which can dynamically construct a compact WordNet-based hierarchy augmented by location. Using this tool, learners can assimilate new information based on their existing knowledge structure, thus avoiding cognitive overload so as to scaffold their metacognitive skills. Sixty-four high school students were invited to take part in an experiment to test the efficacy of the proposed tool compared to a normal keyword-based search (NKBS) system. The experiment evaluated not only the students’ task completion time in the NKBS and LHINS groups, but also their keyword reformulation process, in order to determine the differences in their metacognitive skills. The results revealed that the LHINS group tended to complete the tasks faster and develop better metacognitive skills related to keyword reformulation as compared to the NKBS group. This finding suggests that an image search engine, enhanced by a compact hierarchical navigation tool, can help learners develop better search strategies. When examining how learners with different cognitive styles used the tool, the results showed that learner performance depends on cognitive style, as well as the image retrieval system used, and thus a more detailed investigation of the interaction between the tool and cognitive styles was conducted. Based on these results, several suggestions are derived for designing a more powerful image navigation tool.     

Content analysis of online discussion on a senior-high-school discussion forum of a virtual physics laboratory

In this study we content analyzed the online discussion of several senior-high-school groups on a forum of a virtual physics laboratory in Taiwan. The goal of our research was to investigate the nature of non-course-based online discussion and to find out some useful guidelines in developing such discussion forums for learning purposes. We adapted Henri’s framework and models (1992) for our analysis. The content analysis was conducted in terms of participation rate, social cues, interaction types, and cognitive and metacognitive skills. In this study, we compared the result patterns of two discussion conditions (‘required’ (R-) condition versus ‘non-required’ (NR-) condition) of a non-course-based discussion forum and investigated how the quality of message content changed in the processes of discussion. In the R-condition, participants were required to reply to the thread before they were allowed to read other messages on the forum, whereas participants in the NR-condition were not restricted to this demand. The results showed that for both conditions, the most frequently involved interaction type was ‘direct response’, and the most frequently used cognitive skill was ‘elementary clarification’. Fewer participants of the R-condition strayed from the subject under discussion in comparison to the NR-condition. However, larger percentage of message content containing metacognitive components was found in the NR-condition. When taking the sequences of postings into account, we found that for the R-condition, the percentage of metacognitive component in the message content tended to increase in the up-third postings, whereas for the up-third postings of the NR-condition the percentage of non-cognitive components substantially increased. Overall, the results of our study indicated that the way in which participants used cognitive and metacognitive skills during the discussions was related to the discussion conditions. The initial requirement of reply fostered the use of cognitive skills, but it did not necessarily induce the use of high-level cognitive or metacognitive skills. We concluded that beside the discussion conditions the moderators’ guidance would be influential in determining the quality of online discussion on a non-course-based discussion forum. in final form: 19 August 2005     

Examining the influences of epistemic beliefs and knowledge representations on cognitive processing and conceptual change when learning physics

The purpose of this study was to investigate the role of epistemic beliefs and knowledge representations in cognitive and metacognitive processing when learning about physics concepts through text. Specifically, we manipulated the representation of physics concepts in texts about Newtonian mechanics and explored how these texts interacted with individuals’ epistemic beliefs to facilitate or constrain learning. Results revealed that when individuals’ epistemic beliefs were consistent with the knowledge representations in their assigned texts, they performed better on various measures of learning (use of processing strategies, text recall, and changes in misconceptions) than when their epistemic beliefs were inconsistent with the knowledge representations. These results have implications for how researchers conceptualize epistemic beliefs and support contemporary views regarding the context sensitivity of individuals’ epistemic beliefs.     

How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system?

The goal of this study was to investigate 65 students' evidence scores of emotions while they engaged in cognitive and metacognitive self-regulated learning processes as they learned about the circulatory system with MetaTutor, a hypermedia-based intelligent tutoring system. We coded for the accuracy of detecting students’ cognitive and metacognitive processes, and examined how the computed scores related to mean evidence scores of emotions and overall learning. Results indicated that mean evidence score of surprise negatively predicted the accuracy of making a metacognitive judgment, and mean evidence score of frustration positively predicted the accuracy of taking notes, a cognitive learning strategy. These results have implications for understanding the beneficial role of negative emotions during learning with advanced learning technologies. Future directions include providing students with feedback about the benefits of both positive and negative emotions during learning and how to regulate specific emotions to ensure the most effective learning experience with advanced learning technologies.     

大学英语智能写作评分系统中教师监控策略

随着计算机网络技术广泛运用于语言教学,基于网络自主学习的大学英语写作教学便应运而生。但是大学生尚处于认知发展阶段,学习观念和习惯尚未发展成熟,要想自主学习真正行之有效,还要建立有效的质量监控体系。本文提出基于网络自主学习的大学英语写作教学模式中实施教师计划,指导,检查,评价,反馈,调控等监控策略,旨在帮助学生培养自主学习,从而进一步推进大学英语改革,提高大学英语写作教学质量。     

Using scaffolded rubrics to improve peer assessment in a MOOC writing course

This study explored the value of using a guided rubric to enable students participating in a massive open online course in writing to produce more reliable assessments of their fellow students’ writing. To test the assumption that training students to assess will improve their ability to provide quality feedback, a multivariate factorial analysis was used to determine differences in assessments made by students who received guidance on using a rating rubric and those who did not. Although results were mixed, on average students who were provided no guidance in scoring writing samples were less likely to successfully differentiate between novice, intermediate, and advanced writing samples than students who received rubric guidance. Rubric guidance was most beneficial for items that were subjective, technically complex, and likely to be unfamiliar to the student. Items addressing relatively simple and objective constructs were less likely to be improved by rubric guidance.     

Science teachers' sensemaking of the use of epistemic tools to scaffold students' knowledge (re)construction in classrooms

This study explores the process of teacher scaffolding student engagement in epistemic tools from the critical sensemaking perspective. Epistemic tools are contextual artifacts manipulated to investigate and evaluate ideas to construct knowledge within the constraints of a disciplines' representational means. The main sources of our data are ~50 min-long semistructured, responsive interviews with the 14 secondary school science teachers who participated in our professional learning environment (PLE) and implemented the activities from the PLE in their classrooms. We utilized the tools of discourse analysis to explore teacher sensemaking while they learned to teach science with epistemic tools. We then looked at intertextualities of meaning across multiple sets of data such as students' artifacts, pre/postsurveys, audio and video recordings of the workshops, and teachers' written implementation feedback forms. As a result, we recognized a pattern across different classrooms. Teachers would begin with a contextualized goal, and use a pedagogical strategy to scaffold their students as they worked to achieve that goal. Then, all teachers reported they faced some sort of ambiguity (such as grappling with failure, different levels of students). When faced with an ambiguity, teachers would then revise either their contextualized goal or their initial pedagogical strategy to help their students to reach their goals. Finally, we utilized constant-comparative analysis to identify themes for teachers' contextualized goals. Four major themes emerged, including communicating connections to core ideas of science, making sense of how science works, assessing students' learning process outcomes, and fostering students' epistemic agency. The findings of the study have implications for future research and professional development activities on the use of epistemic practices and tools in classrooms with unique contextual characteristics.     

Feedback on feedback: eliciting learners’ responses to written feedback through student-generated screencasts

Despite the potential benefits of assignment feedback, learners often fail to use it effectively. This study examines the ways in which adult distance learners engage with written feedback on one of their assignments. Participants were 10 undergraduates studying Spanish at the Open University, UK. Their responses to feedback were elicited by means of student-generated screencast (Jing®) recordings in which students talked through the feedback written by their tutors. The recordings were analysed in terms of the students’ cognitive, affective and metacognitive responses to the tutors’ feedback. Results show that, while students do engage with tutor feedback and make active efforts to integrate it, they sometimes use ineffective strategies, especially when tutor and student make different assumptions about the role of feedback. The richness of the data obtained from the Feedback on feedback (F on F) method suggests that it has the potential to promote much needed feedback dialogue between students and tutors.     

Developing Students as Writers Through Collaboration

Revision is recognised as a key and complex element of the writing process. Despite this, research shows that students find it difficult effectively to revise their own writing due to a lack of metacognitive awareness and understanding of the processes they undertake when writing. The first part of this inquiry studies nine students’ understanding of the writing process and the revision strategies they employ using think‐aloud protocols and follow‐up interviews. Although the students all agreed that revision was an important part of improving their writing, they could not, or found it difficult to, articulate reasons for the changes they made to their writing. Therefore, the second part of the study explores the potential of collaborative writing to encourage and facilitate metacognitive talk through the implementation of a strategy where students are paired with a ‘writing buddy’. Observations of classroom work and interview responses of students showed that the scheme was successful in providing students with an experience of writing which was social, flexible and holistic, where talk is used to externalise thinking in order to develop a metacognitive understanding of the writing process.     

Exploring the value of peer feedback in online learning for the provider

This paper reviews studies of peer feedback from the novel perspective of the providers of that feedback. The possible learning benefits of providing peer feedback in online learning have not been extensively studied. The goal of this study was therefore to explore the process of providing online peer feedback as a learning activity for the provider. We concluded that (1) providing online peer feedback has several potential learning benefits for the provider; (2) when providing online peer feedback, students use different cognitive processes; (3) the cognitive processes and the potential learning benefits can be realised when students use specific elements in the feedback they provide.     

为在线学习提供有效的反馈

在教与学的过程中,学生与教师都会提出反馈,也会收到反馈.课程应该提供不会让人感到威胁的环境,学生在其中能够向教师和其他学生充分地表达自己.学生需要得到针对他们工作和表现的、持续的、及时的反馈.提供有效的反馈有助于保证学生的需求得以满足,有助于保证他们能够开展高质量的学习.(Co-hen,2003:Thurmond 和 Wambach,2004)本文主要讨论的是对学生提供的反馈,而反馈本身也是对学习者的工作和活动的回应,帮助学习者更好地理解他所取得的进步,或帮助学习者改善他的学习或表现.反馈可以在教师和学生之间、学生与学生之间,也可以是学生对自身的长处或改进学习活动的某一方面进行的反思和评价.要使反馈真正有效,对学生提供的反馈应着重于缩小学生当前的表现与期望目标之间的差距.文中所提出的案例均来自于本人在线教学经历过的或访谈在线教师过程中了解到的.     

Students’ motivation and teachers’ teaching practices towards the use of blogs for writing of online journals

This research paper explores students’ motivation and teachers’ teaching practices towards the writing of compositions in the conventional paper-based (paper and pencil) and the online blogs mode. Six classes of Grade 5 (224 students) and four English teachers in an elementary-level future school in Singapore were involved in this study. A total of four written assignments were given to the students – two conventional paper and pencil and two online blog-written assignments. No significant difference was found in students’ scores on these assignments. However, the submission rate for the conventional paper-based assignments was 93.8% as compared to 75% for the online blogs entries. Although both students and teachers in this study are savvy information communication technology users who have been exposed to one-to-one computing since Grade 1, the use of blogs for journal writing was not natural to both parties. Teachers found that it was more cumbersome to grade and give comments on students’ online blog posts via the online platform and likewise, students also faced issues with the submission of their online writing assignments. Some students quoted that they preferred writing via conventional paper and pencil mode, experienced network connection and technical issues, had poor time management, experienced forgetfulness and distraction from the computers and the Internet for not submitting their online writing assignments. This study also once again highlighted the importance of the teacher, as one out of the four teachers managed to get all her students to submit their writing assignments. The in-depth analysis of the interviews with the teachers and students, students’ perception survey, students’ performance in their writing tasks (both online and paper-based) and submission rates had revealed useful insights and considerations on the use of blogs to engage students in writing.     

A new perspective on memorization practices among East Asian students based on PISA 2012

Abstract

This study examined learning strategy use in mathematics among East Asian students in East Asian educational systems. By employing latent class analysis on the Programme for International Student Assessment (PISA) 2012 data, we found four classes of learning strategy types, namely memorization with metacognitive strategies (17.49%), metacognitive strategies with memorization (50.70%), elaboration only (10.33%), and metacognitive strategies with elaboration (16.47%). The results showed that the majority of the students in all seven East Asian educational systems belonged to the ‘metacognitive strategies with memorization’ class, and most students adopted more than one type of learning strategy when learning mathematics. Additionally, students who reported the use of metacognitive strategies along with either memorization or elaboration showed higher mathematics achievement. We conclude that the cognitive processes employed by students of East Asian backgrounds are more complex and nuanced than the previous perception that they relied heavily on memorization.     

Cueing Metacognition to Improve Researching and Essay Writing in a Final Year High School Biology Class

This paper reports on degrees of awareness and use of specific metacognitive strategies by 16 students in a final-year high school biology class in New Zealand. The aims of the intervention were to broaden students' thinking about bioethical issues associated with cancer and to enhance students' use of metacognition. Cues and prompts were used in this unit of work to help students use metacognitive strategies since students did not generally use metacognitive strategies spontaneously. Scaffolding was mediated through the teacher modelling, questioning, cueing or prompting students to evaluate their learning. The research reported here illustrates how teachers can cue students to be more self-directed in their learning. Three case studies illustrate how learning strategies were used differentially. Most students were aware of strategies that could help them to learn more effectively. It was found that those students who were not only aware of but also used strategies to plan, monitor and evaluate their work, produced essays of higher quality.