Evaluating the quality of interaction in asynchronous discussion forums in fully online courses

Fully online courses are becoming progressively more popular because of their “anytime anywhere” learning flexibility. One of the ways students interact with each other and with the instructors within fully online learning environments is via asynchronous discussion forums. However, student engagement in online discussion forums does not always take place automatically and there is a lack of clarity about the ideal role of the instructors in them. In this article, we report on our research on the quality of discussion in fully online courses through analysis of discussion forum activities. We have conducted our research on two large fully online subjects for computing students over two consecutive semesters and used a grounded theoretic approach for data analysis. Our results reveal what students and instructors consider as quality interaction in fully online courses. We also propose two frameworks based on our findings that can be used to ensure effective online interaction.     

Assessing participation skills: online discussions with peers

Many tertiary-level courses assess students’ participation in tutorial or online discussions. However, in educational and pedagogical research literature, criteria for assessing students’ skills in engaging with peers remain unclear. This article describes an online assignment with a set of participation criteria and a method for assessing the quality of students’ interactions with peers. The assignment focuses on students’ ability to utilise their critical thinking skills while engaging with peers on a particular topic. This includes abilities such as responding to criticism, justifying one’s view and contributing to discussion. While the assignment is designed for a critical thinking course in a philosophy curriculum, the method and participation criteria may be adapted for assessment in other discipline areas.     

Participation in asynchronous online discussion forums does improve student learning of gross anatomy

Asynchronous online discussion forums are common in blended learning models and are popular with students. A previous report has suggested that participation in these forums may assist student learning in a gross anatomy subject but it was unclear as to whether more academically able students post more often or whether participation led to improved learning outcomes. This study used a path model to analyze the contribution of forum participation, previous academic ability, and student campus of enrolment to final marks in a multicampus gross anatomy course for physiotherapy students. The course has a substantial online learning management system (LMS) that incorporates asynchronous forums as a learning tool, particularly to answer learning objectives. Students were encouraged to post new threads and answer queries in threads started by others. The forums were moderated weekly by staff. Discussion forums were the most used feature of the LMS site with 31,920 hits. Forty‐eight percent of the students posted at least once with 186 threads initiated by students and a total of 608 posts. The total number of posts made a significant direct contribution to final mark (P = 0.008) as did previous academic ability (P = 0.002). Although campus did not contribute to final mark, there was a trend for students at the campus where the course coordinator was situated to post more often than those at the other campus (P = 0.073). These results indicate that asynchronous online discussion forums can be an effective tool for improving student learning outcomes as evidenced by final marks in gross anatomy teaching. Anat Sci Educ. 7: 71–76. © 2013 American Association of Anatomists.     

Student outcomes associated with use of asynchronous online discussion forums in gross anatomy teaching

Asynchronous online discussion forums are increasingly common in blended learning environments but the relationship to student learning outcomes has not been reported for anatomy teaching. Forums were monitored in two multicampus anatomy courses; an introductory first year course and a second year physiotherapy‐specific course. The forums are structured with a separate site for each course module and moderated weekly by staff. Students are encouraged to post to new threads (initial post) and answer queries in threads started by others (reply post). Analysis of forums was conducted separately for each course and included overall activity (posts and views) for a full semester and a detailed analysis for one week in the middle of semester. Students were classified as zero, moderate, or high contributors to the forums based on the number of posts. Final mark for the course was related to level of forum contribution using nonparametric tests. Forum threads were characterized as task‐focused, administrative, or other. A higher proportion of second year (36%) than first‐year (17%) students posted on the forums and the postings were more likely to be task‐focused and student initiated. Second‐year students that posted frequently to the forum gained a higher final mark for the course than those that did not post or only posted a moderate number of times (P < 0.01). This relationship was not evident for first‐year students who had a much higher proportion of administrative threads. Forums in anatomy courses can be powerful learning tools encouraging deeper learning and improved learning outcomes. Anat Sci Educ 6: 101–106. © 2012 American Association of Anatomists.     

Development of reasoning skills through participation in collaborative synchronous online discussions

This article investigates the effect of participation in synchronous online discussions on the development of individual reasoning as manifested in reflective essays. Students from a fourth-grade classroom engaged in a series of real-timeonline discussions. The format of the discussion was based on the Collaborative Reasoning approach which has clear guidelines and procedures. The results showed that compared to the students from the contrast classroom, the students who had experienced synchronous online discussions wrote essays with more satisfactory arguments, counterarguments, rebuttals, and textual information. In addition, they wrote longer essays which contained fewer irrelevant statements. These effects of online discussions were consistent between girls and boys and between shy and non-shy children. The students' uses of arguments and rebuttals, as well as the length of their essays, were adequately predicted by the frequency of their contributions in the discussions. The present study suggests that when an online chat is implemented with an instructional approach which has well-established procedures and effective moves, it can provide an intellectually stimulating context in which all students can learn to reason by interacting with one another.     

Reconceptualizing the pedagogical value of student facilitation

Sustained discourse is critical to the learning potential of online courses. And, while research has surfaced many factors that mediate interaction, it further suggests that sustained interaction remains elusive. In this paper, I propose that student facilitation may have an impact on the quality of facilitators' interactions following a week of moderating a course discussion. Through a survey of students in two post-secondary online courses, the results suggest that moderation fosters understanding of online learning processes and enhances interaction with others and content. I therefore suggest that moderation acts to inculcate students into the social fabric of an online course, prior to which their role and performance is ill-defined.     

Improving the quality of online discussion: the effects of strategies designed based on cognitive load theory principles

This article focuses on heavy cognitive load as the reason for the lack of quality associated with conventional online discussion. Using the principles of cognitive load theory, four online discussion strategies were designed specifically aiming at reducing the discussants’ cognitive load and thus enhancing the quality of their online discussion. The results indicate that, compared to a conventional discussion strategy, the discussion quality was significantly enhanced for participants using example-posting strategy and limited-number-of-posting strategy. Cognitive load was significantly reduced for participants using filtered-posting and combination strategies. Instructional efficiency of all proposed strategies was found to be significantly better than conventional discussion strategy. The results are discussed and implications of the findings on instructional design application and future research are also presented.     

Using communities of practice as a tool to analyse developing identity in online discussion

In this article, we address the methodological implications of analysing online discussion boards with a focus on participants' changing identities. More specifically, we propose the use of a Communities of Practice framework as a heuristic method for considering how participants' contributions to online discussion play a role in changing who they become, as opposed to what they learn. We argue that many analyses of online communication fail to take account of learning as a change in identity – what/who the learner is (becoming) – and focus mainly on the opportunity for cognitive development – what they know. In doing so, we use a single case study from a discussion board for secondary-aged students of mathematics which acts as a ‘telling case’ before demonstrating what this might say about other contexts for online learning. We argue that this has important implications for both research into, and the design of, online education.     

The role of expressed emotions in online discussions

Abstract

We investigated relationships among expressed emotions, perceived motivation, perceived emotions, and three dependent variables (i.e., behavioral engagement, cognitive engagement, and student achievement) in the context of a blended online course. We defined “expressed emotions” as emotions detected by an affective computing tool in messages that students posted to online discussion forums in a blended undergraduate writing course. The results of two-step hierarchical multivariate regressions revealed that expressed emotions differentiated positive emotions from negative emotions better than perceived emotions did. Moreover, while no significant effect emerged for perceived motivation and perceived emotions, expressed fear was a significant predictor of student achievement (i.e., final score). Although affective computing is in its infancy, our findings suggest the potential use of expressed emotions for educational research and practice.     

Practices of parental participation: a case study

The nature of parental participation in children’s education is changing rapidly. A growing body of research points to the positive effect that parental involvement has on outcomes of schooling and on children’s well‐being. This paper examines parental participation practices in terms of parents working together with a range of professionals, exchanging knowledge and information regarding their child’s SEN, challenging practices, and negotiating SEN provision. The parents in this study exercised agency – that is, they showed resilience and took initiative, within a context of shared responsibility and accountability, and advocated for their child’s right to educational provision. This paper argues for a strengths‐based approach towards enabling active parental participation and advocacy.     

Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment

The purpose of this study is to examine the effect of online assessment training, with synchronous group discussion as a key component, on subsequent web-based peer assessment results. Participants included 81 college students, mostly women, taking a business writing class. After initial submission of a draft counter-offer letter, they completed online assessment training by engaging in a consensus-seeking, synchronous group discussion of the rubric-based ratings they gave to sample counter-offer letters. They then engaged in web-based assessment of randomly assigned peer counter-offer letters and upon receiving peer feedback, submitted revision of their own counter-offer letter. The discussion groups were randomly assigned to either anonymous (using a pseudo name) or identified conditions (using real name). Findings indicate that the quality of student counter-offer letters improved after online assessment training, and improved even more after web-based peer assessment. There were no significant differences between anonymous discussion groups and identified groups.     

“Safe Harbor”: Evaluation of a professionalism case discussion intervention for the gross anatomy course

Medical professionalism is a multifaceted paradigm and is an essential component of medical education. Gross anatomy is a laboratory to teach professionalism, and promoting critical reflection in medical students is a prerequisite to furthering professionalism. The aim of this study was to determine if professionalism case discussions during a Gross Anatomy course improve students' reflections using a validated reflection instrument (12 items; five‐point Likert scale where 1 = Disagree, 2 = Disagree with reservation, 3 = Neutral, 4 = Agree with reservation, 5 = Agree). Four facilitated reflection sessions were aimed at fostering reflective capacity through reflection on elements of professionalism. Results did not show a significant change between pre‐and postintervention reflection scores (3.45 ± 0.61 vs. 3.48 ± 0.51; P = 0.82). Historical control students were found to have significantly higher reflection scores when compared with postintervention students (3.91 ± 0.53 vs. 3.48 ± 0.51; P < 0.001). However, the historical control students were found to have significantly higher professionalism scores (P = 0.001) as compared with the intervention students. Student satisfaction was high, with 25 of 28 (89.2%) students reporting that the sessions should be included as a component of future anatomy courses. While reflection scores were not significantly increased as a result of the intervention, students expressed appreciation for the opportunity to discuss professionalism issues related to the dissection of cadavers. Additionally, the intervention students had both lower professionalism scores and lower reflection scores, which supports the idea that highly professional students are more capable of reflecting on professionalism. Future studies should determine whether this case discussion intervention improves objective measures of professionalism. Anat Sci Educ 7: 191–198. © 2013 American Association of Anatomists.     

Content analysis of online discussion on a senior-high-school discussion forum of a virtual physics laboratory

In this study we content analyzed the online discussion of several senior-high-school groups on a forum of a virtual physics laboratory in Taiwan. The goal of our research was to investigate the nature of non-course-based online discussion and to find out some useful guidelines in developing such discussion forums for learning purposes. We adapted Henri’s framework and models (1992) for our analysis. The content analysis was conducted in terms of participation rate, social cues, interaction types, and cognitive and metacognitive skills. In this study, we compared the result patterns of two discussion conditions (‘required’ (R-) condition versus ‘non-required’ (NR-) condition) of a non-course-based discussion forum and investigated how the quality of message content changed in the processes of discussion. In the R-condition, participants were required to reply to the thread before they were allowed to read other messages on the forum, whereas participants in the NR-condition were not restricted to this demand. The results showed that for both conditions, the most frequently involved interaction type was ‘direct response’, and the most frequently used cognitive skill was ‘elementary clarification’. Fewer participants of the R-condition strayed from the subject under discussion in comparison to the NR-condition. However, larger percentage of message content containing metacognitive components was found in the NR-condition. When taking the sequences of postings into account, we found that for the R-condition, the percentage of metacognitive component in the message content tended to increase in the up-third postings, whereas for the up-third postings of the NR-condition the percentage of non-cognitive components substantially increased. Overall, the results of our study indicated that the way in which participants used cognitive and metacognitive skills during the discussions was related to the discussion conditions. The initial requirement of reply fostered the use of cognitive skills, but it did not necessarily induce the use of high-level cognitive or metacognitive skills. We concluded that beside the discussion conditions the moderators’ guidance would be influential in determining the quality of online discussion on a non-course-based discussion forum. in final form: 19 August 2005     

Update your status: exploring pre-service teacher identities in an online discussion group

A substantial body of research indicates that a teacher’s identity is an essential aspect of their professional practice. As this body of research grows, researchers have increasingly sought to investigate the nature of pre-service teacher identities. This paper reports on a study that examined identities in the context of a pre-service cohort’s online discussion group. By examining the group, this study attempted to address a gap in research knowledge, as research to this date has been unable to investigate pre-service teacher identities in non-course-endorsed or instructor-occupied spaces. A thematic and quantitative analysis of online postings by and interviews with group members provided an insight into how identities performed and related to one another within the online discussion group. The findings indicate that one category of identities emerged from a commitment to the social expectations and values of the group, whilst another emerged out of a personal resistance towards the social norms of group participation and involvement. This study may be useful for teacher educators deliberating the use of online spaces to support pre-service teacher identity development.     

Interaction and cognitive engagement: An analysis of four asynchronous online discussions

Online discussion plays a unique role in face-to-face and distance teaching and learning. Interaction and student cognitive engagement during the online discussion are critical for constructing new understanding and knowledge. This article analyzes types of interaction that occur during online discussions, examines levels of student cognitive engagement in each discussion, and explores their effects on and implications for learning and teaching in higher education. By combining methods of social network analysis with qualitative content analysis, the article explores new methodologies for analyzing participation, interaction, and learning that take place online, and suggests areas for research in learning and teaching online.     

Radical student participation: lessons from an urban government primary school in Tigray,Ethiopia

Recent policies in Ethiopia put students at the heart of school improvement through structures for peer leadership and school-level consultation, evaluation and decision-making. This article draws on an ethnographic study of a government school in Tigray, Ethiopia, to explore how the participation and influence of students is achieved and mediated by structures and processes in school. Three key contexts of student participation are explored: positions of peer leadership (monitor, ‘one-to-five’ network leader); public evaluation sessions (gim gima); and the Parent Student Teacher Association (PSTA). Recommendations are made for sharing and strengthening democratic practices and for future research.     

Peer assessment in a project-based engineering course: comparing between on-campus and online learning environments

As the number of participants in online distance learning courses increases, peer assessment is becoming a popular strategy for evaluating open assignments and for breaking the social isolation surrounding distance education. Yet, the quality and characteristics of peer assessment in massive online courses has received little attention. Hence, this study was set to examine peer feedback quality and grading accuracy in a project-based course. The study applied a sequential exploratory mixed methods design. It included 339 participants who studied the same engineering course, but in three different modes: on-campus (n = 77), small private online course (n = 110), and massive open online course (MOOC) (n = 152). Content analysis of feedback comments identified four categories: reinforcement, statement, verification and elaboration, arranged in an ascending scale of cognitive ability. The findings indicated that the MOOC participants provided more feedback comments and volunteered to assess more projects than their counterparts did. However, the on-campus students provided higher quality feedback and their peer grading was better correlated with the grades assigned by the teaching assistants.     

Visualizing the learning patterns of topic-based social interaction in online discussion forums: an exploratory study

Educational technology research and development - Online discussion forums are common features of learning management systems; they allow teachers to engage students in topical discussions in...