A comparison of student evaluations of teaching between online and face-to-face courses

The literature contains indications of a bias in student evaluations of teaching (SET) against online instruction compared to face-to-face instruction. The present case study consists of content analysis of anonymous student responses to open-ended SET questions submitted by 534 students enrolled in 82 class sections taught by 41 instructors, one online and one face-to-face class section for each instructor. There was no significant difference in the proportion of appraisal text segments by delivery method, suggesting no delivery method bias existed. However, there were significant differences in the proportion of text segments for topical themes and topical categories by delivery method. Implications of the findings for research and practice are presented.     

Applying the scholarship of teaching and learning: student perceptions,behaviours and success online and face-to-face

This study compares student perceptions, learning behaviours and success in online and face-to-face versions of a Principles of Microeconomics course. It follows a Scholarship of Teaching and Learning (SoTL) approach by using a cycle of empirical analysis, reflection and action to improve the learning experience for students. The online course design involves 58 interactive narrated online modules, interactive online quizzes and biweekly online meetings with the instructor via video and voice-over-IP technology. Findings indicate that schedule flexibility motivates students to choose the online course format. Students in both learning environments felt they had high-quality communication with the instructor, while online students indicated limited peer-to-peer communication. Online students report studying more at home than face-to-face students, but not enough to compensate for the time face-to-face students spend in class. Reflecting on the findings, the authors suggest actions to improve the online course experience.     

Learning online,offline, and in-between: comparing student academic outcomes and course satisfaction in face-to-face,online, and blended teaching modalities

The purpose of this study was to conduct a three-way comparison of face-to-face, online, and blended teaching modalities in an undergraduate Child Development course to determine if there were differences in student academic outcomes and course satisfaction across modalities. Student academic outcomes were measured by three examinations, one research paper assignment, and the overall course total grade. Course satisfaction was measured by administering the Student Opinion Questionnaire (SOQ) across the three teaching modalities and the Constructivist On-Line Learning Environment Survey (COLLES) to online and blended modalities. Results indicated that students performed equally well on all three examinations, research paper, and the overall course total grade across three teaching modalities, allaying traditional reservations about online and blended teaching efficacy. The SOQ and COLLES analysis found students from the three modalities were equally satisfied with their learning experiences. A Two-Factor Model identifying Face-to-Face Interaction and Learn on Demand (Flexibility) as factors determining student academic outcomes was proposed. Implications, limitations, and future research direction were discussed.     

Computer-mediated instruction: a comparison of online and face-to-face collaboration

This study investigated the effects of collaboration mode and group composition during a computer-mediated collaborative (CMC) program. Six intact sections of a computer literacy course were assigned to either a face-to-face or a virtual, online collaboration treatment condition. Groups consisted of homogeneous lower-ability, homogeneous higher-ability, or heterogeneous-ability pairs. The study examined the effects of collaboration mode and group composition on individual posttest performance, group project performance, collaborative interaction behavior, and attitudes towards the instruction. Results indicated that virtual dyads exhibited significantly more questioning behaviors and significantly better project performance than those who collaborated face-to-face. By comparison, students in the face-to-face condition performed significantly better on the individual posttest than those in the virtual online condition. Findings suggest that both virtual and face-to-face collaboration can be effective in achieving learning goals. However, consideration should be given to the collaborative structure of the lesson and the type of task in the design of CMC environments.

Self-regulatory and demographic predictors of grades in online and face-to-face university cohorts: A multi-group path analysis

Predictors of academic success at university are of great interest to educators, researchers and policymakers. With more students studying online, it is important to understand whether traditional predictors of academic outcomes in face-to-face settings are relevant to online learning. This study modelled self-regulatory and demographic predictors of subject grades in 84 online and 80 face-to-face undergraduate students. Predictors were effort regulation, grade goal, academic self-efficacy, performance self-efficacy, age, sex, socio-economic status (SES) and first-in-family status. A multi-group path analysis indicated that the models were significantly different across learning modalities. For face-to-face students, none of the model variables significantly predicted grades. For online students, only performance self-efficacy significantly predicted grades (small effect). Findings suggest that learner characteristics may not function in the same way across learning modes. Further factor analytic and hierarchical research is needed to determine whether self-regulatory predictors of academic success continue to be relevant to modern student cohorts.

Practitioner Notes

What is already known about this topic

• Self-regulatory and demographic variables are important predictors of university outcomes like grades.
• It is unclear whether the relationships between predictor variables and outcomes are the same across learning modalities, as research findings are mixed.

What this paper adds

• Models predicting university students' grades by demographic and self-regulatory predictors differed significantly between face-to-face and online learning modalities.
• Performance self-efficacy significantly predicted grades for online students.
• No self-regulatory variables significantly predicted grades for face-to-face students, and no demographic variables significantly predicted grades in either cohort.
• Overall, traditional predictors of grades showed no/small unique effects in both cohorts.

Implications for practice and/or policy

• The learner characteristics that predict success may not be the same across learning modalities.
• Approaches to enhancing success in face-to-face settings are not automatically applicable to online settings.
• Self-regulatory variables may not predict university outcomes as strongly as previously believed, and more research is needed.

     

A study of teaching presence and student sense of learning community in fully online and web-enhanced college courses

This paper focuses on two components of a model for online teaching and learning—“teaching presence” and “community”. It is suggested that previous research points to the critical role that community plays in academic success and persistence in higher education. Through a review of recent literature it is proposed that teaching presence–viewed as the core roles of the online instructor–is a promising mechanism for developing learning community in online environments. This investigation presents a multi-institutional study of 1067 students across 32 different colleges that further substantiates this claim. An instrument to assess instructor teaching presence (“The Teaching Presence Scale”) is presented and validated. Factor and regression analysis indicate a significant link between students' sense of learning community and effective instructional design and “directed facilitation” on the part of course instructors, and highlights interesting differences between online and classroom environments. Alternative hypotheses regarding student demographics associated with variables such as age (the “net generation” effect) and gender are also examined. Despite recent assertions that younger students are or soon will be too sophisticated to “feel at home” in largely text-based asynchronous learning environments, no significant effects were found by demographic differences examined. Recommendations for online course design, pedagogy, and future research are included.     

Psychological capital development effectiveness of face-to-face,online, and Micro-learning interventions

Education and Information Technologies - There is growing empirical support for the benefits of developing psychological capital (PsyCap), and the effectiveness of PsyCap interventions (PCIs) in...     

A model of online and general campus‐based student engagement

Knowing how campus‐based students engage in key online and general learning practices can play a central role in managing and developing university education. Knowledge in this area is limited, however, despite recent advances in student engagement research, and widespread adoption of online learning systems. This paper responds to the need to develop such knowledge, by documenting the development and application of a typological model of online and general campus‐based student engagement. It reports the statistical analyses used to develop the model, and analyses the model’s structure and substance. The model is exemplified by considering what it says about how increasingly powerful and pervasive online technologies might be leveraged to enhance campus‐based student engagement.     

Virtual teamwork: students studying about ethics in an online environment

The fundamental concepts of ethics: value, obligation and responsibility are what many of us use in our everyday decision‐making on issues that affect our lives. Students in the coursework unit ‘Science and technology in contemporary society’ learn about these concepts in relation to science and technological research and development. The learning takes place in small teams within an online learning environment. This research study reports on a case study that investigated the nature of the collaboration by virtual team members undertaking semi‐structured online tasks to develop an understanding of the topic on ethics in the coursework unit. Students’ perceptions of the usefulness of this type of learning, the types of collaboration that took place between virtual team members and an analysis of the quality of the completed tasks resulting from the virtual teamwork are presented in this paper. Factors affecting the success of the learning experience are also discussed.     

Predicting student success by modeling student interaction in asynchronous online courses

Early-warning intervention for students at risk of failing their online courses is increasingly important for higher education institutions. Students who show high levels of engagement appear less likely to be at risk of failing, and how engaged a student is in their online experience can be characterized as factors contributing to their social presence. Social presence begins with teacher-student and student-student interaction in online courses. Fortunately, student interaction data can be gleaned from learning management systems, used to model and predict at-risk students at an early stage. This research addresses an existing model for predicting at-risk students to test a previous hypothesis that a holiday effect is a contributor for failure. A new analysis then presents an alternative approach, one that tests the frequency of student interaction rather than amount of interaction as a preferable indicator.     

Comparing face-to-face and asynchronous online communication as mechanisms for critical reflective dialogue

Two mechanisms for engaging in critical reflective dialogue are discussed and compared: face-to-face meetings and asynchronous online discussion. The context is an umbrella action research project, with over 20 participants, which aimed to improve practices in online teaching and contribute to the development of graduate attributes. The article compares discussion using the two modes (face-to-face and online) of the nature of and development of problem-solving and other graduate attributes. Face-to-face discussion was wide ranging and quite loosely structured, so divergent aspects of a topic were uncovered. The asynchronous nature of online discussion, however, permitted topics to be explored more thoroughly. The two modes worked well in conjunction with one another, if aspects of face-to-face discussion topics were posted online as discussion threads. The asynchronous online discussions then allowed each thread to be explored in depth, so that collective understanding of a given topic could be enhanced.     

Building student trust in online learning environments

As online learning continues to gain widespread attention and thrive as a legitimate alternative to classroom instruction, educational institutions and online instructors face the challenge of building and sustaining student trust in online learning environments. The present study represents an attempt to address the challenge by identifying the social and technical factors that can likely induce or influence students’ perception about the trustworthiness of an online course and integrating the factors into a socio-technical framework that can be empirically validated. The methodology used and the data obtained from a university-wide survey conducted in an American university are reported in this article. Feedback from students with disabilities was further investigated, and the result has important implications for our understanding of disabled students’ acceptance for online learning.