Student evaluation of instruction: comparison between in-class and online methods

This study compares student evaluations of instruction that were collected in-class with those gathered through an online survey. The two modes of administration were compared with respect to response rate, psychometric characteristics and mean ratings through different statistical analyses. Findings indicated that in-class evaluations produced a significantly higher response rate than online evaluation. In addition, Rasch analysis showed that mean ratings obtained in in-class evaluation were significantly higher than those obtained in online evaluation. Finally, the distributions of student attendance and expected grade in both modes were compared via chi-square tests, and were found to differ in the two modes of administration.     

Self-regulation in three types of online interaction: a scale development

The purpose of this study was to develop a scale with which to examine students’ self-regulation (SR) in three types of online interaction. Using scale development steps, we constructed the online self-regulation questionnaire (OSRQ), a self-report survey. A total of 799 online students participated in the study. Data from 400 randomly selected participants were used for exploratory factor analysis (EFA), and data of the remaining 399 participants were used for confirmatory factor analysis (CFA). The EFA yielded three factors as hypothesized: SR in interaction between student and content, SR in interaction between student and student and SR in interaction between student and teacher. The CFA demonstrated that the factor structures appearing in the EFA were also observed with different participants. In addition, we found convergent validity in the OSRQ. The study contributes to understanding SR in online learning settings.     

大学生在线学习投入对学习绩效的影响研究——以西部某新建师范院校为例

以群体动力学理论为基础,以西部某新建师范院校在校本科生为研究对象,构建了在线学习投入对学习绩效的解释结构模型。研究表明:群体动力学理论的基本假设对开展在线学习行为研究具有一定的适用性和拓展性;大学生参加在线学习的内部动机越强,其情感投入、学习绩效越高;情感投入度越高,其行为投入、认知投入度越高;增强线上交互有助于强化情感投入;增强情感投入有助于强化内部动机对认知投入的影响和线上交互对行为投入的影响;增强认知投入和行为投入,有助于强化情感投入对学习绩效的影响。因此,高校应进一步规范课程引入、强化选课指导、优化学习空间,以增强大学生在线学习的内部动机,提升线上交互质量。     

From learning to development: a sociocultural approach to instruction

Theories of human development and learning provide an essential framework in which to understand the mechanisms involved in the process of formal instruction as a specific form of teaching and learning in the school setting. The sociocultural theory of development, founded on the works of Lev Vygotsky, espouses the view that social interaction among two or more people is the greatest motivating force in human development. Communication, via the use of language, provides one of the most effective means of social interaction. By collaborating toward a common cultural goal, people co‐construct new knowledge by building on each participant's contribution. Based on the main tenets of sociocultural theory, the following eight interrelated principles for instruction are presented, namely, that it should be: mediated; discursive; collaborative; responsive; contextualized; activity‐oriented; developmental; and integrated.     

Using personalized learning as an instructional approach to motivate learners in online higher education: Learner self-determination and intrinsic motivation

Abstract

In this qualitative comparison study, we examine the perceived efficacy of using personalized learning (PL) activities based on PL principles to support students’ psychological need satisfaction and intrinsic motivation in an online course using a traditional one-size-fits-all model. We apply self-determination theory as a framework to investigate students’ perceptions of their psychological need satisfaction (e.g., competence, autonomy, and relatedness) and relation to students’ intrinsic motivation when enrolled in an online course implementing PL principles. Overall, the study results showed the potential of implementing personalized learning principles in online courses to support students’ psychological need satisfaction (e.g., autonomy and competence) and intrinsic motivation. Furthermore, students perceived the PL interventions as engaging and effective in meeting their learning needs and interests.     

Transforming online teaching practice: critical analysis of the literature on the roles and competencies of online teachers

Understanding what is lacking in the online teaching literature is critical to helping researchers and practitioners develop programs and support mechanisms for online teachers in higher education. This review formulates a critique of the standards- and competency-driven vision of online teaching from the perspective of transformative learning theory, in order to offer an alternative exploration of the professional development of online teachers as adult learners. The results indicate that while research about online teacher roles and competencies guides the development of teacher preparation and training programs, it lacks in terms of addressing the issues of empowerment of online teachers, promoting critical reflection, and integrating technology into pedagogical inquiry. An alternative perspective is suggested that considers teachers as adult learners who continuously transform their meaning of structures related to online teaching through a continuous process of critical reflection and action.     

Social technologies for online learning: theoretical and contextual issues

Three exemplars are presented of social technologies deployed in educational contexts: wikis; a photo-sharing environment; and a social bookmarking tool. Students were found to engage with the technologies selectively, sometimes rejecting them, in the light of their prior conceptions of education. Some students (a minority in all the studies) were unsympathetic to the educational philosophy underpinning the technology’s adoption. The paper demonstrates, through an examination of in-context use, the importance of sociocultural factors in relation to education, and the non-deterministic nature of educational technology. The academic study of technology has increasingly called into question the deterministic views which are so pervasive in popular discourse and among policy-makers. Instead, sociocultural factors play a crucial role in shaping and defining technology and educational technology is no exception, as the examples in the paper show. The paper concludes by drawing out some implications of the examples for the use of social technologies in education.     

A practical approach for applying online remote experiments: OnPReX

The development of Internet technologies stimulates the increase of online technology-supported education in universities. Online learning based on remote experiments is capable of diminishing the scantiness in practical courses. In this paper, we present online practical courses based on remote experiments (OnPReX). These courses consist of online experiments, interactive graphics and an online tutoring-system organised at the Berlin Institute of Technology (TUB). We developed two online practical courses, one focusing on classical and the other on modern physics, for bachelor and intermediate diploma engineering students. Our online practical courses based on remote experiments took place in two test phases during two semesters. These courses were evaluated and the results were used to improve the courses. Our online practical courses on remote experiments have successfully been integrated as electives at the TUB.     

Learning to teach online: a systematic review of the literature on K-12 teacher preparation for teaching online

There is a growing need for qualified online instructors to teach the expanding population of online K-12 students. To meet this need, teachers must be provided learning opportunities to acquire the specific types of knowledge and skills necessary to teach online. In this systematic review of the literature, we utilize the TPACK framework to aggregate the types of knowledge and skills required to teach online and examine both the extent to which these elements are addressed in existing programs and are based on empirical research. Findings suggest that the types of knowledge and skills based on empirical research originate from few studies and that most programs address only a small subset of knowledge and skills, varying greatly without uniformity in content or learning experiences.     

Systems,transfer, and fields: Evaluating a new approach to energy instruction

Energy is a central concept in science in every discipline and also an essential player in many of the issues facing people everywhere on the globe. However, studies have shown that by the end of K-12 schooling, most students do not reach the level of understanding required to be able to use energy to make sense of a wide range of phenomena. Many researchers have questioned whether the conceptual foundations of traditional approaches to energy instruction may be responsible for students' difficulties. In response to these concerns, we developed and tested a novel approach to middle school physical science energy instruction that was informed by the recommendations of the Framework for K-12 Science Education (National Research Council, 2012a) and the Next Generation Science Standards (NGSS) (NGSS Lead States, 2013). This new approach differs substantially from more traditional approaches to energy instruction in that it does not require energy forms and it emphasizes connections between energy, systems, and fields that mediate interaction-at-a-distance. We investigated student learning during this novel approach and contrasted it with student learning within a comparable unit based on a more traditional approach to energy instruction. Our findings indicate that students who learned in the new approach outperformed students who learned in the traditional approach in every quantitative and qualitative aspect considered in this study, irrespective of their prior knowledge of energy. They developed more parsimonious knowledge networks in relation to energy that focused primarily around the concept of energy transfer. This study warrants further investigation into the value of this new approach to energy instruction in both middle and high school.     

Analyzing learner-hypermedia interaction: An overview of online methods

In this paper we examine the potential of online methods for hypermedia research. Online methods allow the recording, analysis and interpretation of learner-hypermedia interaction. Online methods have been extensively used in cognitive research, and especially in the area of discourse processing. In the first part of the paper we examine several online methods used in discourse comprehension research. We discuss the benefits and limits of each method, and its applicability to hypermedia research. In the second part we focus on the analysis of learner-hypermedia interaction protocols. We introduce several possible approaches, as a function of the observation grain, or the precision of the events that the researcher needs to examine. We present qualitative and quantitative examples at the coarse, intermediate and fine grain and we discuss the research context in which each approach seems most appropriate. We conclude that the empirical study of learner-hypermedia interaction should comply with the general standards of empirical research, e.g., explicit hypotheses and controlled study conditions.     

Student identity construction in online teacher education: a narrative life history approach

This paper explores student identity construction through the narrative life history of one non-traditional student, engaged in teacher education in a non-traditional way – a fully online university degree course. The students within this course are all mature-aged. Most are female, and have already developed personal identities as partners, friends and mothers, as well as professional identities such as teacher aides. Adding the new identity of “student” to these already established roles has an impact on these participants’ actions, beliefs, experiences and hence on their identities. Further, the notion that they are now “pre-service teachers” forces students to consider their professional identity in new and sometimes uncomfortable ways. This paper explores the challenges for one student created by the need to negotiate this complexity. Through this exploration using narrative life history methods, the paper considers the implications of the experience of becoming a student and a teacher.     

University teacher roles and competencies in online learning environments: a theoretical analysis of teaching and learning practices

The aim of this article is to clarify the university teacher roles and competencies in online learning environments, with a view to assisting in the design of professional development activities. This referential framework results from an extensive review of the literature and from analysing professional development designed in different European universities. It is worth mentioning that the definitions that will be produced do not refer to standards of teacher performance; on the contrary, we would like to emphasise the notion of socially situated competencies which are derived from the roles and tasks attributed to university teachers in online learning environments, without losing track of the dialectics and integrity of their exercise.     

在线教育：从机遇增长，到融入主流、稳步发展——美国在线高等教育系列调查评估对我国网络教育发展的启示

“在线教育”这种基于现代计算机网络的全新学习环境随着现代信息技术的发展正在成为现代教育系统中重要的组成部分。通过对美国“在线教育”质量和规模的评估报告的分析可以使人们清醒地认识其发展的现状,并把握预测和规划未来发展的依据。美国斯罗恩在线教育中心在巴博森学院和弗兰克林·西奥林工程学院合作下于2003、2004、2005连续三年对在线教育的质量和规模进行了评估,并分别发表了题为“正在增加的机遇”、“正在进入主流”和“稳步发展”的三份调查报告。这三次评估所获得的数据对于我国规划和管理网络教育有一定的借鉴意义。     

Self-directed learning to develop autonomy in an online ESP community

Low foreign language achievers in vocational education often have a lack of learning strategies, a tendency to feel frustrated, and unwillingness to be involved. In order to develop vocational college students’ autonomy, this study integrated on-site workshops with an online learning community by means of self-directed learning English for specific purposes (ESP). The results show that the online ESP community developed students into autonomous learners by (1) employing resource-based approach to download learning materials for preview and review, (2) utilizing curriculum-based approach to view online photos for monitoring their role-play and interactions in the learning processes and taking e-assessment for evaluating learning progress, and (3) using technology-based approach for interacting with their peers. The students developed learner autonomy to achieve significant better learning outcomes in the post-test. It was implied that self-directed learning with little teacher intervention of integrating on-site and online learning community could develop learner autonomy in ESP.     

Consensus among stakeholders about success factors and indicators for quality of online and blended learning in adult education: a Delphi study

Quality models for online and blended learning (OBL) have mainly been developed in higher education. The literature indicates that these models are often conceptualised from the providers’ perspective. What is important for the quality of OBL from the students’ perspective has recently received increased attention in the literature. Consensus among stakeholders about students’ quality needs is useful to support dialogue between professionals to strategically adopt OBL and to ensure that the needs of students are met. This study aims to validate a quality instrument for OBL, taking a set of 74 quality indicators and analysing them in terms of seven success factors (credibility, accessibility, transparency, flexibility, interactivity, personalisation, productivity). The Delphi method was selected as most suited. Participants from adult education were asked to indicate on a 7-point Likert scale to what extent the indicators add to OBL quality to meet students’ needs. After four Delphi rounds, the participants agreed on definitions of success factors and 30 indicators. The results are useful for institutions, ministries of education and external quality assessment agencies to assess the quality of OBL and can support institutions to implement improvement actions to ensure that the needs of students are met.     

Comparing K-12 online and blended teaching competencies: a literature review

This article presents a synthesis of reports and research on K-12 blended teaching competencies compared with K-12 online teaching competencies. The skills needed to teach in online and blended environments are distinct from traditional teaching, but teacher education programs often do not equip preservice teachers for the new modes of instruction. Additionally, there is a dearth of research on blended teaching competencies. This review synthesizes 8 blended teaching documents and 10 online teaching documents. Seven global themes identified in both competency domains are (1) pedagogy, (2) management, (3) assessment, (4) technology, (5) instructional design, (6) dispositions, and (7) improvement. The top 20 blended teaching skills include flexibility and personalization, mastery-based learning, data usage and interpretation, learning management system usage, online discussion facilitation, and software management. The authors recommend that researchers collect more methodologically transparent data about blended teaching and that teacher education programs include the identified skills in curriculum.     

Understanding student evaluations of teaching in online learning

In this paper, we have developed a classification model for online learning environments that relates the Instructors Overall Performance (IOP) rating (according to students’ perceptions) with the course characteristics, students’ demographics and the effectiveness of the instructor in his/her teaching roles. To that end, a comprehensive Student Evaluation of Teaching (SET) instrument is proposed, which includes not only conventional teaching elements, but also items that encourage twenty-first century skills. The goal of the study is twofold: (i) to quantify the extent to which the selected variables explain the IOP rating, and (ii) determine which teaching and non-teaching variables most affect the IOP rating. The best performing classifier achieved a competitive accuracy, highlighting that the selected variables mainly determine the IOP values. Other important findings include: (i) the IOP value is mainly influenced by the effectiveness of the instructor in his/her teaching roles; (ii) teaching strategies that involve the cooperation between the technical and pedagogical roles should be promoted; (iii) the pedagogical role has the highest impact on the final IOP value; and (iv) the most influential demographic variable is the student’s status (working commitments and family responsibilities).     

Barriers to learning online experienced by students with a mental health disability

Online education is widely regarded as increasing accessibility to higher education to individuals with disadvantage and disability, including those with a mental health disability. However, the learning challenges these students experience within the online learning environment are not well understood. The purpose of this qualitative case study was to better understand the barriers to learning that these students face in this environment. A qualitative content analysis of semi-structured interviews conducted with 12 students revealed three major learning barriers: (a) impact of impairment, (b) personal and situational circumstances, and (c) learning environment. These barriers were found to have wide-ranging consequences for the students’ ability to fully engage in study and their overall wellbeing. The findings lend insight into the low retention rates for this cohort of students and the learning barriers that need to be addressed by online education providers to better enhance the educational experience of these students.