Evaluation of e‐learning outcomes: experience from an online psychotherapy education programme

SEPTIMUS is a one‐year Europe‐wide postgraduate theoretical course for psychotherapists and counsellors provided entirely via the Internet. It may be used as part of a training course, with face‐to‐face elements provided locally, or for continuing professional development. The course was developed at the University of Sheffield in collaboration with psychotherapy training institute partners in seven other European countries. Two studies involving 167 SEPTIMUS students and 60 comparable face‐to‐face students were undertaken. ? Study 1. Drop‐out rates for the SEPTIMUS programme were found to be low, and comparison between those dropping out and those completing did not highlight any significant factors linked to distance learning. However, students cited finance, distance from training centre, lack of practical experience, family commitments and the intensity of their working weeks as having been barriers to taking face‐to‐face learning courses in the past.

? Study 2. SEPTIMUS students (e‐learners) were compared with students taking comparable attending (face‐to‐face) theoretical courses also being provided by partners in the project to psychotherapy trainees. Significant differences were found in distance from training institute and ability to visit training institute. SEPTIMUS students had higher levels of computer ownership, frequency of Internet use and IT skills than attenders; these factors when examined in Study 1 did not have an impact on the drop‐out rate of e‐learners.

e‐Learning can overcome barriers to traditional learning in psychotherapy, particularly distance from a training centre, without loss of student satisfaction or student performance. Factors sometimes thought to be obstacles to e‐learning, such as information technology skills, were not found to be significant barriers – although they may have affected recruitment. Certain aspects of e‐learning, such as the tendency to facilitate self‐disclosure, were found to be very beneficial, particularly in the context of psychotherapy programmes.     

Problem-based learning in distance education: Practitioners' beliefs about an action learning project

Despite the advantages of problem based learning (PBL) and the fact that it has been utilised for some time in conventional higher education settings, it is not widely used in distance education in Hong Kong. Recently, a small group of course co‐ordinators at the Open University of Hong Kong engaged in a series of action learning projects to explore ways in which it could be incorporated into their courses. The purpose of this paper is to report the opinions of these academics about the suitability of PBL for a distance education environment. Generally, they concluded that it is possible, and perhaps desirable, to consider implementing PBL as one learning approach. However, most of the projects focussed on a fairly narrow application of PBL, namely in face‐to‐face tutorials. The limitations of the participants’ interpretations are discussed in the light of the constraints they face, and some recommendations are made for other ways of implementing PBL into distance education.     

Best and worst dressed web courses: Strutting into the 21st century in comfort and style

Web courses are constructed as the answer to fiscal crises evoked by neo‐liberal restructuring. They are also touted as an anarchist exemplar of ‘de‐schooling’ as envisaged by Ivan IIlich. The trouble is, some courses are vastly under‐dressed and merely attempt to display a face‐to‐face course on‐line. At the other extreme are those laced with links, animation and more than enough glitter and glam to make Liberace wince. In this study the authors employed a 43‐item coding schedule to examine the accessibility, opportunities for interaction and attractiveness of 127 courses on the web. Interrelationships between the 43 variables and issues pertaining to accessibility, interaction and attractiveness were identified with the aid of SPSS. Exemplary web courses were then distinguished from mediocre web courses. In our view, Madonna exemplifies qualities that should be incorporated into web courses. After examining 127 sites the Madonna award for the ‘best‐dressed’ site went to a University of Wisconsin History course. The ‘worst‐dressed’ award went to a Social Foundations of Education course at a USA State University which exuded glitter but lacked substance. Reasons for these decisions are elaborated. (The word, course, used here, describes what some systems call a unit of study.)     

Making the written word “speak”: Reflections on the teaching of correspondence courses

Abstract

Learning outcomes for an interactive television‐based distance learning course in introductory high school Japanese were evaluated in three successive years by comparing student achievement in the distance learning course to that in traditional classes. Year‐end achievement tests of listening and written language competency were administered to students in both the distance and face‐to‐face courses. Results in the first two years showed that test scores of students in the distance learning course were higher than those of students in the face‐to‐face classes; however, possible group differences in motivation, general ability, and experience as language learners could not be ruled out as explanations for the difference. Therefore, achievement measures were supplemented in the third year with data on students’ perceived efficacy as Japanese language users, their grades, and their previous foreign language learning experience. The achievement data again showed differences favoring the distance learning group; trends were consistent for students with differing levels of school success and amount of prior language learning experience. Factors that could account for these results are hypothesized and suggestions for future research are proposed.     

The quest for quality,East and West

The paper describes the development of a new distance education institution in Hong Kong. The methods and systems used to assure that its courses and degree programmes are of the highest quality are described. The paper addresses the means by which new courses are produced: a direct import from another institution, adaptation of an imported course, and in‐house production. Although established by the Hong Kong Government the institution is required to become self‐financing within four years — the paper describes some of the consequences of this policy especially on quality. The paper concludes by comparing the performance of Hong Kong students on courses taken from the British Open University with that of their British counterparts.     

我国网络远程课程十年研究综述

网络远程课程,即网络课程与远程课程的合称。自2000年以来,我国网络远程课程研究已走过10年（2000—2009）历程,已有研究在课程内涵、课程设置、课程设计、课程开发、课程建设、课程实施和课程评价等方面都存在不同进展与不足。基于开放本质的整体设计和基于成人特色的学教设计,是课程设计的两大方向;课程开发中课程设计与课程理念、课程设置的研究存在脱节现象;目前课程建设的整体规划、教学设计水平有待提高,优秀资源共享程度较低;课程实施中缺乏实施机制和实效研究,不注重研究成果转化;课程评价则存在评价指标和量化标准上重复研究的情况,评价的目的多为评质定级而不是反馈改进。当前网络远程课程的发展需要具有全程、综合、以“学”为中心的研究视野,树立动态的、学科开放的、学习开放的网络远程课程观,建立专业化的团队,注重试验研究,注重研究成果的及时转化。     

Teaching Chemistry at Canada's Open University

University‐level courses in science that contain a substantial practicum or laboratory component have always been a problem to deliver through distance education. Because of the potential hazards inherent in the equipment and chemicals commonly used, chemistry is among the more challenging disciplines to teach at a distance. Athabasca University (AU) ‐ Canada's Open University ‐ has been successfully running chemistry courses for over two decades. The development and delivery of AU chemistry courses are described and the approaches that have been developed to meet the challenges of a North American distance‐education university, including the use of new technologies, are discussed. The problems associated with providing distance students with appropriate laboratory experience are also examined. The first‐year general chemistry courses are compared to an equivalent course at a neighbouring traditional university and an analysis of student performance in AU chemistry courses is presented.     

Student Learning and Performance in Information Systems Courses: The Role of Academic Motivation

Despite the need for information technology knowledge in the business world today, enrollments in information systems (IS) courses have been consistently declining. Student performance in lower level IS courses and student assumptions about the level of difficulty of the courses seem to be reasons for lower enrollments. To understand how student motivation may explain learning outcomes in introductory IS courses, this study investigates the impact of intrinsic and extrinsic academic motivations as framed by self‐determination theory on two measures of learning outcomes: (1) student self‐reported measures of learning and (2) actual grades obtained in courses and course components. Using 269 student responses collected in a second‐year undergraduate core course and a first‐year MBA core course, both of which are offered in a traditional face‐to‐face classroom environment, study hypotheses are analyzed. Results indicate that the motivational model explains both the affective and cognitive perceptions of learning held by students. In examining overall grades and grades in course components, the motivational model, however, was unable to sufficiently explain student performance. Data also indicate that there are significant differences between undergraduate and graduate students in terms of their motivation and learning outcomes.     

The development and assessment of an online microscopic anatomy laboratory course

Increasing enrollment in post‐secondary institutions across North America, along with an increase in popularity of and demand for distance education is pressuring institutions to offer a greater number and variety of courses online. A fully online laboratory course in microscopic anatomy (histology) which can be taught simultaneously with a face‐to‐face (F2F) version of the same course has been developed. This full year course was offered in the Fall/Winter (FW) terms in both F2F and online formats. To ensure that the online course was of the same quality as the F2F format, a number of performance indicators were evaluated. The same course, offered exclusively online during the summer with a compressed time frame, was also evaluated. Senior undergraduate students self‐selected which version of the course they would enroll in. Course assessment outcomes were compared while incoming grades were used as a predictor for course performance. There were no significant differences between the incoming grades for the F2F FW and Online FW courses; similarly, there were no significant differences between outcomes for these formats. There were significant differences between the incoming grades of the F2F FW and Summer Online students. However, there were no significant differences among any of the outcomes for any of the formats offered. Incoming grades were strong, significant predictors of course performance for both formats. These results indicate that an online laboratory course in microscopic anatomy is an effective format for delivering histology course content, therefore giving students greater options for course selections. Anat Sci Educ 6: 246–256. © 2013 American Association of Anatomists.     

Reflective learning in distance education

This article addresses one of three major challenges which it is argued, currently face distance education, namely its claimed over-reliance on behaviourist approaches to teaching and learning. In particular, the derivation of principles of course design which can be applied irrespective of difference of context, content and learners, has not proved to be a realistic and effective way forward. Fortunately, the practice of distance education has not been limited to applied behaviourism only, and has included approaches which draw upon social constructivist and cognitive approaches to learning. These have worked well in combination with regular feedback to students in programmes at undergraduate level at the UK Open University (UKOU). Other conceptualisations of learning have also begun to make an impact, notably the experiential and the relational. The former emphasises reflection on direct experience and the transformation of existing knowledge. The latter reveals the shaping influence of students conceptions in these areas. Distance education already has many examples of activities and projects which require students to process existing and new experience in relation to course concepts and goals. A number of courses at the UKOU are also encouraging students to review their own learning approaches and to be proactive about their study methods. A case study of two courses is introduced, as an example of teaching approaches which foster reflection on experience, integrated with conceptual learning, and reflection by the learner on their own learning process in parallel with the study of course content. Evidence is provided from evaluation of the extent to which these learning process oriented course materials, have affected the learned outcomes students identify for themeselves. The integration of a reflective component into assessment of the course has been especially effective. Students report changes most frequently at the level of general awareness of purpose of study and learning transfer, rather than in the area of detailed study skills.     

TEACHING COMMUNITY COLLEGE FACULTY MEMBERS ON THE INTERNET

This article details the experiences of a university professor and former community college president in teaching World Wide Web based graduate courses to faculty members from Florida's community colleges. These courses have provided faculty members from various parts of the state access to advanced educational opportunities. Courses have been particularly relevant to the day-to-day activities of full-time and adjunct teaching faculty members. For those who might be interested in converting traditional courses for Web-based delivery, tips are included on designing course materials and using technical experts. Emphasis is placed on the needs of the learner to maximize the benefits of this type of distance education. The 12 canons for distance learners, which served as guideposts, as community college faculty member-students progressed through the courses are included. Discussion of various course material components provides insight into the need for thoroughness in overall course design. Course evaluation results, which highlight the appreciation of community college faculty member-students for the way in which the courses were conducted, are included. For example, convenience and exibility were ranked highly as positive reasons for taking Web-based courses. Problem areas are also identified. Teaching graduate courses on the Internet to community college personnel has become an important endeavor in Florida. The University of Central Florida has made a commitment to expand the number and types of courses offered in this manner to address the needs of all students. These courses are particularly important to community college faculty members and administrators who may be precluded from taking relevant graduate courses because of geographical or time limitations. Hence, through the magic of the Internet, courses are available at their fingertips.     

Perspectives on inclusive education: learning from each other

Many courses of study are currently available that address inclusive education and, increasingly, distance education is seen as a flexible and appropriately inclusive way to deliver such courses. In this article a team of colleagues, Kieron Sheehy, Jonathan Rix, Melanie Nind and Katy Simmons, discusses the development of an Open University course, E243 Inclusive Education: Learning from Each Other, which was launched in February 2004. The team reflects on their own process of learning from each other and from the rich network of people involved, mirroring some of the course themes in their own journeys. Collaborative learning became a key theme within the course, both as a method for teaching within the ‘inclusive classroom’ and also as the process for producing a course in a contested and challenging area. This experience allowed the team to change and develop their own perspectives on important issues and, it is suggested, allowed the course to include ways in which students could be supported in having the same opportunity.     

Faculty work in developing and teaching web‐based distance courses: A case study of time and effort

Abstract

Using an experiential case approach, this study explores the conventional wisdom that distance education courses require greater faculty work effort and time commitment than traditionally taught courses. The study's basis for analysis is an instructor's time and effort in developing and delivering a graduate‐level course in public administration, for both a distance course (a modality with which he had no previous experience) and his traditional classroom courses. The study finds support for the conventional wisdom. But it also suggests hypotheses for future comparative analysis that development and delivery time and effort may partially depend on the accumulation of instructor experience and the level of institutional support. This article also identifies some implications for future research and faculty participation in distance education.     

Rethinking Learner Support: The challenge of collaborative online learning

The use of computer-mediated communication (CMC) as an integral part of the design of distance taught courses raises interesting challenges to our thinking about course design and learner support. These have typically been conceptualised as two complementary but distinct systems in distance education, characterised by different practices often carried out by different groups of staff. Where CMC is designed as an integral part of the course, with collaborative learning as essential to assessment and study, this separation breaks down. The design of online activities is integral to both learner support and the course content, with new possibilities for open and distance learning as a result. Where the learning group itself is a resource for study and personal development, it also becomes feasible to orientate courses and programmes towards local teams and communities. Online tutors play a key role and need to develop 'the technology of conversation' and expertise in the design of activities, as part of their facilitator role.     

远程教育从业人员的职业发展阶段和典型工作任务分析

高质量的远程教育,需要一支高质量的专业队伍。然而目前我国现代远程教育的从业人员,大多数都缺少对这个领域的了解,知识和方法准备不足,严重影响了远程教育教学过程的实施和质量的提升。因此,对从业人员进行专业或在职培训已经成为这个领域越来越迫切的问题。但是什么样的培训内容和方法能够满足远程教育从业人员的需求呢？首先需要对从业人员进行工作或职业资格分析,了解其角色和能力需求。基于工作分析的思路,运用典型工作任务分析和实践专家研讨会法对我国远程教育机构有经验的从业人员进行调查和访谈发现：我国远程教育从业人员主要包含课程设计人员、学生支持人员、教师、技术人员四类关键角色,其职业发展经历入职、独立工作、项目主管、部门主管四个典型阶段。远程教育机构可以通过通用的培训课程和针对不同关键角色的培训课程,在职业发展的不同阶段,选择有针对性、适时、合理的培训课程对从业人员进行培训。同时,远程教育机构还应当采用“任务驱动式”或“基于项目学习”的教学模式开展从业人员培训,将每一个典型工作任务转化为一门任务课程或项目课程,为学习者创建真实的任务情境,从而实现真正的能力培养而不是传统的知识灌输。     

Comparing Student Evaluations of Distance Learning and Standard Classroom Courses in Graduate Social Work Education

Abstract

This study compared the student course evaluations of standard education and distance learning courses in the school of social work of one southern university. The sample included 14 distance learning (DL) and 122 standard education courses. A 20-item quantitative student course evaluation and a 7-item qualitative questionnaire were used to compare differences between social work courses taught in a standard classroom setting with those taught using distance learning technology. Comparisons of identical courses taught in both formats found that students rated distance learning higher than the standard classroom for a course having predominantly lecture content. Conversely, ratings for clinical practice courses were just the opposite with lower ratings for distance learning than the standard classroom. Results of a qualitative survey (n = 39) of students conducted at the end of a course taught by distance learning found that 73% of the students felt that distance learning technology interfered with class participation. However, 73% of the students felt the instructor handled technological problems in a professional and patient manner. Although 54% of the students reported that they would take another course by distance learning, more research is needed to determine what social work courses can be most effectively taught by distance and classroom formats.     

A method for assessing required course-related skills and prerequisite structure

Engineering curricula should be dynamic with a goal of constant improvement and refinement. Unfortunately, this is often not the case; courses are developed, altered, and expanded in a piecemeal manner. Namely, as time progresses many programmes end up with courses that are developed and not a developed curriculum. To remedy this shortcoming product, development tools are proposed for the refinement and assessment of an existing curriculum; how these methods could be used for the development of a curriculum is also highlighted. The voice of the customer (VOC) process is used to identify and prioritise desired student skills. The design structure matrix (DSM) is used to assess course prerequisite structure. There is broad agreement between faculty and industry related to which professional skills are the most important. The DSM is shown to be a useful tool in ordering courses and assessing prerequisite structures. The DSM is also shown to be useful in identifying which courses in a curriculum are critical and should be the focus of educational and administrative resources.     

A Delphi study on collaborative learning in distance education: The faculty perspective

This paper focuses on the factors that influence collaborative learning in distance education. Distance education has been around for many years and the use of collaborative learning techniques in distance education is becoming increasingly popular. Several studies have demonstrated the superiority of collaborative learning over traditional modes of learning and it has been identified as a potential solution to some of the weaknesses of traditional distance education courses. There are a rapidly growing number of technologies in use today and educators and practitioners face an increasingly difficult challenge to successfully implement collaborative learning in distance education; precipitated not only from technical advances but also from wider social and organisational concerns. To the best of our knowledge, this study is the first to investigate the factors that influence collaborative learning in distance education, by eliciting the opinions of an expert panel using a Delphi survey. The aim was to produce an integrated list of the most important implementation factors and to investigate the role that technology is perceived to contribute. The findings identified 17 of the most important factors; these factors cover a range of themes including course rationale and design, instructor characteristics, training, group dynamics, the development of a learning community and technology. The potential of technology, however, does not seem to be fully realised and newer technologies such as multi‐user environments would seem to be of limited use in practice according to the expert panel.     

计算机信息技术基础课程教学设计研究

在远程开放教育模式下要实现专业培养目标,必须从适应现代远程教育的目标出发,从学科发展的现状和应用环境出发,精心架构开放教育课程的教学体系。江苏电大信息工程学院针对信息技术教育的特点进行了一体化教学设计研究,取得很好的效果,促进了开放教育教学质量的提高。