Transitioning to learning outcomes at the coalface: An academic’s quantitative evaluation at the course level

Implementation of learning outcomes in Universities has not been seamless – their alignment with assessments requires faculty to specify learning outcomes and show transparent evaluation of this alignment. Difficulties arise transitioning from grading within a range of pre-existing assessment formats to grading common learning outcomes across those different formats. Experiencing this, we performed a quantitative evaluation of students completing an academic literacy course. We aimed to see if student achievement was determined by assessment format or by learning outcomes, and then to identify whether achievement of a learning outcome was equivalent across assessment formats. A twostep cluster analysis identified three clusters of students: high, medium, and low achievers. Strongest predictors of cluster-membership were learning outcomes assessed in the written essay, however scores for each learning outcome when assessed across assessment formats correlated poorly. Faculty should ensure consistent standards in learning outcomes achievement when assessed across different formats, or clearly separate learning outcomes.     

A blended model: simultaneously teaching a quantitative course traditionally,online, and remotely

As universities seek to bolster enrollment through distance education, faculty are tasked with maintaining comparable teaching/learning standards in traditional, blended, and online courses. Research has shown that there is an achievement gap between students taking courses exclusively offered online versus those enrolled in face-to-face classes. In an effort to mitigate these observed differences, the School of Business faculty at the research institution investigated various course models to meet the needs of a diverse, non-traditional, and multifaceted student population. Ultimately, a blended course model for statistics and quantitative method courses was developed that allowed students to choose between online, remote (via interactive television), and traditional course delivery modes each week. This model is more flexible and agile than existing blended courses that have more static components. Multiple regression analysis, χ², and t-tests are used to demonstrate the efficacy of our model in maintaining student performance standards.     

The effectiveness of blended online learning courses at the community college level

Whether through the use of online-only or hybrid/blended formats, colleges and universities across the country are increasingly utilizing online platforms as a medium for the delivery of instruction. At the same time, we know little about how student learning outcomes are related to students’ engagement with online instructional formats. In particular, few studies have evaluated online learning in community colleges, and fewer yet have employed an experimental or quasi-experimental design to do so. In this research, we use propensity score matching to compare learning gains between community college students enrolled in blended courses, (courses that combine online instructional delivery with traditional classroom-based instruction) with gains experienced by students receiving only classroom-based instruction. Among students enrolled in blended courses, we also consider which aspects of student use of online instructional materials are most strongly associated with student learning. While some evidence has suggested significantly poorer outcomes for community college students enrolled in online-only courses, our results suggest that students enrolled in blended courses perform similarly, if not better, relative to students in a traditional instructional setting. Implications for practice and research are discussed.     

A predictive study of learner satisfaction and outcomes in face-to-face,satellite broadcast,and live video-streaming learning environments

This study was conducted to assess the predictive relationships among delivery mode (DM), self-perceived learner-to-teacher interaction, self-rated computer skill, prior distance learning experience, and learners' satisfaction and outcomes. Participants were enrolled in courses which used three different DMs: face-to-face, satellite broadcasting, and live video-streaming (LVS). In each case, the course was offered simultaneously by the same teacher via all three formats. The results indicated no predictive utility of delivery mode for self-perceived learner-to-teacher interaction. On the other hand, the results supported the validity of self-perceived learner-to-teacher interaction as a predictor for student satisfaction and learning outcomes (measured by course final grades). To a lesser extent, self-rated computer skills and the number of distance learning courses taken played a weak role in learning outcomes and students' satisfaction. Overall, findings from the study support prior research that has reported the importance of learner-to-teacher interaction in learning outcomes and satisfaction of distance education students.     

Using the Blended Learning Approach in a Quantitative Literacy Course

The efforts to improve the quantitative reasoning (quantitative literacy) skills of college students in the United States have been gaining momentum in recent years. At the same time, the blended learning approach to course delivery has gained in popularity, promising better learning with flexible modalities and pace. This paper presents the results of an exploratory study that compares student learning outcomes and student attitudes over several semesters of blended versus traditional delivery in the upper-division quantitative literacy course at Point Loma Nazarene University.     

Blended learning at pre-service teacher education in Turkey: A systematic review

The literature shows an increase in blended learning implementations (N?=?74) at faculties of education in Turkey whereas pre-service and in-service teachers’ ICT competencies have been identified as one of the areas where they are in need of professional development. This systematic review was conducted to find out the impact of blended learning on academic achievement and attitudes at teacher education programs in Turkey. 21 articles and 10 theses complying with all pre-determined criteria (i.e., studies having quantitative research design or at least a quantitative aspect conducted at pre-service teacher education programs) included within the scope of this review. With regard to academic achievement, it was synthesized that majority of the studies confirmed its positive impact on attaining course outcomes. Likewise, blended learning environment was revealed to contribute pre-service teachers to develop positive attitudes towards the courses. It was also concluded that face-to-face aspect of the courses was favoured considerably as it enhanced social interaction between peers and teachers. Other benefits of blended learning were listed as providing various materials, receiving prompt feedback, and tracking progress. Slow internet access, connection failure and anxiety in some pre-service teachers on using ICT were reported as obstacles. Regarding the positive results of blended learning and the significance of ICT integration, pre-service teacher education curricula are suggested to be reconstructed by infusing ICT into entire program through blended learning rather than delivering isolated ICT courses which may thus serve for prospective teachers as catalysts to integrate the use of ICT in their own teaching.     

Comparing Student Evaluations of Distance Learning and Standard Classroom Courses in Graduate Social Work Education

Abstract

This study compared the student course evaluations of standard education and distance learning courses in the school of social work of one southern university. The sample included 14 distance learning (DL) and 122 standard education courses. A 20-item quantitative student course evaluation and a 7-item qualitative questionnaire were used to compare differences between social work courses taught in a standard classroom setting with those taught using distance learning technology. Comparisons of identical courses taught in both formats found that students rated distance learning higher than the standard classroom for a course having predominantly lecture content. Conversely, ratings for clinical practice courses were just the opposite with lower ratings for distance learning than the standard classroom. Results of a qualitative survey (n = 39) of students conducted at the end of a course taught by distance learning found that 73% of the students felt that distance learning technology interfered with class participation. However, 73% of the students felt the instructor handled technological problems in a professional and patient manner. Although 54% of the students reported that they would take another course by distance learning, more research is needed to determine what social work courses can be most effectively taught by distance and classroom formats.     

A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience, and a case study

Hybrid learning, or blended learning, has become an interesting learning delivery method in recent years. Many universities have sought to develop their own hybrid learning courses as another option for students and instructors who prefer to replace some portion of traditional face-to-face meeting time with online instruction. This paper provides some pragmatic guidance for establishing hybrid learning courses in universities. The authors focus on the use of information technology, as well as the development and the design of the course content. The paper also illustrates a case study of hybrid learning courses at NJIT. The research results showed no significant difference between the performance of the students who took a course in hybrid mode versus the performance of those who took the identical course in distance learning mode. Some positive feedback in terms of perceived benefit from the hybrid course instruction and course materials was obtained from the students. The student learning styles were also investigated. The results demonstrated that the majority of students who participated in the hybrid learning course are active/sensing/sequential/visual learners. Most of them preferred visual presentations to verbal explanations. The research results also revealed the difference between learning styles of students with high performance, and those with low performance.     

Blended learning: communication,locations and work-life practices

The article discusses blended learning and how various delivery formats affect the way learning is situated in work-life practices. The authors approached this issue through an empirical study of an in-service training programme for middle-level managers in a number of case organisations. The programme used a combination of e-learning, textbooks and face-to-face seminars. The conclusion reached is that a purposeful blend of delivery modes and technology systems can situate learning outside the daily work location and at the same time facilitate the creation of communities of practice embedded in daily work experience. It is further argued that inflexibility can be a necessary for creation of such communities.     

Learning online,offline, and in-between: comparing student academic outcomes and course satisfaction in face-to-face,online, and blended teaching modalities

The purpose of this study was to conduct a three-way comparison of face-to-face, online, and blended teaching modalities in an undergraduate Child Development course to determine if there were differences in student academic outcomes and course satisfaction across modalities. Student academic outcomes were measured by three examinations, one research paper assignment, and the overall course total grade. Course satisfaction was measured by administering the Student Opinion Questionnaire (SOQ) across the three teaching modalities and the Constructivist On-Line Learning Environment Survey (COLLES) to online and blended modalities. Results indicated that students performed equally well on all three examinations, research paper, and the overall course total grade across three teaching modalities, allaying traditional reservations about online and blended teaching efficacy. The SOQ and COLLES analysis found students from the three modalities were equally satisfied with their learning experiences. A Two-Factor Model identifying Face-to-Face Interaction and Learn on Demand (Flexibility) as factors determining student academic outcomes was proposed. Implications, limitations, and future research direction were discussed.     

A comparison of student satisfaction and value of academic community between blended and online sections of a university-level educational foundations course

This pre-test/post-test study explores students' (n = 262) sense of academic community, including their perspectives of the value of academic community, plus course satisfaction and perceived learning in nearly identical blended and online sections of an educational foundations course. Students in both delivery modes were generally satisfied with the course, had equally high perceived learning scores, but had neutral sense of community and value of connectedness scores. The findings in this study raise questions about whether the students would benefit from the infusion of time-intensive community-building strategies.     

Quality in blended learning: Exploring the relationships between on-line and face-to-face teaching and learning

This project draws on a large body of seminal research showing that the approaches students take to learning, and the subsequent quality of their learning, is closely related to their perceptions of their learning experience. Recent research has demonstrated these findings also hold for non-standard modes of delivery such as distance education using on-line strategies. However, there is currently little research about how predominately campus-based students' experiences of the on-line part of their course are associated with their experience of the course as a whole. The present study extends previous research into the domain of blended learning, by exploring the relations between student perceptions of the e-Learning environment, approaches to study, and student grades.     

The Academic Achievement of Adolescents from Immigrant Families: The Role of Family Background, Attitudes, and Behavior

The goal of this study was to determine the relative impact of family background, parental attitudes, peer support, and adolescents' won attitudes and behaviors on the academic achievement of students from immigrant families. Approximately 1,100 adolescents with Latino, East Asian, Filipino, and European backgrounds reported on their own academic attitudes and behaviors as well as those of their parents and peers. In addition, students' course grades were obtained from their official school records. Results indicated that first and second generation students received higher grades in mathematics and English than their peers from native families. Only a small portion of their success could be attributed to their socioeconomic background; a more significant correlate of their achievement was a strong emphasis on education that was shared by the students, their parents, and their peers. These demographic and psychosocial factors were also important in understanding the variation in academic performance among the immigrant students themselves.     

An approach to designing and evaluating blended courses

Recently, there has been an increased interest in producing electronic courses. However, literature shows that adopting e-learning does not guarantee improved learning. This is because mixing technology and content does not necessarily yield effective learning. This paper presents a systematic design process for developing blended courses for undergraduate higher education. The instructional design process is based on instructional design theories and utilized three taxonomies: Bloom Taxonomy, Redeker Taxonomy and Guerra scale. A mapping model is proposed and embedded in the design process to develop a blended course starting from the objectives and content of a traditional course. This paper also presents a evaluation process that estimates the effectiveness of the selected technologies in the design of the blended course. This effectiveness is evaluated in terms of three dimensions: course content formats, interaction and collaboration. A case study is presented to demonstrate the proposed design approach on a System Analysis and Design blended course under development.     

Comparability of educational achievement and learning attitudes across nations

We estimated the invariance of educational achievement (EA) and learning attitudes (LA) measures across nations. A multi-group confirmatory factor analysis was used to estimate the invariance of educational achievement and learning attitudes across 55 nations (Programme for International Student Assessment [PISA] 2006 data, N?=?354,203). The constructs had the same meaning (factor loadings) but different scales (intercepts). Our conclusion is that comparisons of the relationships between educational achievement and learning attitudes across countries need to take into consideration two sources of variability: individual differences of students and group differences of educational systems. The lack of scalar invariance in EA and LA measures means that the relationships between EA and LA may have a different meaning at the level of nations and at the student level within countries. In other words, as PISA measures are not invariant in scalar sense, the comparisons across countries with nationally aggregated scores are not justified.     

A Study of Disciplinary, Structural, and Behavioral Effects on Course Outcomes in Online MBA Courses

This article reports the results of a 2‐year study examining the effects of subject matter, course structure, and participant behaviors on students' perceived learning and satisfaction with delivery medium in Web‐based courses of an MBA program in the midwestern United States. Using finance as the referent discipline, we found statistically significant differences in the mean course outcomes (students' perceived learning and satisfaction with delivery medium) associated with 13 business disciplines. Although most of these disciplinary differences ceased to be significant predictors of student perceived learning as structural and behavioral characteristics were incorporated into the model, these differences remained significant predictors of perceived delivery medium satisfaction. We also found that some structural and behavioral characteristics were significant predictors of course outcomes, but in opposite directions. For instance, media variety was a positive predictor of delivery medium satisfaction but a negative predictor of perceived learning, while learner–learner interaction positively predicted perceived learning but negatively predicted delivery medium satisfaction. These findings suggest that instructors of online graduate courses must manage trade‐offs in balancing students' learning with their perceptions of the internet as a course delivery medium.     

The present state and future trends of blended learning in workplace learning settings across five countries

This article reports survey findings related to the current status and future trends of blended learning in workplace learning settings from diverse cultures. This particular survey was conducted of 674 training and human resource development professionals from five different countries, mostly from the Asia-Pacific region (i.e., China, South Korea, Taiwan, United States, and the United Kingdom). The results show that blended learning will become a popular delivery method in the future of workplace learning not only in Western countries but also in Asian countries. Still, the respondents indicated that there were several barriers to blended learning; one of the most noticeable issues was their lack of understanding of blended learning. There is a pressing need, therefore, to provide practitioners with guidance on how to implement blended learning in their organizations. Additionally, among the countries surveyed, the results of the present study revealed that there were significant differences in the current level of adoption of blended learning, the respondents’ attitudes toward and perceptions of blended learning, and the content areas taught by blended learning. Respondents’ predictions related to emerging instructional strategies, technologies, and evaluation techniques for blended learning are also reported.     

Factors related to rural school administrators’ satisfaction with distance education

The purpose of this study was to examine rural school district administrators’ satisfaction with distance education in the United States and to identify factors that may contribute to their satisfaction. Telephone interviews were conducted with administrators in randomly selected rural districts across the country. Analyses revealed that students’ preparation in their study and computer skills as well as the use of synchronous delivery formats were related to administrators’ satisfaction with distance education. Results imply that students’ study and computer skills should be addressed as needed and, when feasible, synchronous delivery formats used in order to possibly bolster districts’ satisfaction with and effective use of distance education.     

The role of temporal patterns in students' behavior for predicting course performance: A comparison of two blended learning courses

In higher education, many studies have tried to establish which student activities predict achievement in blended courses, with the aim of optimizing course design. In this paper, we examine whether taking into account temporal patterns of student activity and instructional conditions of a course help to explain course performance. A course with a flipped classroom model (FCM) and a course with an enhanced hybrid model (EHM) were compared. The results show that in both cases, a regular pattern of activity is more effective than low activity. In the FCM, initial low activity is detrimental, whereas in the EHM the strategy of cramming later on in the course can still lead to higher course performance. In the FCM, a combination of face-to-face and online activity led to sufficient course performance, whereas in the EHM, face-to-face or online activity on its own could lead to sufficient course performance. This study offers a methodological and empirical contribution to exploring the role of patterns of activity and instructional conditions for course performance.     

Mastering course content and learner satisfaction in early childhood education: A comparison of regular classroom instruction with three variations of internet delivery*

Abstract

In the spring semester 2000, a Penn State course, ECE 479 (The Young Child's Play as Educative Process), was taught by the same instructor in four delivery formats. One group consisted of a regular classroom, held on campus. A second group, also on campus, was taught in a computer lab via the Internet; and there were opportunities for interaction with peers and the instructor. A third group took the course on the Internet as part of a local distance education group; hence, there were some limited opportunities for face‐to‐face interaction with peers and the instructor. The fourth group took the course on the Internet, as part of a statewide distance education group, where there were no opportunities for face‐to‐face interaction. Twenty students who enrolled in the course (5 per group) completed questionnaires and phone interviews. Information was gathered on professional backgrounds, computer experience, and initial level of content knowledge on the topic of the ECE Internet course. Sixteen students who completed the course were interviewed again to evaluate satisfaction with the course and to estimate learning outcomes. Across the four conditions general satisfaction was expressed with the content, activities, and course requirements and with the teacher. However, students in the three computer groups expressed dissatisfaction over technical problems (all four who did not complete the course came from these computer groups). Significant gains in content knowledge occurred for the classroom group, while the learning in the three Internet‐based instruction groups did not show the same gains. Concern was expressed related to the lack of face‐to‐face interaction, making the learning environment less desirable. Although Internet technology provides a great deal of promise, these results suggest that improvements are needed to make this delivery modality more effective for in‐service distance learning. © 2001 Elsevier Science Inc. All rights reserved.