The effect of feedback on academic achievement in technology-rich learning environments (TREs): A meta-analytic review

This study aimed to investigate the effect of feedback on students' academic achievement in a technology-rich environment through a systematic and quantitative synthesis of the studies conducted over several decades. We focused on three issues: (a) the effectiveness of feedback in enhancing learning performance; (b) possible factors (feedback characteristics and study features) associated with different studies that could have resulted in the inconsistent findings across the studies; and (c) how different types of feedback differed in their effect in enhancing academic achievement. Based on 182 effect sizes extracted from 61 studies, we found that, compared with no feedback condition, feedback had at least a medium effect (g = 0.44, 95%CI [0.324, 0.555]) in enhancing academic achievement, and the effect of explanation feedback was the strongest compared to other types of feedback. The study further revealed that the feedback in blended learning was more effective than that in online learning. Possible explanations and implications of these findings, as well as limitations and future research directions were discussed.     

Research in online and blended learning in the business disciplines: Key findings and possible future directions

In this literature review, we examine and assess the state of research of online and blended learning in the business disciplines with the intent of assessing the state of the field and identifying opportunities for meaningful future research. We review research from business disciplines such as Accounting, Economics, Finance, Information Systems (IS), Management, Marketing, and Operations/Supply Chain Management. We found that the volume and quality of research in online and blended business education has increased dramatically during the past decade. However, the rate of progress is somewhat uneven across disciplines. IS, Management, and multi-disciplinary studies have the highest volumes of research activity, with markedly less activity in Finance and Economics. Furthermore, scholars of online and blended business education predominantly publish in learning and education journals of the business disciplines rather than also publishing in journals that focus on technology-mediated learning, thereby missing an opportunity to inform scholars in other disciplines about their work. The most common research streams across disciplines were outcome comparison studies with classroom-based learning and studies examining potential predictors of course outcomes. Results from the comparison studies suggest generally that online courses are at least comparable to classroom-based courses in achieving desired learning outcomes, while there is divergence in findings of comparisons of other course aspects. Collectively, the range of untested conceptual frameworks, the lack of discipline-specific theories, and the relative absence of a critical mass of researchers focused on the topic suggest ample opportunities for business scholars seeking to enter this research community.     

A comparison of student satisfaction and value of academic community between blended and online sections of a university-level educational foundations course

This pre-test/post-test study explores students' (n = 262) sense of academic community, including their perspectives of the value of academic community, plus course satisfaction and perceived learning in nearly identical blended and online sections of an educational foundations course. Students in both delivery modes were generally satisfied with the course, had equally high perceived learning scores, but had neutral sense of community and value of connectedness scores. The findings in this study raise questions about whether the students would benefit from the infusion of time-intensive community-building strategies.     

Self-assessment in the process of self-regulated learning and its relationship with academic achievement

Abstract

Despite the theoretical argument and empirical evidence regarding the impact of self- assessment on academic achievement and self-regulated learning (SRL), the mechanism for this impact is understudied. The present study aimed to investigate the characteristics of self-assessment practices at different SRL phases and its relationship with academic achievement. Using a course assignment as the learning task, sixty-three students enrolled in a one-year master programme in a teacher education institute responded to an instrument assessing their self-assessment practices (including four self-assessment actions) at the SRL Preparatory, Performance and Appraisal phases of the task. Their final scores of the assignment were also collected. The results showed that self-assessment is a fundamental skill for SRL and occurs at each SRL phase with different patterns. Autoregressive relationships were found for all self-assessment actions between different SRL phases. Self-reflection at Performance phase was found to influence feedback seeking at Appraisal phase. Self-directed feedback seeking through monitoring at Performance phase was the strongest and positive predictor of academic achievement; and achievement had negative impact on all self-assessment actions at Appraisal phase. This study may assist educators and researchers to better understand the complexity of self-assessment in relation to learning process.     

Comparing K-12 online and blended teaching competencies: a literature review

This article presents a synthesis of reports and research on K-12 blended teaching competencies compared with K-12 online teaching competencies. The skills needed to teach in online and blended environments are distinct from traditional teaching, but teacher education programs often do not equip preservice teachers for the new modes of instruction. Additionally, there is a dearth of research on blended teaching competencies. This review synthesizes 8 blended teaching documents and 10 online teaching documents. Seven global themes identified in both competency domains are (1) pedagogy, (2) management, (3) assessment, (4) technology, (5) instructional design, (6) dispositions, and (7) improvement. The top 20 blended teaching skills include flexibility and personalization, mastery-based learning, data usage and interpretation, learning management system usage, online discussion facilitation, and software management. The authors recommend that researchers collect more methodologically transparent data about blended teaching and that teacher education programs include the identified skills in curriculum.     

Study procrastination, achievement, and academic motivation in web-based and blended distance learning

Growth in distance education is increasing the need to examine students' learning strategies in distance and blended learning environments. Students' cramming or spaced-review behaviors were measured and compared across delivery formats as well as examined related to course achievement and attitudes across a term. Although theory would predict that spaced study rather than last minute cramming would yield higher achievement, researchers report mixed findings in both areas. One hundred fifty-seven students in distance and blended course formats were blocked into 5 groups based on their cramming/spaced-review patterns a week prior to each of 3 posttests. Significant differences were observed in cramming/spaced-review behaviors between delivery formats and for achievement and attitudes.     

The interplay between self-determined motivation,self-regulated cognitive strategies,and prior achievement in predicting academic performance

The present study examined the interplay between self-determined motivation and the use of cognitive strategies in predicting university students’ academic performance while taking into account the effect of prior achievement. A theory based model was tested using structural equation modeling on a sample of 764 Italian university students. Results showed that prior achievement influenced students’ academic performance and their motivation and use of cognitive strategies. Critical thinking was the only cognitive strategy which proved to have a significant impact on students’ academic performance. Autonomous motivation had an indirect positive impact on academic performance through its influence on the critical thinking strategy. Controlled motivation had a direct negative impact on academic performance. On the whole, our findings suggest that autonomously motivated students tend to achieve better academic performance by using critical thinking, while students who are driven by controlled motivation have lower academic performance.     

Facilitating flexible learning by replacing classroom time with an online learning environment: A systematic review of blended learning in higher education

Higher education institutions are trying to provide more flexibility and individualization, which is mainly realized through the use of new technologies and implemented in online or blended learning designs. This systematic review aims to investigate the impact of replacing classroom time with an online learning environment. The meta-analysis (k = 21 effect sizes) applied strict inclusion criteria concerning research design, measurement of learning outcomes and implementation of blended learning. The estimated effect size (Hedge's g) was positive, although not significantly different from zero and the confidence interval [-0.13, 0.25], suggesting that overall differences between blended and conventional classroom learning are small, and, at best, very small negative or moderate positive effects are plausible. This means that despite a reduction in classroom time between 30 and 79 per cent, equivalent learning outcomes were found. Consequently, blended learning with reduced classroom time is not systematically more or less effective than conventional classroom learning.     

Relations between early family risk, children's behavioral regulation, and academic achievement

This study examined relations among early family risk, children's behavioral regulation at 54 months and kindergarten, and academic achievement in first grade using data on 1,298 children from the National Institute of Child Health and Human Development (NICHD) Study of Early Child Care and Youth Development. Family risk was indexed by ethnic minority status, low maternal education, low average family income from 1 - 54 months, and high maternal depressive symptoms from 1 - 54 months. Results of structural equation modeling indicated that minority status, low maternal education, and low family income had significant negative effects on reading, math, and vocabulary achievement in first grade. Modest indirect effects were also found from ethnicity, maternal education, and maternal depressive symptoms, through 54-month and kindergarten behavioral regulation to first-grade achievement. Discussion focuses on the importance of behavioral regulation for school success especially for children facing early risk.     

Integrating collaborative PBL with blended learning to explore preservice teachers’ development of online learning communities

This study integrated collaborative problem-based learning (collaborative PBL) with blended learning to explore the emerging process and function of online learning communities among preservice teachers. Thirty-two preservice teachers participated in a 16-week instruction program. Analyses of online group discussions and portfolios found that (a) the integrated approach facilitated the preservice teachers’ formation of online learning communities; (b) the preservice teachers’ online learning communities emerged via four stages: motivation and acquaintance, socialization and belongingness, information exchange and consensus, and tacit understanding and development; and (c) six factors influenced the development of the preservice teachers’ online learning communities.     

Defining the nature of blended learning through its depiction in current research

ABSTRACT

Blended learning has been a feature of higher education practice and research for almost two decades. This article takes stock of current blended learning research, contributing to the growing number of meta-analyses of higher education and blended learning research more generally, through a review of ninety-seven articles relating to blended learning in higher education published in fifteen journals between 2012 and mid-2017. The review focused on where and when the articles were published; their provenance, scale, scope; methodological approach; the broad research themes; and definition of blended learning used. The review shows that despite its ubiquity, blended learning’s definition is all-encompassing; its spread is global but research is dominated by key players; it is of technical interest; and its research is small-scale, individually focused, seeking to evidence the benefits of blended learning. The article concludes with recommendations of how higher education research could provide institutions with evidence to ensure their ‘best of blends’.     

Promoting self-regulated learning to improve achievement: A case study in higher education

Abstract

The aim of this article is to report on a study conducted to assess the effect of an intervention programme to improve SRL and the achievement of a group of poorly performing undergraduate students at the Tshwane University of Technology. SRL was used as theoretical framework. The case study reports on 20 Engineering students who attended learning skills intervention sessions and wrote a college version of the learning and study strategies inventory (LASSI) pre-test and post-test. The intervention consisted of 12 workshop sessions presented over a period of three months. The LASSI pre-test showed that the group scored below the 50th percentile on four scales (anxiety, attitude, selecting main ideas and test-taking strategies). Observed improvements in the post-test scores of the LASSI scales for seven out of ten scales were statistically significant. The students’ academic achievements also improved. The findings are important for improving student success and throughput in South African higher education.     

Metacognition, achievement goals, study strategies and academic achievement: pathways to achievement

The purpose of this research was to develop and test a model of effective self-regulated learning. Based on effort expenditure we discerned effective self-regulators and less effective self-regulators. The model comprised achievement goals (mastery, performance-approach and -avoidance goals), metacognition (metacognitive knowledge, regulation and experience), study strategies (metacognitive, deep cognitive, surface cognitive and resource management strategies) and academic achievement. The relationships in the model were tested with controlling for intellectual ability, gender and age. The results showed that effective self-regulated learning involved two pathways: a metacognitive and a strategy pathway. The first pathway involved a positive relationship of mastery goals and a negative relationship of performance-avoidance goals with metacognition. Metacognition positively affected the use of the four study strategies. The strategy pathway involved positive effects of mastery and performance-approach goals on the use of metacognitive and deep cognitive strategies. Further, performance-approach goals positively affected the use of surface cognitive and resource management strategies. The use of metacognitive and resource management strategies had a positive and the use of surface cognitive strategies had a negative effect on exam scores.     

The effects of achievement goals and self-regulated learning behaviors on reading comprehension in technology-enhanced learning environments

Studies examining students’ achievement goals, cognitive engagement strategies and performance have found that achievement goals tend to predict classes of cognitive strategy use which predict performance on measures of learning. These studies have led to deeper theoretical understanding, but their reliance on self-report data limit the conclusions that can be drawn. We employed a behavioral approach instead and assessed learning processes by logging learners’ behaviors as they used educational technology. We examined the relationship between achievement goals, strategy use, and comprehension scores of 160 undergraduates who studied a hypertext passage in a technology-enhanced learning environment (TELE) equipped with tools that support learning behaviors including highlighting, taking notes, review of annotations, seeking additional information and monitoring understanding. Results of a path analysis indicated that higher mastery goals predicted more information-seeking and note-taking and marginally more monitoring of learning. Performance avoidance goals negatively predicted note-taking and information-seeking. Performance approach goals did not predict the behaviors we traced. Of the behaviors we traced, highlighting and monitoring predicted increases in comprehension scores. A behavioral approach to assessing learning processes confirmed only a subset of paths from achievement goals to learning processes to learning outcomes originally discovered with self-report data.     

Effects of online note taking formats and self-monitoring prompts on learning from online text: Using technology to enhance self-regulated learning

This study explored conditions under which note taking methods and self-monitoring prompts are most effective for facilitating information collection and achievement in an online learning enviornment. In experiment 1 30 students collected notes from a website using an online conventional, outline, or matrix note taking tool. In experiment 2 119 students collected notes from a larger, more ecologically valid set of learning materials using the conventional, outline, or the matrix tool. One half of the students also received prompts designed to encourage self-monitoring. Results of both experiments indicated that the matrix note taking device was a superior tool for collecting information and for achievement. Results of experiment 2 indicated that self-monitoring prompts have a significant positive impact on notes taken and achievement as well. Results are discussed relative to self-regulated learning and perceptual enhancement theories.     

Examining research on the impact of distance and online learning: A second-order meta-analysis study

Distance learning has evolved over many generations into its newest form of what we commonly label as online learning. In this second-order meta-analysis, we analyze 19 first-order meta-analyses to examine the impact of distance learning and the special case of online learning on students’ cognitive, affective and behavioral outcomes. We examine to what extent distance learning generation level, and instructional setting moderate the influences of distance learning on cognitive, affective and behavioral outcomes. This second-order meta-analyses also analyzes the first-order meta-analyses for methodological quality and robustness. The findings revealed a statistically significant overall average effect size (g = 0.156, p < .001 with a 95% confidence interval of 0.087–0.224) of distance learning impacting cognitive, affective and behavioral outcomes in comparison to face-to-face learning. Meta-analyses on higher education had a statistically significant larger effect size than K-12 education. Limitations, implications, and directions for future research are discussed.     

Exploring the relationships between students' academic motivation and social ability in online learning environments

This research explicates the construct of social ability and describes the relationship between students' academic motivation and social ability in online learning environments. Findings reveal perceived peers social presence, perceived written communication skills, perceived instructor social presence, comfort with sharing personal information, and social navigation as the five factors that define social ability. In addition, the multivariate multiple regression analyses indicate that different motivational constructs vary in their relationships with the multiple social ability factors. Intrinsic goal orientation is related to perceived peers social presence. Self-efficacy explains the variance of perceived instructor social presence and comfort with sharing personal information. Task value is associated with social navigation and both perceived peers and instructor social presence. Additional studies are needed to replicate the current findings and further explicate social ability in online learning, to continue to improve the social ability instrument, and to examine the value of other academic motivation beliefs in predicting social ability as well as that of social ability in predicting learning outcomes.     

Qualitative review synthesis: the relationship between inattention and academic achievement

Background: A body of literature has emerged that links inattentive symptoms of attention deficit hyperactivity disorder (ADHD) to poor academic achievement. Major variation across studies renders conclusions about this relationship complex.

Purpose: This review will provide a qualitative synthesis of these studies that (1) use community samples and (2) examine inattention as a separate dimension from hyperactivity/impulsivity. The aim of this review is to ascertain whether the relationship documented between inattention and academic outcomes in ADHD also holds for the dimensional trait of inattention as manifest in non-clinical community samples of children and adolescents, taking into consideration both academic achievement and academic performance across age.

Design and methods: A comprehensive search was carried out using two databases. The PRISMA guidelines were used to report the search steps. The QUIPS tool was used to rate the quality of studies, followed by a best evidence synthesis to summarise these results.

Results: Out of 1748 citations found, 27 articles met the specific inclusion criteria. Results point to a strong effect according to the best evidence synthesis: 7 studies that have low risk of bias found that teacher-rated inattention is significantly predicative of poor academic achievement in community samples of children.

Conclusions: This review provides support for a consistent, negative relationship between classroom inattention as reported by teachers and both standardised academic test achievement and classroom performance outcomes for children in preschool (moderate evidence), elementary school and longitudinally from elementary to high school. The average relationship was stronger when classroom performance was measured, as compared to standardised achievement. However, the quantitative strength of relationship has not been confirmed with a meta-analysis due to heterogeneity and too few high-quality studies identified. Variance across the studies in terms of the strength of association suggests that other unexamined factors (e.g. cognitive function or motivation) may be contributing to this relationship. Implications for educators and clinicians who work within the school setting are discussed.     

The effects of digital storytelling on student achievement,social presence,and attitude in online collaborative learning environments

This study investigated the effects of digital storytelling on student achievement, social presence, and attitude in online collaborative learning environments. Students in one middle school course were randomly assigned to one of the two treatment groups after they received initial general instruction regarding teamwork skills. The “digital storytelling-based online collaborative learning (DST-OCL)” and the “general online collaborative learning (G-OCL)” groups received subsequent associated skills training. The overall results indicated that after each group took part in the treatment during online collaborative learning activities, the “DST-OCL” groups had significantly higher social presence than the “G-OCL” groups. Specifically, using “DST-OCL” strategies was significantly more effective than using “G-OCL” strategies for improving the “online communication,” “interactivity,” and “privacy” components of students’ social presence in online collaborative learning environments. There was no significant difference between the two groups regarding student achievement and attitude. The findings of this study offer an insight into methods for using digital storytelling as an instructional strategy for improving online collaborative learning effectiveness.