Towards learning analytics adoption: A mixed methods study of data-related practices and policies in Latin American universities

In Latin American universities, Learning Analytics (LA) has been perceived as a promising opportunity to leverage data to meet the needs of a diverse student cohort. Although universities have been collecting educational data for years, the adoption of LA in this region is still limited due to the lack of expertise and policies for processing and using educational data. In order to get a better picture of how existing data-related practices and policies might affect the incorporation of LA in Latin American institutions, we conducted a mixed methods study in four Latin American universities (two Chilean and two Ecuadorian). In this paper, the qualitative data were based on 37 interviews with managers and 16 focus groups with 51 teaching staff and 45 students; the quantitative data were collected through two surveys answered by 1884 students and 368 teachers, respectively. The findings reveal opportunities to incorporate LA services into existing data practices in the four case studies. However, the lack of reliable information systems and policies to regulate the use of data imposes challenges that need to be overcome for future LA adoption.     

Using learning analytics to assess student engagement and academic outcomes in open access enabling programmes

Curriculum design, teaching methods, assessments and range of academic support need to be inclusive in Open Access Enabling courses. The findings of this study confirm a correlation between student access to online learning materials and a positive impact on grades in science courses. More specifically, students who frequently use the online learning system to access materials have better assessment and exam results.     

Re-integrating academic development and academic language and learning: a call to reason

This paper argues for the re-integration of academic development (AD) and a academic language and learning (ALL) practitioners in Australian higher education. This argument is made as universities aim to develop internationally recognised, inter-disciplinary and standards-based curricula against the backdrop of international comparative education (e.g., Organisation for Economic Cooperation and Development), the Australian Qualifications Framework and a quality emphasis on English language standards (e.g., Tertiary Education Quality and Assessment Agency). Drawing on Rowland's argument that professional life in the academy has become fragmented across five fault lines ([2002]. Overcoming fragmentation in professional life: The challenge for academic development. Higher Education Quarterly, 56(1), 52–64), I propose a sixth: the pedagogical fault line between language and learning which I argue is institutionally manifest in the historical bifurcation of AD and ALL practitioners in the academy. This paper traces the historical separation of these two fields of practice in Australian higher education in order to disturb the present distinction and show how it is more an accident of history than the result of sound pedagogical decision-making. The paper argues that in the current educational context, it is timely to consider a re-integration of these two aspects of the academic field. It is suggested that such a move will create research and teaching connections that develop synergies in educational development that are able to work with language and learning simultaneously.     

Evaluation of a learning analytics tool for supporting teachers in the creation and evaluation of accessible and quality open educational resources

The learning analytics (LA) field seeks to analyze data about students’ interactions, and it has been applied in the development of tools for supporting both learning and teaching processes. Recent research has paid attention on how LA may benefit teachers in the creation of educational resources. However, most of the research on LA solutions is carried out to support teachers in analyzing students’ behavior data collected as they interact with virtual learning environments. While solutions to support teachers in different virtual learning and teaching contexts have become important, to date little research has been done on how LA solutions can help teachers to create and evaluate Open Educational Resources (OERs). This study aims at presenting the evaluation of a LA tool for supporting teachers in the creation and evaluation of accessible and quality OERs considering that both processes fall within the competences that teachers can acquire and strengthen by participating as authors (creation) and evaluators (evaluation) of OERs. The study was conducted with Colombian teachers and the results obtained highlight the positive effect the tool had on the teachers’ acquisition of the competences and the positive attitude they had toward using the tool.     

Learning analytics to uncover inequality in behavioural engagement and academic attainment in a distance learning setting

Abstract

Although the attainment gap between black and minority ethnic (BME) students and white students has persisted for decades, the potential causes of these disparities are highly debated. The emergence of learning analytics allows researchers to understand how students engage in learning activities based on their digital traces in a naturalistic setting. This study investigates the attainment gap by analysing the differences in behavioural engagement between different ethnic groups. Using multilevel models of academic performance, demographics, and online traces of 149,672 students enrolled in 401 modules in a distance learning setting, we confirmed the existing attainment gap. After controlling for other demographics, module characteristics and engagement, BME students were between 19% and 79% less likely to complete, pass or achieve an excellent grade compared to white students. Given the same academic performance, BME students spent 4-12% more time on studying than white students. While the attainment gap remained persistent after controlling for academic engagement, our study further highlighted the inequality of attainment between BME and white students.     

A systematic review on the deployment and effectiveness of data analytics in higher education to improve student outcomes

Abstract

This is a systematic review conducted of primary research literature published between 2007 and 2018 on the deployment and effectiveness of data analytics in higher education to improve student outcomes. We took a methodological approach to searching databases; appraising and synthesising results against predefined criteria. We reviewed research on the effectiveness of three differentiated forms of data analytics: learning, academic and learner analytics. Student outcomes are defined as retention, academic performance and engagement. Our results find that three quarters of studies report the use of educational data analytics to be effective in improving student outcomes but their relationship with student outcomes requires further and more robust investigation and assessment. We argue that research must interpret and communicate effectiveness qualitatively, as well as quantitatively, by including the student voice in assessments of impact.     

The effects of cooperative learning on peer relations,academic support,and engagement in learning among students of color

Abstract

Despite Brown vs. Board of Education, prejudice still exists in the American school system. These attitudes can give rise to negative social experiences for students of color (i.e., discrimination), negatively impacting their mental and physical health and creating disparities in educational outcomes. Rather than seeking to ameliorate these negative experiences, our approach attempts to address the underlying prejudices and, in so doing, reduce these disparities. Using 4 waves of data from a cluster randomized trial (N?=?15 middle schools, 1,890 students, 47.1% female, 75.2% White), we hypothesized that cooperative learning, which has been shown to reduce prejudice in previous research, would create positive gains in peer relatedness, perceptions of academic support, and engagement in learning, and that gains would be larger for students of color; our results confirmed these hypotheses. Our findings highlight the potential role of cooperative learning in reducing disparities and creating greater equity in education.     

Controlled evaluation of a multimodal system to improve oral presentation skills in a real learning setting

Developing oral presentation skills requires both practice and expert feedback. Several systems have been developed during the last 20 years to provide ample practice opportunities and automated feedback for novice presenters. However, a comprehensive literature review discovered that none of those systems have been adequately evaluated in real learning settings. This work is the first randomised controlled evaluation of the impact that one of these systems has in developing oral presentation skills during a real semester-long learning activity with 180 students. The main findings are that (1) the development of different dimensions of the oral presentations are not affected equally by the automated feedback and (2) there is a small but statistically significant effect of the use of the tool when a subsequent presentation is evaluated by a human expert.     

Effects of learning approaches,locus of control,socio-economic status and self-efficacy on academic achievement: a Turkish perspective

In this study the effects of learning approaches, locus of control (LOC), socio-economic status and self-efficacy on undergraduate students in North Cyprus was investigated. Four questionnaires were administered on 99 students in order to collect data regarding the learning approaches, LOC, self-efficacy and demographic factors. High cumulative grade point average and self-efficacy were shown to be an indicator of academic achievement and high self-efficacy was related to the use of deep approach (DA). Students, whose mothers had lower levels of education, were found to also predict academic success. No direct significant relationship between DA and academic achievement was found.     

Process evaluation of a teaching and learning centre at a research university

This paper describes the evaluation of a teaching and learning centre (TLC) five?years after its inception at a mid-sized, midwestern state university. The mixed methods process evaluation gathered data from 209 attendees and non-attendees of the TLC from the full-time, benefit-eligible teaching faculty. Focus groups noted feelings of inclusiveness because of the sole concentration on teaching. The survey found that attendees felt more positive about the value and effectiveness of the TLC than non-attendees, and no one on campus expressed negative feelings about its effectiveness. We discuss implications for future evaluation research.     

Preliminary evidence of a relationship between the use of online learning and academic performance in a South African first-year university accounting course

Abstract

This article examines the relationship between the use of online learning resources and academic performance in an Accounting 1 course conducted at a South African Higher Education Institution. The study employed a quantitative analysis over three academic years comparing the collection of end of year marks and the time spent online. The results provide preliminary empirical evidence to show that students who spent more time online significantly improved their course mark. Although much accounting-based educational research exists on the use of computers, there is a dearth of research testing any relationship between the use of online learning material and performance, and particularly in accounting education. While the results are preliminary and have some limitations, they are useful to students, teaching instructors and administrators, and provide a platform for future research into the value of using online learning in accounting.     

Developing a mathematics curriculum to improve learning behaviors and mathematics competency of children

The authors investigated the effect of a mathematical curriculum (CU) developed based on verbal and practical activities on the mathematical competency (MC) and learning behaviors (LB) of preschool children. In a quasi-experimental design, 60 children (5- to 6-year-old girls) were selected using the accessible sampling method. The children were randomly divided into an experimental group and a control group, and the relevant concepts were taught to the children in both groups. While the control group received the typical kindergarten education based on the usual textbooks and worksheets, the CU was taught to the experimental group. Structural equation modeling was used to model the data and statistical evaluation. The results demonstrated a significant difference between the two groups in MC and LB. The CU significantly improved MC directly, and indirectly through the improvement of LB (i.e., engagement and learning focus, verbal behaviors, and type of activity).     

Preliminary evidence of a relationship between the use of online learning and academic performance in a South African first-year university accounting course

Abstract

This paper examines the relationship between the use of online learning resources and academic performance in an Accounting 1 course conducted at a South African Higher Education Institution. The study employed a quantitative analysis over three academic years comparing the collection of end of year marks and the time spent online. The results provide preliminary empirical evidence to show that students who spent more time online significantly improved their course mark. Although much accounting-based educational research exists on the use of computers, there is a dearth of research testing any relationship between the use of online learning material and performance. While the results are preliminary and have some limitations, they are useful to students, teaching instructors and administrators, and provide a platform for future research into the value of using online learning in accounting.     

Learning and Study Strategies among First-Year Students at a South African University: A Mixed Methods Study

South African higher education is plagued by low academic success rates. Academic development and support units can play an important role in addressing low academic success rates by assisting students in developing appropriate learning and study strategies. Limited information is available on students’ learning and study strategy profiles and their needs regarding intervention programmes. This article reports on a mixed methods study that investigated learning and study strategies among a sample of first-year students enrolled at a South African university. Quantitative data, collected using the Learning and Study Strategies Inventory (LASSI) from a sample of first-year students, pointed to an urgent need for learning and study strategy intervention programmes to be provided. The qualitative data offered a more in-depth understanding of participants’ needs regarding learning and study strategy intervention programmes. Implications for practice and avenues for further research are discussed.     

Application of experiential learning to improve student engagement and experience in a mechanical engineering course

ABSTRACT

This paper introduced how a mechanical engineering course was redesigned by applying experiential learning theory to improve student engagement and learning experience. Design of machine elements has been considered by students to be a difficult course. Traditional teaching methods tend not to be effective in engaging students. Experiential learning is a philosophy of learning by doing. In applying an experiential learning approach to the course, the design project and workshop activities were restructured in such a way that students were engaged in direct experience and focused reflection to construct knowledge. By exploring a physical gearbox model, working on subtasks for the design project, having group discussions, raising questions, getting feedback, and moving forward for next subtasks, students experienced the learning cycles of ‘DO, OBSERVE, THINK, and PLAN’ many times. Course survey results showed that application of experiential learning helped to improve student engagement and learning experience significantly.     

Comparative functions of preschool learning style and IQ in predicting future academic performance

Early assessment programs frequently rely on intelligence tests for making predictions regarding children's future school performance. Unfortunately, IQ scores provide little information to those who must develop educational interventions tailored to the unique ways in which children respond to learning situations. Alternatively, measures of children's learning style focus on distinct patterns of learning-related behavior manifested in classroom settings. Each dimension of learning style is composed of observable skills that are potentially teachable or alterable through available instructional procedures. In order to examine the relative contributions of learning style dimensions, IQ, and their interactions to the prediction of subsequent performance, 100 kindergarten children were evaluated by teachers using the Study of Children's Learning Styles scale and were administered the Kuhlmann-Anderson Intelligence Test. Fifteen months later the children's first-grade achievement was determined through standardized tests and teacher-assigned grades in reading, language, and mathematics. Relationships between the predictor and criterion variables were studied through patterns of bivariate correlations, canonical variate loadings, and standardized regression weights. Although IQ was found the better predictor, learning styles accounted for appreciable and statistically significant proportions of the variability in later achievement. The learning style dimensions functioned differentially across areas of achievement to enhance overall prediction either by complementing or interacting with the predictions afforded by IQ. The results are examined in the light of earlier research on learning-related behavior.     

The effects of resilience in learning variables on mathematical literacy performance: a study of learning characteristics of the academic resilient and advantaged low achievers in Shanghai,Singapore, Hong Kong,Taiwan and Korea

Abstract

Many students from disadvantaged homes participating in Programme for International Student Assessment (PISA) 2012 were classified as academic resilient (called disadvantaged high achiever, the DHA in this study). In comparison with peers of comparable home background status, there were also students from advantaged homes performing far behind standard in mathematical literacy performance (called advantaged low achiever, the ALA). Drawing data from the PISA 2012, this study sought to examine the similarities and differences in learning mathematics characteristics (ie gender, family and academic background, and resilience in learning variables) amongst students of the top five high-performing Asian economies, ie Shanghai, Singapore, Hong Kong, Taiwan and Korea. The results of the logistic regression analyses showed that variables like family and academic background, as well as resilience in learning mathematics variables (eg familiarity with mathematical concept, mathematics self-efficacy, mathematics self-concept and mathematics anxiety) are able to predict whether a student of comparable disadvantaged (or advantaged) home background is more likely to be classified as DHA (or ALA) or not. The findings are important to shed light on the principles and methods of mathematics education so as to help the low achievers, whether advantaged or disadvantaged, to advance to higher level of mathematical literacy attainment.     

Aids to computer-based multimedia learning: a comparison of human tutoring and computer support

Learners are usually provided with support devices because they find it difficult to learn from multimedia presentations. A key question, with no clear answer so far, is how best to present these support devices. One possibility is to insert them intothe multimedia presentation (canned support), while another is to have a human agent provide them (human tutoring). Human tutoring poses potential advantages: it uses spoken modality, displays non-verbal cues and implies social interaction. However, there is mixed evidence regarding these supposed advantages, and prior research comparing human and computer support presents problems. Our goal was to explore whether the advantages of human tutoring actually exist while avoiding the problems of prior research. In one experiment, participants learned Geology from a multimedia presentation including one of three forms of support: human tutoring, canned support or no support. After viewing the presentation, participants solved retention and transfer tests. Results revealed that participants in the human tutoring condition outperformed those in the other two conditions, who did not differ from each other. This means that human tutoring is advantageous, a fact that has implications in the design of support devices in multimedia learning.