Can videos affect learning outcomes? Evidence from an actual learning environment

Educational technology research and development - We examine the effect of an innovation in an educational context, a class of 500?+?first-year economics students at a well-known...     

Do flexible admission systems affect student enrollment? Evidence from UK universities

We reveal the current level of flexible admission systems (FAS) at UK universities, and explore its impact on student enrollment rates. We employ quantitative analysis techniques for data collected and customized from the Higher Education Statistics Agency (HESA) in the UK, during the period 2010–2015. To understand the impact of FAS on student enrollment, six statistical tests were conducted. Based on the level of FAS adopted by universities, we identified four groups of UK universities: very low, low, medium, and high levels of FAS. No robust evidence exists to support claims that universities which apply a higher level of FAS have higher student enrollment. The study results were based only on secondary data collected from HESA, so future studies should be based on other types of data. This paper attempts to cover the missing elements of previous literature and its traditional research techniques.     

Do student migrations affect school performance? Evidence from Wisconsin's inter-district public school program

This paper examines the competitive effects of a unique school choice program implemented in the late 1990s, Wisconsin's open enrollment program, which allows families to send their children to schools outside their home district. In contrast to other school choice programs, districts not only face negative consequences from losing students and state funding, but they also stand to gain in the event of student emigration from other districts. The identification approach exploits differences in the number of schools in bordering districts, which affects inter-district ease-of-transfer. Estimates produce three main conclusions. First, districts that experience student out-migration produce higher standardized test scores in the subsequent year. Second, these effects are most evident among districts for which out-migration, expressed as a percentage of enrollment, falls in the upper quartile of all districts under consideration. Third, districts do not appear to respond to in-migration, indicating that districts place more emphasis on (and have more control over) preventing out-migration, as opposed to encouraging in-migration. These findings provide evidence that schools respond to competitive forces by improving quality.     

Do increases in national-level preschool enrollment increase student achievement? Evidence from international assessments

The main purpose of the study is to analyze whether globally observed trends towards preschool expansion have impacted student achievement in primary and secondary school. We use data from multiple study cycles of two international large-scale assessments that have a longitudinal component at the country level—PIRLS and PISA—and combine these data with a country-level measure of preschool enrollment rates as the main explanatory variable. Employing a multilevel regression with fixed effects for countries and years, we find that changes in preschool enrollment are unrelated to changes in average student achievement. Even after controlling for covariates on the individual and country levels, we do not find any support for the policy expectation that expanding preschool enrollment per se leads to better student achievement on country level.     

Does learning happen? A mixed study of online chat data as an indicator of student participation in an online English course

Education and Information Technologies - Student participation, as a significant indicator of class learning, has been investigated from various perspectives. The present research seeks to explore...     

Digital technologies for promoting “student voice” and co-creating learning experience in an academic course

“Student voice” (SV) refers to listening to and valuing students’ views regarding their learning experiences, as well as treating them as equal partners in the evaluation process. This is expected, in turn, to empower students to take a more active role in shaping their learning. This study explores the role played by digital technologies in creating a space for SV in academia. The qualitative study was conducted in an academic course, which combines face-to face, synchronous lessons with a variety of asynchronous self-directed and group learning activities. The participants were 54 Master’s students in education. We analyzed the pedagogical design of the course, as well as interpretations of teaching, learning, assessment, and the role of technology as experienced and presented by the students. The findings demonstrated that students functioned as co-designers of the course content, co-creators of teaching and of their own learning experience. Students perceived the requirements of active learning, teamwork, and community participation (i.e., an advanced way of conveying SV—leadership; Mitra International handbook of student experience in elementary and secondary school, Springer Publishers, The Netherlands, 2007), as both challenges related to overload and stress, and benefits related to the gains of meaningful learning, innovative pedagogical design, and diverse instructional methods. The equalization effect of the digital environment, which diminishes status cues changed the power dynamic, promoted students’ active participation and their pedagogical partnership with the instructor. Based on the findings, our conceptualization of SV and its implications for academia includes: (1) co-design of content, (2) co-teaching, (3) co-creation of learning experience and outcomes, and (4) embedded co-assessment for learning.     

Do student-centred learning activities improve learning outcomes on a BTEC Applied Science course in FE?

This article provides quantitative evidence on the effect on learning outcomes of contrasting teaching styles applied to a class of Level 3 final-year students on a BTEC Applied Science course within a further education college in the UK. Two topics within a unit were taught using either a student-centred or teacher-centric (instructional) approach. Learning outcomes were monitored via tests aimed at both surface and deeper learning. Analysis showed that there was no significant difference between instructional or student-centred modes of teaching with respect to surface learning outcomes. However, analysis showed that a significant difference (p = 0.025) had occurred in deeper learning outcomes between the two modes of teaching. Interestingly, in this study, deeper learning was significantly improved after instructional teaching as opposed to student-centred teaching. Possible reasons for this are discussed and related to the role of instruction in vocational science education within FE. Preferences for teaching style were also obtained from the students via a survey and this indicated that PowerPoints were considered helpful whereas practical work and research tasks were very helpful to their learning.     

What response rates are needed to make reliable inferences from student evaluations of teaching?

This paper addresses the determination of statistically desirable response rates in students’ surveys, with emphasis on assessing the effect of underlying variability in the student evaluation of teaching (SET). We discuss factors affecting the determination of adequate response rates and highlight challenges caused by non-response and lack of randomization. Estimates of underlying variability were obtained for a period of 4?years, from online evaluations at the University of British Columbia (UBC). Simulations were used to examine the effect of underlying variability on desirable response rates. The UBC response rates were compared to those reported in the literature. Results indicate that small differences in underlying variability may not impact desired rates. We present acceptable response rates for a range of variability scenarios, class sizes, confidence level, and margin of error. The stability of estimates observed at UBC, over a 4-year period, indicates that valid model-based inferences of SET could be made.     

Discrepancies in purposes of student course evaluations: what does it mean to be “satisfied”?

Educational Assessment, Evaluation and Accountability - Student evaluation of teaching is a multipurpose tool that aims to improve and assure educational quality. Improved teaching and student...     

Vets and videos: student learning from context‐based assessment in a pre‐clinical science course

To increase the perceived relevance of pre‐clinical science courses to undergraduates, a context‐based assessment item was introduced to a genetics course that occurs early within a five‐year veterinary science programme. The aim was to make a direct link between genetic concepts and the future clinical profession of the students. In the assessment task, students used problem‐solving skills to deduce relationships between genetic variants and nose and coat colour in dogs and to determine breeding strategies to obtain a specified colour combination. The assignment was contextualised by students presenting their results as a role‐play video of a veterinarian/client consultation. The students responded enthusiastically, finding relevance and enjoyment in the task. Together with the higher cognitive skills required, contextualisation is likely to be responsible for the deeper style of learning that was adopted by the majority of students. Hence, making explicit links between pre‐clinical content and its use in a workplace setting can lead to improved learning outcomes     

Do girls’ scholarship programs work? Evidence from two countries

This study examined the extent that a scholarship program operating in Sierra Leone and Djibouti was successful in increasing girls’ persistence in basic education. Results of field studies indicated that scholarships could be appropriately targeted and delivered in ways that appear to minimize misappropriation of funds. However, the scholarships often created significant tensions between award recipients and non-recipients and among their families that frequently isolated recipient girls and led to their harassment by non-recipients. These findings are interpreted within the context of the larger debate about the relative merit of abolishing school fees for all students or targeting scholarships for only the neediest students.     

Do drawing tasks improve monitoring and control during learning from text?

In two experiments it was investigated how drawing as a monitoring task affects self-regulated learning and cognitive load. To this end, participants (Exp. 1: N = 73, Exp. 2: N = 69) were randomly assigned to one of two conditions. In the experimental condition, students were asked to read an expository text on the formation of polar lights consisting of five paragraphs, whereby, after each paragraph, they had to create a drawing of the text's content. In the control condition, students read the same text, but performed no drawing task. In both conditions, students had to give judgments of learning (JoLs) after each paragraph and after reading the whole text as well as rate their cognitive load. Then, they were asked to select paragraphs for restudy. In Experiment 1, participants continued with an assessment of their learning outcomes immediately after their restudy selection, whereas in Experiment 2 they were first given the opportunity to actually restudy the selected paragraphs before working on the posttest. Results of both experiments indicate that JoLs rather than cognitive load predicted posttest performance. Moreover, students in the drawing condition compared with the control condition exhibited more accurate (relative) monitoring in Experiment 1 in that their JoLs were more strongly related to performance. Moreover, JoLs predicted students' restudy decisions in both experiments; however, this effect was by-and-large independent of whether they had to draw. Overall, results hint towards the potential of drawing to support metacognitive monitoring.     

No student left behind? Evidence from the Programme for School Guidance in Spain

This paper evaluates the effects of a remedial education programme implemented in Spain between 2005 and 2012 that offered after-school classes for underperforming students from poor socioeconomic backgrounds. We use two different estimation strategies, re-weighting estimators and propensity score matching, and address the existence of selection bias. We find that this programme had a substantial positive effect on children’s academic achievement: the probability of falling behind the general progress of the group declined by between 3.5 and 6.4 percentage points and mean reading scores increased by between 8.5 and 17.4% of one standard deviation. We also find that a larger exposure to the programme improves students’ scores: whereas students in schools that participated in the programme for at most two years do not experience any significant positive effect, those in schools that participated for at least three years did. The programme significantly reduced the probability of belonging to the bottom part of the distribution (by between 3.2 and 7.7 percentage points) and improved mean scores (by between 8 and 21.5% of one standard deviation). Finally, we find that the impact of the programme is much stronger for students in rural schools than for students in urban schools.     

Do college admissions counselors discriminate? Evidence from a correspondence-based field experiment

I design and implement a correspondence based field experiment to test for race and gender discrimination among college admissions counselors in the student information gathering stage. The experiment uses names to identify student race and gender, and student grade, SAT score, and writing differences to reflect varying levels of applicant quality. I find that counselors do not respond differently by race in most cases, but there are measurable differences in response/non-response and in the type of correspondence sent that favor female students. I also find that the quality of the student induces large differences in the type of response.     

Does the amount of on-screen text influence student learning from a multimedia-based instructional unit?

The present study examines how changes in the amount of on-screen text will influence student learning from a multimedia instructional unit on basic concepts of coordinate geometry. The relative effectiveness of two different versions (short-text and whole-text) of the instructional unit was examined for students who differed in terms of their ability to remember symbolic units, symbolic systems and symbolic interpretations. A total of 101 seventh graders were randomly assigned to work with either the whole-text or the short-text version. Student gains were analyzed using pre-test, post-test and retention test scores. Memory ability was assessed by the sub-tests of the Structure of Intellect-Learning Abilities Test. Results indicated no significant differences between groups who worked with short-text and whole-text versions. However retention scores of high and low memory groups who worked with the whole-text version showed significant differences. The whole-text version was observed to favor students with high memory for symbolic implications. Results suggest that workability of design principles for multimedia instruction may depend on the nature of the task and characteristics of the learner.     

How do student teachers reflect on their practice through practicum courses? A case study from Iran

The present study investigates the nature of Iranian student teachers’ reflections and their professional development in the context of teacher education practicums. The participants were student teachers (N = 41) enrolled in teacher education colleges at Farhangian University in Tehran, Iran. A total of 620 reflective writing excerpts were coded using deductive content analysis across three cohorts in three different practicums during a two-year period. To analyse the data, this study applied a rubric for evaluating student teachers’ reflections developed by Ward and McCotter. The analysis also involved Friedman’s test and follow-up Wilcoxon tests. The results show that routine levels of reflection significantly decreased across the three practicums, while technical levels of reflection significantly increased. The higher levels of reflection, namely dialogic and transformative levels, were rarely found in student teachers’ reflective writings across the practicums. This study discusses the need both to develop appropriate methods to guide student teachers in centralized contexts such as Iran and to investigate further aspects that enhance or hinder progress in the quality of reflection in teacher education.     

Does attending a STEM high school improve student performance? Evidence from New York City

We investigate the role of specialized science, technology, engineering, and mathematics (STEM) high schools in New York City (NYC) in promoting performance in science and mathematics and in closing the gender and race gaps in STEM subjects. Using administrative data covering several recent cohorts of public school students and a rich variety of high schools including over 30 STEMs, we estimate the effect of attending a STEM high school on a variety of student outcomes, including test taking and performance on specialized science and mathematics examinations. While comparisons of means indicate an advantage to attending a STEM school, more thorough analysis conditioning on a rich set of covariates, including previous grade test performance, reduces or eliminates this advantage. Females and males in STEMs do better than their counterparts in Non-STEMs, but the gender gap is also larger in these schools. We also find that the black-white and Hispanic-white gaps are smaller in STEM relative to Non-STEM schools across almost all outcomes, but the Asian-white gap, in contrast, is larger in STEMs relative to Non-STEMs.     

What are students doing during lecture? Evidence from new technologies to capture student activity

Engaging students in class is paramount if they are to gain a deep understanding of class content. Student engagement is manifested by attention to the various components of instruction. However, there is little research at the tertiary level focusing on what aspects of instruction are related to changes in student attention during class. To address this gap, we collected multiple streams of data that provide a measure of student attention during instruction. We had students in an organic chemistry course who wear hats with a camera mounted on the brim, to provide a record of student gaze (i.e. looking at the board, notes, and friends). We also had students who use electronic pens that allowed us to record what information students transferred into their notes (pencasts). Based on our initial results, we believe the data provided by the point-of-view cameras and electronic pens hold great promise for using these technologies as viable research tools in educational settings to address various research questions.     

Executive functions in learning processes: Do they benefit from physical activity?

As executive functions play an essential role in learning processes, approaches capable of enhancing executive functioning are of particular interest to educational psychology. Recently, the hypothesis has been advanced that executive functioning may benefit from changes in neurobiological processes induced by physical activity. The present research explored this hypothesis by systematically identifying and reviewing intervention studies targeting the relationship between physical activity and executive functions, distinguishing between different types of intervention and of executive function. The review found considerable evidence for beneficial effects of physical activity on executive functions, with performance benefitting more consistently in inhibition tasks than in dual task coordination, shifting tasks, or combined tasks. Possible physiological explanations are discussed. Open questions for application and future research concern the sustainability of effects, the design of physical activity interventions, and the role of individual differences. Possible interventions applicable to educational settings are discussed.     

Does more schooling imply improved learning? Evidence from the Kanyashree Prakalpa in India

Studies on Conditional Cash Transfer (CCT) programs have documented positive effects on school enrollment though evidence on learning outcomes is mixed. Using representative data, we evaluate one of the largest CCT programs, Kanyashree Prakalpa (KP), which was implemented in the state of West Bengal, India, in 2013. In particular, we examine the effect on female school enrollment and learning outcomes. Exploiting the timing of the program implementation for identification and applying difference-in-difference regressions, we document a positive effect on enrollment with no discernible impact on secondary and higher secondary school completion. We also observe significant improvements in lower-level learning outcomes but a marked deterioration in higher-level skills like solving simple division problems. Complementary investments like classroom availability and teacher attendance appear to have fallen after the implementation of KP, which explains the decline in learning skills despite higher schooling exposure, thereby underscoring the need for supply-side interventions in school amenities.