A Comparison of Student Achievement and Satisfaction in an Online Versus a Traditional Face-to-Face Statistics Class

In this study we examined differences between online distance education and traditional classroom learning for an introductory undergraduate statistics course. Two outcome dimensions were measured: students final grades and student satisfaction with the course. Using independent samples t-tests, results indicated that there was no significant difference in grades between the online and traditional classroom contexts. However, students enrolled in the online course were significantly less satisfied with the course than the traditional classroom students on several dimensions. This finding is inconsistent with the no significant difference phenomenon, described in Russells (1999) annotated bibliography, which supports minimal outcome differences between online courses and face-to-face courses.Jessica J. Summers and Tiffany A. Whittaker are Assistant Professors, and Alexander Waigandt is an Associate Professor in the Department of Educational, School, and Counseling Psychology at the University of Missouri–Columbia. Dr. Summers holds a Ph.D. in Educational Psychology from the University of Texas at Austin. Her research interests include the study of social contexts of motivation, academic classroom community, and cooperative learning. Dr. Waigandt holds a Ph.D. in Community and School Health from the University of Oregon. His primary research interest is in demographic analysis. Dr. Whittaker holds a Ph.D. from the University of Texas at Austin. Her research interests include model selection methods in structural equation modeling and multiple regression, interpretation of score reports in computer-based testing, and the effects of missing data on the recovery of item and person parameters in the item response theory framework.     

A Randomized Trial of an Elementary School Mathematics Software Intervention: Spatial-Temporal Math

Abstract

Fifty-two low performing schools were randomly assigned to receive Spatial-Temporal (ST) Math, a supplemental mathematics software and instructional program, in second/third or fourth/fifth grades or to a business-as-usual control. Analyses reveal a negligible effect of ST Math on mathematics scores, which did not differ significantly across subgroups defined by prior math proficiency and English Language Learner status. Two years of program treatment produced a nonsignificant effect. Publication of evaluation results from large-scale real-world supplemental mathematics instructional implementations such as this one can provide a realistic view of the possibilities, costs, and limitations of this and other computer aided instruction supplemental interventions.     

Detecting Intervention Effects Across Context: An Examination of the Precision of Cluster Randomized Trials

The Institute of Education Sciences has funded more than 100 experiments to evaluate educational interventions in an effort to generate scientific evidence of program effectiveness on which to base education policy and practice. In general, these studies are designed with the goal of having adequate statistical power to detect the average treatment effect. However, the average treatment effect may be less informative if the treatment effects vary substantially from site to site or if the intervention effects differ across context or subpopulations. This article considers the precision of studies to detect different types of treatment effect heterogeneity. Calculations are demonstrated using a set of Institute of Education Sciences funded cluster randomized trials. Strategies for planning future studies with adequate precision for estimating treatment effect heterogeneity are discussed.     

从在线协作到面对面协作:基于多点触摸桌面的CSCL研究综述

新兴的多用户交互式触摸桌面技术,正逐渐成为CSCL研究关注的热点问题。多点触摸桌面技术与现有课堂的融合,引发了CSCL研究的视角转变:从关注虚拟环境中的交互,转向计算机支持的面对面人际交互。多点触摸桌面的技术特性表现出支持社会性交互、促进多用户协作、丰富学习者动手体验等教育适应性。对已有研究梳理发现,桌面技术在技术架构、课堂交互分析的理论框架两方面已取得可直接指导实践应用的成果。桌面技术教学实证研究的结论表明,该技术能有效支持真实课堂环境中的协作学习。未来此领域的研究焦点将集中在技术与教学两个方面:桌面技术与现有课堂信息技术系统协同工作机制;桌面技术支持下的教师教学组织能力与技术准备。     

Impact of Background Music on Medical Student Anxiety and Performance During Anatomical Dissections: A Cluster Randomized Interventional Trial

Anatomical dissection on cadavers can be a source of anxiety for medical students. Studies in other stressful settings have shown a reduction in anxiety when there is background music. The objective of this study was to determine if music can have an impact on student anxiety, student satisfaction, and student performance in dissection room. This cluster randomized interventional trial included 187 second-year medical students. The intervention was standardized background music, selected based on the literature, with a tempo of between 60 and 80 bpm. Six balanced clusters were randomized (1:1) to music or no music during dissection sessions. The main assessment criterion was a validated self-evaluation scale score for anxiety, the State Trait Anxiety Inventory. Student satisfaction was measured using a visual analog scale and dissection performance was evaluated by an examination. The outcomes were analyzed with mixed models adjusted on group effect, chronic anxiety, and confounding factors. A significant (58%) relative decrease in acute anxiety, odds ratio 0.423 [0.160; 0.710] was found for the music intervention group. Music also had a positive impact on performance with students in the intervention group attaining higher grades than those in the control group (0.42/10 higher, P = 0.0016). The study also showed a nonsignificant increase in satisfaction with 0.37 extra points (P = 0.137) in the intervention group. Background music had a significant impact on anxiety in the dissection room and on technical and theoretical performance in the subsequent anatomy examination. This music intervention could be extended to other stressful work environments.     

Effects of a Pre-Kindergarten Mathematics Intervention: A Randomized Experiment

Abstract

Research indicates that a socioeconomic status-related gap in mathematical knowledge appears early and widens during early childhood. Young children from economically disadvantaged families receive less support for mathematical development both at home and in preschool. Consequently, children from different socioeconomic backgrounds enter elementary school at different levels of readiness to learn a standards-based mathematics curriculum. One approach to closing this gap is the development and implementation of effective mathematics curricula for public preschool programs enrolling economically disadvantaged children. A randomized controlled trial was conducted in 40 Head Start and state preschool classrooms, with 278 children, to determine whether a pre-kindergarten mathematics intervention was effective. Intervention teachers received training that enabled them to implement with fidelity, and a large majority of parents regularly used math activities teachers sent home. Intervention and control groups did not differ on math assessments at pretest; however, gain scores of intervention children were significantly greater than those of control children at posttest. Thus, the intervention reduced the gap in children's early mathematical knowledge.     

Computer-Assisted Learning in Elementary Reading: A Randomized Control Trial

This study evaluated the efficacy of Accelerated Reader, a computer-based learning program, at improving student reading. Accelerated Reader is a progress-monitoring, assessment, and practice tool that supports classroom instruction and guides independent reading. Researchers used a randomized controlled trial to evaluate the program with 344 first- through fourth-grade students in three schools in a large Midwestern U.S. city. The results of hierarchical linear modelling analyses indicated that the computer-assisted learning program had a statistically significant positive impact on student reading gains when compared with traditional reading instruction alone. The impact corresponded to a moderate effect size (d = 0.38).     

Remediating Computational Deficits at Third Grade: A Randomized Field Trial

The major purposes of this study were to assess the efficacy of tutoring to remediate 3rd-grade computational deficits and to explore whether remediation is differentially efficacious depending on whether students experience mathematics difficulty alone or concomitantly with reading difficulty. At 2 sites, 127 students were stratified on mathematics difficulty status and randomly assigned to 4 conditions: word recognition (control) tutoring or 1 of 3 computation tutoring conditions: fact retrieval, procedural computation and computational estimation, and combined (fact retrieval + procedural computation and computational estimation). Results revealed that fact retrieval tutoring enhanced fact retrieval skill, and procedural computation and computational estimation tutoring (whether in isolation or combined with fact retrieval tutoring) enhanced computational estimation skill. Remediation was not differentially efficacious as a function of students' mathematics difficulty status.     

Remediating Computational Deficits at Third Grade: A Randomized Field Trial

Abstract

The major purposes of this study were to assess the efficacy of tutoring to remediate 3rd-grade computational deficits and to explore whether remediation is differentially efficacious depending on whether students experience mathematics difficulty alone or concomitantly with reading difficulty. At 2 sites, 127 students were stratified on mathematics difficulty status and randomly assigned to 4 conditions: word recognition (control) tutoring or 1 of 3 computation tutoring conditions: fact retrieval, procedural computation and computational estimation, and combined (fact retrieval + procedural computation and computational estimation). Results revealed that fact retrieval tutoring enhanced fact retrieval skill, and procedural computation and computational estimation tutoring (whether in isolation or combined with fact retrieval tutoring) enhanced computational estimation skill. Remediation was not differentially efficacious as a function of students' mathematics difficulty status.     

Counting to 20: Online Implementation of a Face-to-Face, Elementary Mathematics Methods Problem-Solving Activity

This study describes implementation of the same problem-solving activity in both online and face-to-face environments. The activity, done in the first class period or first module of a K-2 mathematics methods course, was initially used in a face-to-face class and then adapted later for use in an online class. While the task was originally designed for the face-to-face course, it is not the case that it is fully useful there and less useful in the online version. Rather, each context privileges different ideas about teaching and learning mathematics. Possibilities to address the challenges of each environment are considered with emphasis on task structure and the role of the instructor.     

A Randomized Trial of Teacher Development in Elementary Science: First-Year Achievement Effects

Abstract

This article describes 1st-year experimental effects of a large-scale reform providing professional development to elementary school teachers to implement an extended, inquiry-oriented science curriculum. Known as “immersion teaching” because it “immerses” teachers and students in the full cycle of scientific inquiry, this approach developed through a partnership involving university-based science and mathematics content experts and educators and K-12 educators from the Los Angeles Unified School District. Multilevel analyses, which examined school-level effects of assignment to the professional development intervention, nested Grade 4 students and their science achievement outcomes within the 80 study schools. The analyses revealed a statistically significant negative 1st-year treatment effect of school-level assignment to the initiative on the key science achievement outcome. We also tested whether the treatment had differential effects for English language learners, schools with large proportions of English language learners, and students of new teachers. We found an interaction effect of the treatment by teacher experience level for the teachers who were the primary target of the intervention, with the treatment having positive effects for novice teachers (3 years of experience or less) but a larger, negative effect for veteran teachers. We explore analytically three sets of explanations for the unexpected negative main effect of treatment: potential statistical and design artifacts, possible misalignment between the assessments and content of the treatment, and practical issues related to implementation of the treatment.     

Teachers: A Critical But Overlooked Component of Bullying Prevention and Intervention

To complete this special issue on theoretical bases for antibullying efforts in schools, we focus in this article on the importance of teachers and other educators in the ecology of schools. First, we present evidence that teachers are not perceived to be effective at intervening when bullying occurs. Then, using a social motivational lens, we provide an overview of teachers' role as a socializing agent in the classroom and school with a particular emphasis on their influence on bullying behaviors among students. Then we present two theories, the theory of planned behaviors, and the transactional theory of emotions and coping. We believe these theories highlight the complexity of teacher responses and make the case that teachers need more than knowledge of bullying to be effective in their role. We discuss implications for teacher training and professional development.     

Math Shelf: A Randomized Trial of a Prekindergarten Tablet Number Sense Curriculum

Research Findings: Effective preschool mathematics instruction is especially important for low-income children. Previous research demonstrates that low-income children enter kindergarten behind their middle-income peers. They receive less mathematics support at home and from public preschools. The aim of this study was to test Math Shelf, a tablet intervention designed to improve at-risk preschoolers’ mathematics performance. A total of 100 children participated in a randomized controlled trial in a large urban Head Start center. Intervention students played Math Shelf on tablet computers for 6 weeks, whereas comparison students played the most downloaded and best reviewed preschool math apps on tablets for an equal amount of time. During game play, graduate student researchers supervised intervention and comparison students in separate rooms. Intervention and comparison groups did not differ on pretest assessments. Math Shelf students performed statistically significantly better (Cohen’s d = 0.57) than comparison students at posttest. Practice or Policy: Math Shelf results suggest that teachers can enhance low-income preschoolers’ mathematics knowledge in a relatively short amount of time by incorporating developmentally appropriate tablet interventions.     

The Effectiveness of a Large‐Scale Language and Preliteracy Intervention: The SPELL Randomized Controlled Trial in Denmark

The present article reports results of a real‐world effectiveness trial conducted in Denmark with six thousand four hundred eighty‐three 3‐ to 6‐year‐olds designed to improve children's language and preliteracy skills. Children in 144 child cares were assigned to a control condition or one of three planned variations of a 20‐week storybook‐based intervention: a base intervention and two enhanced versions featuring extended professional development for educators or a home‐based program for parents. Pre‐ to posttest comparisons revealed a significant impact of all three interventions for preliteracy skills (= .21–.27) but not language skills (d = .04–.16), with little differentiation among the three variations. Fidelity, indexed by number of lessons delivered, was a significant predictor of most outcomes. Implications for real‐world research and practice are considered.     

Monetary and Nonmonetary Student Incentives for Tutoring Services: A Randomized Controlled Trial

Abstract

In recent years, the largely punitive accountability measures imposed by the 2001 No Child Left Behind Act have given way to an emphasis on financial incentives. Although most policy interventions have focused primarily on linking teacher compensation to student test scores, several recent studies have examined the prospects for the use of financial incentives for students to improve student outcomes. This study builds on the existing literature by comparing student responses to monetary and nonmonetary (certificates of recognition) incentives to increase participation in federally funded supplemental educational services (SEdS). Approximately 300 eligible middle grade students who had signed up for SEdS were randomly selected and then assigned to either a control condition that received no incentive, a monetary reward group that could earn up to $100 for regular attendance, or a nonmonetary group that could receive a certificate of recognition signed by the district superintendent. Although the benefits of the monetary incentives were negligible, the students in the certificate group attended 42.5% more of their allotted tutoring hours than those assigned to control. The effect of the certificate was particularly strong for female students, who attended 26% more of their allocated tutoring hours compared to males who were also offered certificates. These results suggest the need for further research into the role of nonmonetary incentives in motivating student behaviors. Also, the findings could be useful to policymakers at the state or district level seeking cost-effective mechanisms to increase uptake of underutilized student supports.     

A Randomized Trial Study of a Preschool Literacy Curriculum: The Importance of Implementation

Abstract

In this 1-year experimental study of 254 students across 27 high-poverty preschool classrooms in an urban setting in the northeast, use of a technology-based prekindergarten literacy curriculum in addition to the district curriculum was compared with the use of the district curriculum alone. Results indicated no main effects for the experimental curriculum. Following the initial analyses, fidelity of implementation in the experimental classrooms was examined and results indicated that children in classrooms rated as having high fidelity of implementation significantly outperformed low-implementing classrooms on two important phonological awareness measures. This trend favoring high-implementing classrooms was also evident on measures of letter-name knowledge, and beginning sounds. These findings suggest that program implementation may be a significant variable when examining the potential effects of literacy curricula on learning outcomes for young at-risk children.     

国外突发性事件的心理危机干预模型研究

国外突发性事件的心理干预模式可分为三类：一是阶段划分性模式,即针对干预过程不同阶段的特点采取不同的措施;二是整合性模式,即将不同的干预模式、支持资源加以整合;三是特殊针对性模式,即针对特殊人群和情境的干预策略或特殊形式的组织形式。我国应借鉴国外的相关经验完善危机干预体系中的心理干预模式。     

Effects of Participation in After-School Programs for Middle School Students: A Randomized Trial

Abstract

This study assessed the effects of attending an after-school program (ASP) on a range of outcomes for middle school youths. The program operated for 9 hr per week for 30 weeks and included attendance monitoring and reinforcement, academic assistance, a prevention curriculum, and recreational programming. Participants were 447 students randomly assigned either to the ASP or to after-school activities as usual. Program attendance was sporadic. Although treatment students experienced increased exposure to ASPs relative to controls, nearly all youth in both groups reported participating in some organized activity during the after-school hours, and the number of different activities in which youths reported being involved did not differ across groups. Participation in the treatment reduced time spent with friends with no adults present during the after-school hours. No differences between treatment and control youths were found on measures of conduct problems, academic performance, school attendance, or any of the intermediate behaviors and attitudes targeted. The study replicates findings from the national evaluation of the 21st Century Community Learning Centers Program for middle school students using a more rigorous research design.