Making Research Methods Concepts Relevant for Students: An Illustrative Study on Low Self-control,Class Attendance,and Student Performance

Undergraduate students in criminology programs often contend that learning research methods is difficult in part because they struggle to see the relevance of the concepts addressed in such classes. The current study, utilizing original data collected from approximately 200 undergraduate students enrolled in a research methods course, focuses on a topic that is highly relevant for students?whether attending class mediates the effect of low self-control on student performance. The results show that while low self-control and class attendance each have direct effects on student performance, attendance does not mediate the effect of low self-control. In addition, the effect of low self-control on student performance varies according to the dimension of low self-control modeled, and the effect of class attendance on student performance is nonlinear. Closing discussion, in addition to describing implications and limitations of the study, highlights how the study encompasses several key research methods–related concepts.     

Reducing student procrastination in a personalized system of instruction course

This study examined the effects of three pacing procedures on student withdrawal rate, rate of progress, final examination performance, and attitude in a personalized system of instruction course. Undergraduate students (N = 100) who were enrolled in an introductory speech communication course were randomly assigned to either a reward, penalty, or control condition. Those students in the penalty group proceeded through the course at a more rapid pace than students in the control group. There were no significant differences in student withdrawal rate, final examination performance, and attitude. Final examination performance was not affected by the interaction between pacing procedures and student perception of locus of control. The benefits of reducing student procrastination, and appropriate means of doing so, are discussed in light of these results.     

The effects of passive and active learning on student preference and performance in an undergraduate basic science course

Active learning is based on self-directed and autonomous teaching methods, whereas passive learning is grounded in instructor taught lectures. An animal physiology course was studied over a two-year period (Year 1, n = 42 students; Year 2, n = 30 students) to determine the effects of student-led seminar (andragogical) and lecture (pedagogical) teaching methods on students' retention of information and performance. For each year of the study, the course was divided into two time periods. The first half was dedicated to instructor-led lectures, followed by a control survey in which the students rated the efficiency of pedagogical learning on a five-point Likert scale from one (strongly disagree) to five (strongly agree). During the second period, students engaged in andragogical learning via peer-led seminars. An experimental survey was then administered to students using the same scale as above to determine students' preferred teaching method. Raw examination scores and survey results from both halves of the course were statistically analyzed by ANOVA with Newman-Keuls multiple comparison test. By the end of the study, student preference for peer-led seminars increased [mean ± SD: (2.47 ± 0.94)/(4.03 ± 1.36), P < 0.04], and examination scores significantly increased [mean ± SD: (73.91% ± 13.18)/(85.77 ± 5.22), P < 0.001]. A majority of students (68.8%) preferred a method that contained peer-led seminars and instructor-led lectures. These results may indicate that integration of active and passive learning into undergraduate courses may have greater benefit in terms of student preference and performance than either method alone.     

Using continuous assessment to promote student engagement in a large class

The authors have developed a first-year fluids course for a class of around 230 aerospace, civil and mechanical engineering students. This paper aims to show how the teaching and assessment methodology was applied to the challenge of a large class. The lectures featured formal teaching interspersed with active learning elements. Smaller group (about 25–30 students) tutorial classes involved student practice. A 10-minute test occurred in each tutorial during weeks 3–11. Each test was based on the previous week's lecture material and the marks contributed towards 20% of the course mark. A condition for passing the course was that a student must pass at least six of the nine tests. The assessment promoted student involvement with the course – tutorial attendance was greater and more uniform than previously and exam performance improved significantly. Students recognised that the assessment system was useful in encouraging continuous learning over the semester and building confidence.     

Implementing the flipped classroom: an exploration of study behaviour and student performance

The flipped classroom is becoming more popular as a means to support student learning in higher education by requiring students to prepare before lectures and actively engaging students during lectures. While some research has been conducted into student performance in the flipped classroom, students’ study behaviour throughout a flipped course has not been investigated. This study explored students’ study behaviour throughout a flipped and a regular course by means of bi-weekly diaries. Furthermore, student references to their learning regulation were explored in course evaluations. Results from the diaries showed that students’ study behaviour in the flipped course did not appear to be very different from that of students in a regular course. Furthermore, study behaviour did not appear strongly related to student performance in both the flipped and the regular course. Exploration of student references to their learning regulation in the course evaluations showed that some students experienced the flipped course design as intended to support their learning process. Other students, however, demonstrated resistance to changing their study behaviour even though changing study behaviour is expected in order to benefit from the flipped classroom. Further research on the relationship between students’ learning regulation and actual study behaviour and course results is necessary to understand when and why implementing the flipped classroom is successful. Recommendations that may help more effective flipped classroom implementation include considering the prior history between students and instructor(s), the broader curriculum context, and frequent expectation communication especially with large numbers of students and non-mandatory lecture attendance.     

Supporting Student Learning through Instructional Videos in Business Statistics

While statistics is an essential topic for business students, many students experience barriers to successful learning due to anxiety, motivation, or difficulty with quantitative understanding. This research examines the use of online videos with an effort to explore the relationship between student characteristics, video usage, and course performance measures. In addition, the study examines student perceptions of the supplemental resources in an effort to examine the efficacy related to student learning and performance. This study seeks to confirm previous research regarding the benefit of supplemental video resources and extend the knowledge base by understanding the impact for various types of students (e.g., level of course, level of previous academic performance, etc.). The study found that the use of the video resources varies based on students’ previous math performance and the difficulty of the material. Student ratings indicate that the videos were helpful in learning the content and that they provided an important resource when students needed additional tools to master the material. Analysis of the results provides implications for understanding how different students use online videos and offers recommendations for educators and researchers about how to enhance student success in difficult statistics coursework.     

Effectiveness of Podcasts Delivered on Mobile Devices as a Support for Student Learning During General Chemistry Laboratories

Chemistry instructors in teaching laboratories provide expert modeling of techniques and cognitive processes and provide assistance to enrolled students that may be described as scaffolding interaction. Such student support is particularly essential in laboratories taught with an inquiry-based curriculum. In a teaching laboratory with a high instructor-to-student ratio, mobile devices can provide a platform for expert modeling and scaffolding during the laboratory sessions. This research study provides data collected on the effectiveness of podcasts delivered as needed in a first-semester general chemistry laboratory setting. Podcasts with audio and visual tracks covering essential laboratory techniques and central concepts that aid in experimental design or data processing were prepared and made available for students to access on an as-needed basis on iPhones^® or iPod touches^®. Research focused in three areas: the extent of podcast usage, the numbers and types of interactions between instructors and student laboratory teams, and student performance on graded assignments. Data analysis indicates that on average the podcast treatment laboratory teams accessed a podcast 2.86 times during the laboratory period during each week that podcasts were available. Comparison of interaction data for the lecture treatment laboratory teams and podcast treatment laboratory teams reveals that scaffolding interactions with instructors were statistically significantly fewer for teams that had podcast access rather than a pre-laboratory lecture. The implication of the results is that student laboratory teams were able to gather laboratory information more effectively when it was presented in an on-demand podcast format than in a pre-laboratory lecture format. Finally, statistical analysis of data on student performance on graded assignments indicates no significant differences between outcome measures for the treatment groups when compared as cohorts. The only statistically significant difference is between students who demonstrated a high level of class participation in the concurrent general chemistry lecture course; for this sub-group the students in the podcast treatment group earned a course average that was statistically significantly higher than those in the lecture treatment group.     

Implementing a Total Quality Management Approach in the Design, Delivery, and Redesign of a Statistical Process Control Course

ABSTRACT: The benefit of implementing total quality management(TQM)into university classrooms has been demonstrated. The objective of this work was to develop a TQM project to use as a teaching tool for TQM and statistical process control (SPC) concepts, an assessment tool for the course, and as a means for involving students in improving the course in progress. A plan-do-study-act (PDSA) assignment was developed to use SPC tools and the 4 concepts of TQM. The implementation of recommendations developed as part of the PDSA project significantly (p < 0.05) improved student performance on quizzes, student satisfaction with the course, student perception of instructor performance, as well as instructor satisfaction with the course.     

Application of cognitive apprenticeship model to a graduate course in performance systems analysis: A case study

This article reports a case study describing how the principles of a cognitive apprenticeship (CA) model developed by Collins, Brown, and Holum (1991) were applied to a graduate course on performance systems analysis (PSA), and the differences this application made in student performance and evaluation of the course compared to the previous semester. I analyzed the requirements for the CA learning environment and identified the contributions of instructor, students, and the course based on those requirments. I then applied the findings to create an authentic learning environment based on CA principles. In this case the students became performance consultants, immersed in practical application of the PSA content and methodology to authentic organizational performance issues provided by real clients. Finally, I compare student evaluation of the course to student evaluations in the previous semester, and report their responses to a set of open-ended questions concerning the application of CA principles.     

Assessment of the effects of student response systems on student learning and attitudes over a broad range of biology courses

With the advent of wireless technology, new tools are available that are intended to enhance students' learning and attitudes. To assess the effectiveness of wireless student response systems in the biology curriculum at New Mexico State University, a combined study of student attitudes and performance was undertaken. A survey of students in six biology courses showed that strong majorities of students had favorable overall impressions of the use of student response systems and also thought that the technology improved their interest in the course, attendance, and understanding of course content. Students in lower-division courses had more strongly positive overall impressions than did students in upper-division courses. To assess the effects of the response systems on student learning, the number of in-class questions was varied within each course throughout the semester. Students' performance was compared on exam questions derived from lectures with low, medium, or high numbers of in-class questions. Increased use of the response systems in lecture had a positive influence on students' performance on exam questions across all six biology courses. Students not only have favorable opinions about the use of student response systems, increased use of these systems increases student learning.     

Allowing course compensation in higher education: a latent class regression analysis to evaluate performance on a follow-up course

Abstract

In this study, the consequences of allowing course compensation in a higher education academic dismissal policy are evaluated by examining performance on a second-year follow-up (i.e. sequel) course that builds on material from a first-year precursor course. Up to now, differences in the consequences of compensation on student performance across groups of students who portray different unobserved study processes were not considered. In this study we used a latent class regression model to distinguish latent groups of students. Data from two undergraduate curricula were used and latent classes were formed based on similar patterns in averages, variability in grades, the number of compensated courses, and the number of retakes in the first year. Results show that students can be distinguished by three latent classes. Although the first-year precursor course is compensated in each of these latent classes, low performance on the precursor course results in low performance on the second-year sequel course for psychology students who belong to a class in which the average across first-year courses is low and the average number of compensated courses and retakes are high. For these students, compensation on a precursor course seems more likely to relate to insufficient performance on a sequel course.     

Identifying critical junctures in learning in a college course on evolution

The purpose of this research study was to (a) describe how concept mapping can be used as an integral instructional strategy for teaching a college course on evolution, (b) evaluate the utility of incorporating concept mapping in a college course on evolution, (c) determine whether students' concept maps reveal “critical junctures” in learning as the course unfolds, and (d) assess the impact of concept mapping on students' study practices and on students' understanding of course content. Key findings include: (a) Critical junctures in learning evolution can be identified by monitoring the degree of concordance of superordinate concepts appearing on the class set of concept maps submitted after each of the course lectures; (b) students who made concept maps reported spending an average of 37% more study time on this college biology course than on their previous biology courses; and (c) the use of “seed concepts,” “micromapping,” a standard concept map format, and a standard concept map checklist made the strategy feasible for the instructor to implement and for the student to adopt. A concept map performance index formulas was also developed for this research study in order to assess students' overall mapping performance.     

Energy and Energy Waste: a Topic for Science Education

The Science Foundation Programme (SFP) was launched in 1991 at the University of Natal, Pietermaritzburg, South Africa in an attempt to equip a selected number of matriculants from historically disadvantaged schools with the skills, resources and self-confidence needed to embark on their tertiary studies. Previous research within the SFP biology component suggests that a major contributor to poor achievement and low retention rates among English second language (ESL) students in the Life Sciences is the inadequate background knowledge in natural history. In this study, SFP student background knowledge was assessed along a continuum of language dependency using a set of three probes. Improved student performance in each of the respective assessments examined the extent to which a sound natural history background facilitated meaningful learning relative to ESL proficiency. Student profiles and attitudes to biology were also examined. Results indicated that students did not perceive language to be a problem in biology. However, analysis of the student performance in the assessment probes indicated that, although the marine course provided the students with the background knowledge that they were initially lacking, they continued to perform better in the drawing and MCQ tools in the post-tests, suggesting that it is their inability to express themselves in the written form that hampers their development. These results have implications for curriculum development within the constructivist framework of the SFP.     

Writing Across the Curriculum: A Hermeneutic Study of Students' Experiences in Writing in Food Science Education

ABSTRACT: Writing can enhance learning by helping students put words to their thinking about course material. The purposes of this study were to assess the influence of a structured academic journal writing exercise on student learning in a food science class and to examine student responses to the experience. Hermeneutics, a philosophy of science and qualitative research method, was used to analyze journal data from 48 participating students during a 2-y period and involved 3 steps: (1) describing themes taken from a global reading of student commentaries, (2) reducing or relating themes to specific, verbatim statements found in student writings, and (3) interpreting or imposing meaning on the themes and the statements (Lanigan 1988). Hermeneutic analysis showed that journal writing was difficult at first but became easier and enjoyable over time, allowed students to relate course content to other knowledge, exposed students to course material multiple times allowing for better information retention, enhanced student understanding, helped students think critically, required students to prepare for class, gave students the opportunity to express opinions, and allowed students to experience writing as enjoyable and positive. Several minor themes suggested that most students found the experience useful to their learning. Findings from this study are consistent with neuroscience and cognitive psychology theories regarding learning and the development of reasoning skills.     

A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience, and a case study

Hybrid learning, or blended learning, has become an interesting learning delivery method in recent years. Many universities have sought to develop their own hybrid learning courses as another option for students and instructors who prefer to replace some portion of traditional face-to-face meeting time with online instruction. This paper provides some pragmatic guidance for establishing hybrid learning courses in universities. The authors focus on the use of information technology, as well as the development and the design of the course content. The paper also illustrates a case study of hybrid learning courses at NJIT. The research results showed no significant difference between the performance of the students who took a course in hybrid mode versus the performance of those who took the identical course in distance learning mode. Some positive feedback in terms of perceived benefit from the hybrid course instruction and course materials was obtained from the students. The student learning styles were also investigated. The results demonstrated that the majority of students who participated in the hybrid learning course are active/sensing/sequential/visual learners. Most of them preferred visual presentations to verbal explanations. The research results also revealed the difference between learning styles of students with high performance, and those with low performance.     

Tool-use in a content management system: a matter of timing?

Given the rising popularity of content management systems (CMSs) in higher education, we investigated how students use the available CMS tools, as well as whether the moment of using a CMS tool affects students’ learning. This temporal dimension has been neglected in current research on CMS use. More insight into students’ tool-use is particularly important from an instructional design perspective because research has repeatedly revealed that a learning environments’ effectiveness depends heavily on students’ adaptive tool-use. Data were collected by logging the frequency and the time students (158) use the available tools within a CMS. Repeated-measures analyses revealed that students’ tool-use changed throughout the course, a dynamism that was different for each tool and was related to course-specific deadlines. Significant temporal student differences were found for some types of tools. Furthermore, students’ course performance was significantly impacted by the moment students used the course material outlines and the discussion board. In line with expectations, effects were different dependent on the tool. Hence, by examining students’ tool-use from a temporal perspective, this study highlighted that the timing of use matters. Furthermore, this timing depends on tool functionality. Consequently, the results have interesting implications for designing CMSs and they suggest implications for releasing some type of CMS tools at specific moments in the learning process.     

A blended model: simultaneously teaching a quantitative course traditionally,online, and remotely

As universities seek to bolster enrollment through distance education, faculty are tasked with maintaining comparable teaching/learning standards in traditional, blended, and online courses. Research has shown that there is an achievement gap between students taking courses exclusively offered online versus those enrolled in face-to-face classes. In an effort to mitigate these observed differences, the School of Business faculty at the research institution investigated various course models to meet the needs of a diverse, non-traditional, and multifaceted student population. Ultimately, a blended course model for statistics and quantitative method courses was developed that allowed students to choose between online, remote (via interactive television), and traditional course delivery modes each week. This model is more flexible and agile than existing blended courses that have more static components. Multiple regression analysis, χ², and t-tests are used to demonstrate the efficacy of our model in maintaining student performance standards.     

The effects of professional development on the attitudes,knowledge and skills for data-driven decision making

The Dutch government and School Inspectorate encourage schools to use the student performance data they can obtain from their student monitoring systems to maximize student performance in a systematic and goal-oriented way. Research by the same Inspectorate (Inspectie van het Onderwijs, 2010) shows that students in schools which do so outperform students in schools where data-driven decision making (DDDM) is as yet less developed. The University of Twente developed a training course in which school teams learn to utilize data from computerized student monitoring systems in order to improve instructional quality and student performance. Parallel to the training activities, training effects are studied. The research findings show that the training activities had a positive effect on school staff's DDDM knowledge and DDDM skills. Staff attitudes towards DDDM were already high on the pre-tests and remained high on the post-tests.     

Do clickers work for students with poorer grades and in harder courses?

We studied the impact of clickers, also known as electronic student response systems, on the performance of students on two undergraduate finance courses. Consistent with some of the recent literature, we found that clickers have very little impact on student performance, as measured by final course grades. Further, we found that clickers do not have a significant impact on course grades for students in relation to their designated performance ability (weak versus strong) or whether the course in question is less or more difficult. However, after simultaneously controlling for course difficulty and student aptitude, we found that clickers have a meaningfully positive impact on the performance of poorly performing students on more challenging quantitative courses. Our results suggest that the impact of clickers on student performance may depend on the type of student (academically weak, average or strong) and the type of course (average or difficult). This finding has particular implications for curriculum planners at the post-secondary level, although the findings may also have application at the secondary school level.     

Flipping the classroom and instructional technology integration in a college-level information systems spreadsheet course

The purpose of this research was to explore how technology can be used to teach technological skills and to determine what benefit flipping the classroom might have for students taking an introductory-level college course on spreadsheets in terms of student achievement and satisfaction with the class. A pretest posttest quasi-experimental mixed methods design was utilized to determine any differences in student achievement that might be associated with the instructional approach being used. In addition, the scalability of each approach was evaluated along with students’ perceptions of these approaches to determine the affect each intervention might have on a student’s motivation to learn. The simulation-based instruction tested in this study was found to be an extremely scalable solution but less effective than the regular classroom and flipped classroom approaches in terms of student learning. While students did demonstrate learning gains, the process focus of the simulation’s instruction and assessments frustrated students and decreased their motivation to learn. Students’ attitudes towards the topic, their willingness to refer the course to others, and the likelihood that they would take another course like this were considerably lower than those of students in the flipped or regular classroom situations. The results of this study support the conclusion that a technology enhanced flipped classroom was both effective and scalable; it better facilitated learning than the simulation-based training and students found this approach to be more motivating in that it allowed for greater differentiation of instruction.