How clicker use facilitates existing pedagogical practices in higher education: data from interdisciplinary research on student response systems

This article identifies how clicker use can support or augment existing principles of good teaching across different disciplines in higher education. While many of these principles will be familiar to instructors, the link between student response system (SRS) use and existing pedagogical methods is still often unclear, even for scholars who are well read in the literature. Functioning as a resource for both novices and instructors who have already incorporated clickers into their courses, this article synthesizes existing literature and offers empirical data from five courses in three disciplines to show how SRSs can be used to support contemporary pedagogical goals. The authors discuss five exemplary practices, providing sample clicker questions along the way, to show how clickers can be used to facilitate active learning in large courses.     

Vibrant student voices: exploring effects of the use of clickers in large college courses

Teachers have begun using student response systems (SRSs) in an effort to enhance the learning process in higher education courses. Research providing detailed information about how interactive technologies affect students as they learn is crucial for professors who seek to improve teaching quality, attendance rates and student learning. This study investigates social, educational and emotional effects of the use of SRSs – clickers – at the University of Colorado at Boulder. Methods include participant observation, survey data from over 2000 students enrolled in three semesters of General Chemistry, and in‐depth interviews exploring the nature of student experiences with clickers. Findings suggest clickers significantly alter the social environment experienced by students as they learn. Clickers create learning environments characterized by greater activity, cooperation and conceptual application compared to traditional, lecture‐based instruction. Gender also influences whether students choose to work with peers during clicker‐prompted interaction. The qualitative analysis presented here extends upon themes identified in existing research on the effects of clickers for learning.     

Clickers in the flipped classroom: bring your own device (BYOD) to promote student learning

Flipped classrooms continue to grow in popularity across all levels of education. Following this pedagogical trend, the present study aimed to enhance the face-to-face instruction in flipped classrooms with the use of clickers. A game-like clicker application was implemented through a bring your own device (BYOD) model to gamify classroom dynamics in the spirit of question-and-answer competitions. A series of flipped learning lessons were created for the study, with clickers integrated into question-and-answer activities associated with each of the lessons as formative assessments to assist students in the learning of English as a foreign language. In this quasi-experimental research, the data were gathered using a summative assessment, a perception survey, and individual interviews. The collected data were then analyzed to compare the students’ flipped learning experiences, with or without clicker use. The results indicated that the gamified use of clickers had positive influences on student learning, with regard to their performance, perceptions, and preferences. This study thus suggests that the emerging generation of clicker technology allows for a cost-effective BYOD integration model in flipped classrooms, through which it is possible to seamlessly bridge pre-class and in-class activities and to effectively promote student learning.     

The use of clickers in Instrumentation and Control Engineering education: a case study

ABSTRACT

This paper presents results from a small-scale study of third-year Instrumentation and Control Engineering (n?=?37) at the University of Plymouth. The aim of the study was to enhance student learning and increase participation via the use of clickers. Clickers allow for student participation anonymously. The lecture content was modified to embed clicker questions at regular intervals to test knowledge, understanding and cognitive skills. Largely, the students preferred interactive lectures to traditional didactic lectures and using clickers increased student engagement and participation. Interestingly, compared to assessment results from the previous year, the increased level of engagement did seem to lead to an overall improvement in grades of approximately 10% in the subject of Control Engineering. However, in Instrumentation, the average fell by approximately 20%. One possible contributory factor of this drop could be the changed exam format for Instrumentation only. This year, the multiple choice section was removed from the Instrumentation examination paper. Furthermore, an analysis of variance showed that in addition to using clickers in the lectures, attendance plays a key role. Results of this small-scale study show that for a more complex subject like Control, student learning, engagement and attainment can increase by the use of clickers.     

Gender Differences in the Use and Effectiveness of Personal Response Devices

The use of personal response devices (or “clickers”) in the classroom has increased in recent years. While few quantitative studies on the effectiveness of clickers have been published, it is generally reported that clickers have been well-received by the students who use them. Two separate populations (Winter 2006 and Spring 2006) of engineering students were given clickers to use during a general chemistry class. Clicker use was compared to student grades for each course. During both terms, a higher percentage of female students than male students “actively participated” in the lectures, where active participation was defined as answering more than 75% of the clicker questions over the course of the term. Active male students earned final grades about 10 points higher than non-active male students. Active female students, however, scored only about 5 points higher than non-active female students. Student learning was assessed by comparing performance on exam questions and clicker questions with similar content. Students who answered clicker questions correctly were 11–13% more likely to answer the corresponding exam questions correctly than were students who did not answer the clicker question. In this paper, we demonstrate the effectiveness of clicker use in the classroom and examine gender differences associated with this use.     

Classroom Questioning with Immediate Electronic Response: Do Clickers Improve Learning?

A number of studies have focused on how students and instructors feel about digital learning technologies. This research is focused on the substantive difference in learning outcomes between traditional classrooms and classrooms using clickers. A randomized block experimental design involving four sections of undergraduate Operations Management classes was used to determine if clicker systems increase student learning of both quantitative and conceptual material in Operations Management. Learning was measured using the difference between the scores on an entrance examination and the final examination. The findings of this research provide evidence that the use of immediate feedback using a technology like clickers can have a positive impact on student learning as measured by test scores.     

What are Middle School Students Talking About During Clicker Questions? Characterizing Small-Group Conversations Mediated by Classroom Response Systems

There is a growing interest in using classroom response systems or clickers in science classrooms at both the university and K-12 levels. Typically, when instructors use this technology, students are asked to answer and discuss clicker questions with their peers. The existing literature on using clickers at the K-12 level has largely focused on the efficacy of clicker implementation, with few studies investigating collaboration and discourse among students. To expand on this work, we investigated the question: Does clicker use promote productive peer discussion among middle school science students? Specifically, we collected data from middle school students in a physical science course. Students were asked to answer a clicker question individually, discuss the question with their peers, answer the same question again, and then subsequently answer a new matched-pair question individually. We audio recorded the peer conversations to characterize the nature of the student discourse. To analyze these conversations, we used a grounded analysis approach and drew on literature about collaborative knowledge co-construction. The analysis of the conversations revealed that middle school students talked about science content and collaboratively discussed ideas. Furthermore, the majority of conversations, both ones that positively and negatively impacted student performance, contained evidence of collaborative knowledge co-construction.     

A Campus-Wide Investigation of Clicker Implementation: The Status of Peer Discussion in STEM Classes

At the University of Maine, middle and high school teachers observed more than 250 university science, technology, engineering, and mathematics classes and collected information on the nature of instruction, including how clickers were being used. Comparisons of classes taught with (n = 80) and without (n = 184) clickers show that, while instructional behaviors differ, the use of clickers alone does not significantly impact the time instructors spend lecturing. One possible explanation stems from the observation of three distinct modes of clicker use: peer discussion, in which students had the opportunity to talk with one another during clicker questions; individual thinking, in which no peer discussion was observed; and alternative collaboration, in which students had time for discussion, but it was not paired with clicker questions. Investigation of these modes revealed differences in the range of behaviors, the amount of time instructors lecture, and how challenging the clicker questions were to answer. Because instructors can vary their instructional style from one clicker question to the next, we also explored differences in how individual instructors incorporated peer discussion during clicker questions. These findings provide new insights into the range of clicker implementation at a campus-wide level and how such findings can be used to inform targeted professional development for faculty.     

Improving the integrated experience of in-class activities and fine-grained data collection for analysis in a blended learning class

Blended learning has steadily gained in popularity at the higher levels of education. This marks a change in pedagogical approaches from one-directional instruction to an interactive and technology-aided class. However, to manage fluent in-class activities and proper data analysis, real-time and fine-grained data collection activities are still needed. We propose an approach which provides rich information about student activities and automates processes which are time-consuming and which otherwise require extraneous effort. First, we implemented a program to collect real-time and fine-grained data and to provide an integrated experience during in-class activities. Second, we undertook a data analysis with the collected real-time, fine-grained data. Our blended learning is a type of flipped learning with personal response systems (PRSs) of the type commonly known as clickers. We used clickers for attendance, quizzes, and daily surveys, and collected the resulting data. Our outcome shows that the blended learning approach improves student achievement levels with a relatively small standard deviation compared to traditional classes. In addition, the present findings are factors related to student satisfaction and seat position, as analyzed from the data collected using the clickers.     

Students’ perceptions of clickers as an instructional tool to promote active learning

The purpose of this study was to evaluate students’ perceptions of clickers as an instructional tool to promote active learning in a Physical Geography undergraduate class. A convenience sample of 24 undergraduate students registered in a physical geography course was assigned clickers to answer chapter quizzes in class for 15 weeks during the semester. Data from student interviews, student surveys, and exam grades were used to analyze the findings. Overall, students were satisfied and gave high approval ratings for the use of clickers, particularly for enhancing their participation and engagement in class lectures. The study findings show that clickers promote student engagement in the teaching and learning process. However, students did not find clickers to be a motivating factor to study more for the course. The implications for the use of clickers as instructional tools to improve active teaching and learning in technology-rich classrooms are also discussed.     

Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes

What can be done to promote student–instructor interaction in a large lecture class? One approach is to use a personal response system (or “clickers”) in which students press a button on a hand-held remote control device corresponding to their answer to a multiple choice question projected on a screen, then see the class distribution of answers on a screen, and discuss the thinking that leads to the correct answer. Students scored significantly higher on the course exams in a college-level educational psychology class when they used clickers to answer 2 to 4 questions per lecture (clicker group), as compared to an identical class with in-class questions presented without clickers (no-clicker group, d = 0.38) or with no in-class questions (control group, d = 0.40). The clicker treatment produced a gain of approximately 1/3 of a grade point over the no-clicker and control groups, which did not differ significantly from each other. Results are consistent with the generative theory of learning, which predicts students in the clicker group are more cognitively engaged during learning.     

Assessing Multimedia Influences on Student Responses Using a Personal Response System

To date, research to date on personal response systems (clickers) has focused on external issues pertaining to the implementation of this technology or broadly measured student learning gains rather than investigating differences in the responses themselves. Multimedia learning makes use of both words and pictures, and research from cognitive psychology suggests that using both words and illustrations improves student learning. This study analyzed student response data from 561 students taking an introductory earth science course to determine whether including an illustration in a clicker question resulted in a higher percentage of correct responses than questions that did not include a corresponding illustration. Questions on topics pertaining to the solid earth were categorized as illustrated questions if they contained a picture, or graph and text-only if the question only contained text. For each type of question, we calculated the percentage of correct responses for each student and compared the results to student ACT-reading, math, and science scores. A within-groups, repeated measures analysis of covariance with instructor as the covariate yielded no significant differences between the percentage of correct responses to either the text-only or the illustrated questions. Similar non-significant differences were obtained when students were grouped into quartiles according to their ACT-reading, -math, and -science scores. These results suggest that the way in which a conceptest question is written does not affect student responses and supports the claim that conceptest questions are a valid formative assessment tool.     

Combining peer discussion with instructor explanation increases student learning from in-class concept questions

Use of in-class concept questions with clickers can transform an instructor-centered "transmissionist" environment to a more learner-centered constructivist classroom. To compare the effectiveness of three different approaches using clickers, pairs of similar questions were used to monitor student understanding in majors' and nonmajors' genetics courses. After answering the first question individually, students participated in peer discussion only, listened to an instructor explanation only, or engaged in peer discussion followed by instructor explanation, before answering a second question individually. Our results show that the combination of peer discussion followed by instructor explanation improved average student performance substantially when compared with either alone. When gains in learning were analyzed for three ability groups of students (weak, medium, and strong, based on overall clicker performance), all groups benefited most from the combination approach, suggesting that peer discussion and instructor explanation are synergistic in helping students. However, this analysis also revealed that, for the nonmajors, the gains of weak performers using the combination approach were only slightly better than their gains using instructor explanation alone. In contrast, the strong performers in both courses were not helped by the instructor-only approach, emphasizing the importance of peer discussion, even among top-performing students.     

Encouraging College Student Active Engagement in Learning: The Influence of Response Methods

The purpose of this study was to examine the use of two student response methods within selected college lecture halls. Kinesiology majors from three universities were asked to respond to questions during two consecutive lectures, one using “clickers” and the other using hand-raising. Participation and comprehension rates were statistically significantly different following the use of the different response methods. Participant survey responses revealed insight into student participation, question presentation, perceived cognitive engagement, and overall learning in traditional lecture settings using the response methods.     

Rapid Feedback Assessment Methods: Can We Improve Engagement and Preparation for Exams in Large-enrollment Courses?

Scratch-off immediate feedback assessment technique (IF-AT) forms and classroom response systems (clickers) can increase student engagement and interaction and help students prepare for exams by indicating the type and level of questions they will encounter. We used the IF-AT throughout the semester in three sections of a lower-division biology class; in two, students worked on IF-AT questions in small permanent groups, and in one, students alternated between IF-AT and clickers each week. At the end of the semester, students answered surveys about instant feedback techniques. Students appreciated prompt feedback on their understanding of course material, enjoyed the group interaction and opportunities to learn from each other, and continued to have positive perceptions of instant feedback activities and to take them seriously throughout the semester. While appreciating the versatility of clicker questions, we find that the ease of use, low cost, effectiveness, and improved classroom climate of the IF-AT method are particularly commendable.     

Useful interactive teaching tool for learning: clickers in higher education†

Many university lecturers are encouraged to implement innovative teaching tools and methodologies such as clickers in order to create an interactive learning environment and improve student learning, but its performance must be evaluated. The aim of this paper is to test empirically the impact of the use of clickers on students' learning processes. The teaching experience applied to the subject of Financial Accounting is specifically described. The total sample size is 77 students from a Business Administration and Economics Degree, taught in English and in Spanish. The analysis, using multivariate techniques, of the questionnaire responses, students' grades and a reflexive experience of the lecturer conclude that learning with clickers is effective. There is a positive relationship between grades and intrinsic motivation through clickers. Consequently, the students' marks are related to its intrinsic motivation, feedback to understanding, students' discussion and its negative aspects but not gender nor age.     

Using clickers in nonmajors- and majors-level biology courses: student opinion, learning, and long-term retention of course material

Student response systems (clickers) are viewed positively by students and instructors in numerous studies. Evidence that clickers enhance student learning is more variable. After becoming comfortable with the technology during fall 2005-spring 2006, we compared student opinion and student achievement in two different courses taught with clickers in fall 2006. One course was an introductory biology class for nonmajors, and the other course was a 200 level genetics class for biology majors. Students in both courses had positive opinions of the clickers, although we observed some interesting differences between the two groups of students. Student performance was significantly higher on exam questions covering material taught with clickers, although the differences were more dramatic for the nonmajors biology course than the genetics course. We also compared retention of information 4 mo after the course ended, and we saw increased retention of material taught with clickers for the nonmajors course, but not for the genetics course. We discuss the implications of our results in light of differences in how the two courses were taught and differences between science majors and nonmajors.     

Do we click in the right way? A meta-analytic review of clicker-integrated instruction

Clickers, formerly known as instant response systems, have gradually become an integral part of the classroom. Though several reviews on research into clicker-integrated instruction have been published within this decade, the controversy over whether clicker-integrated instruction is effective to enhance students' learning gains has not been settled because the early reviews mainly focus on students' perceptions toward and acceptance of clicker-integrated instruction. Furthermore, so far there is no consistent and clear framework to explain why the use of clickers is effective or ineffective to facilitate academic learning outcomes. Based on the literature from the 1970s to the early 2010s, this review article identifies and summarizes the theoretical aspects accounting for possible relations between clicker-integrated instruction and academic learning outcomes. The theoretical aspects are subsequently evaluated and expanded in reference to primary studies. The results suggest that the superior effect of clicker-integrated instruction, compared to conventional lectures, stands on firm empirical ground. In addition, engaging students in explaining and justifying their answers to clicker questions is highly recommended because such an instructional strategy is associated with positive and strong effect sizes on academic learning outcomes.     

Using clickers to facilitate development of problem-solving skills

Classroom response systems, or clickers, have become pedagogical staples of the undergraduate science curriculum at many universities. In this study, the effectiveness of clickers in promoting problem-solving skills in a genetics class was investigated. Students were presented with problems requiring application of concepts covered in lecture and were polled for the correct answer. A histogram of class responses was displayed, and students were encouraged to discuss the problem, which enabled them to better understand the correct answer. Students were then presented with a similar problem and were again polled. My results indicate that those students who were initially unable to solve the problem were then able to figure out how to solve similar types of problems through a combination of trial and error and class discussion. This was reflected in student performance on exams, where there was a statistically significant positive correlation between grades and the percentage of clicker questions answered. Interestingly, there was no clear correlation between exam grades and the percentage of clicker questions answered correctly. These results suggest that students who attempt to solve problems in class are better equipped to solve problems on exams.     

Student performance in computing education: an empirical analysis of online learning in programming education environments

The benefits of using online exercises have been analysed in terms of distance learning, automatic assessment and self-regulated learning. In this study, we have not found a direct proportional relationship between student performance in the course exercises that use online technologies and the exam grades. We see that the average submission rate to these online exercises is not positively correlated with the exercise points. Yet, our results confirm that doing exercises along supports student learning and skill accumulation equipping them with the knowledge of programming. While the student performance in programming courses is affected by factors such as prior background in programming, cognitive skills and the quality of teaching, completing the course exercises via learning-by-doing is an indispensable part of teaching. Based on the student feedback from the course survey, the students are highly satisfied with using online technologies as part of learning.