Students’ perceptions of clickers as an instructional tool to promote active learning

The purpose of this study was to evaluate students’ perceptions of clickers as an instructional tool to promote active learning in a Physical Geography undergraduate class. A convenience sample of 24 undergraduate students registered in a physical geography course was assigned clickers to answer chapter quizzes in class for 15 weeks during the semester. Data from student interviews, student surveys, and exam grades were used to analyze the findings. Overall, students were satisfied and gave high approval ratings for the use of clickers, particularly for enhancing their participation and engagement in class lectures. The study findings show that clickers promote student engagement in the teaching and learning process. However, students did not find clickers to be a motivating factor to study more for the course. The implications for the use of clickers as instructional tools to improve active teaching and learning in technology-rich classrooms are also discussed.     

Example of good practice of a learning environment with a classroom response system in a mechanical engineering bachelor course

Results of a successful pilot study are presented, in which quizzes are introduced in a second year bachelor course for mechanical engineering students. The pilot study course entailed the basic concepts of mechanical vibrations in complex, realistic structures. The quiz is held weekly using a SharePoint application. The purpose of the quizzes is to repeat important course material, give instantaneous feedback (i.e. formative assessment), stimulate peer instruction and, as a consequence, increase the students’ comprehension of the basic concepts taught in the course so that their deeper understanding of the subject matter improves. Students can earn half a point bonus, on a scale from 0 to 10, on top of their exam mark if they correctly answer 55% of all the quiz questions. The efficacy of the pilot study is determined by investigating the percentage of students that pass the course on their first attempt, i.e. the first time pass rate, and asking students for feedback through questionnaires. The first time pass rate of the students in the pilot study groups has, on average, increased significantly in comparison to groups in which the quizzes are not performed. Students indicated that the feedback from the quizzes helps them to identify gaps in their knowledge. Therefore, the pilot study is considered effective.     

Rapid Feedback Assessment Methods: Can We Improve Engagement and Preparation for Exams in Large-enrollment Courses?

Scratch-off immediate feedback assessment technique (IF-AT) forms and classroom response systems (clickers) can increase student engagement and interaction and help students prepare for exams by indicating the type and level of questions they will encounter. We used the IF-AT throughout the semester in three sections of a lower-division biology class; in two, students worked on IF-AT questions in small permanent groups, and in one, students alternated between IF-AT and clickers each week. At the end of the semester, students answered surveys about instant feedback techniques. Students appreciated prompt feedback on their understanding of course material, enjoyed the group interaction and opportunities to learn from each other, and continued to have positive perceptions of instant feedback activities and to take them seriously throughout the semester. While appreciating the versatility of clicker questions, we find that the ease of use, low cost, effectiveness, and improved classroom climate of the IF-AT method are particularly commendable.     

The benefits of using clickers in small-enrollment seminar-style biology courses

Although the use of clickers and peer discussion is becoming common in large-lecture undergraduate biology courses, their use is limited in small-enrollment seminar-style courses. To investigate whether facilitating peer discussion with clickers would add value to a small-enrollment seminar-style course, we evaluated their usefulness in an 11-student Embryology course at the University of Colorado, Boulder. Student performance data, observations of peer discussion, and interviews with students revealed that adding clickers to a small-enrollment course 1) increases the chance students will do the required reading before class, 2) helps the instructor engage all students in the class, and 3) gives students a focused opportunity to share thinking and to learn from their peers.     

Using clickers in nonmajors- and majors-level biology courses: student opinion, learning, and long-term retention of course material

Student response systems (clickers) are viewed positively by students and instructors in numerous studies. Evidence that clickers enhance student learning is more variable. After becoming comfortable with the technology during fall 2005-spring 2006, we compared student opinion and student achievement in two different courses taught with clickers in fall 2006. One course was an introductory biology class for nonmajors, and the other course was a 200 level genetics class for biology majors. Students in both courses had positive opinions of the clickers, although we observed some interesting differences between the two groups of students. Student performance was significantly higher on exam questions covering material taught with clickers, although the differences were more dramatic for the nonmajors biology course than the genetics course. We also compared retention of information 4 mo after the course ended, and we saw increased retention of material taught with clickers for the nonmajors course, but not for the genetics course. We discuss the implications of our results in light of differences in how the two courses were taught and differences between science majors and nonmajors.     

Sustaining learning through assessment: an evaluation of the value of a weekly class quiz

Commencing each class session with a class quiz, which emphasizes the previous week’s work and is supported by immediate feedback, encourages students to revise their notes ahead of the session, undertake more reading and keep pace with course progression. It reduces the necessity for any spoken review of the previous week’s work, provides guidance on the status of current student learning, and creates a knowledge platform upon which deeper learning may be constructed. When pitched at an accessible level, regular class quizzes are popular with students because they reinforce student engagement with the course and provide immediate positive feedback and reward. In this case study, quiz results correlate significantly with many other forms of assessment, especially those that require immediate individual knowledge such as examinations, learning journals and spoken presentations. They do not correlate so strongly with assessments based on teamwork or deductive exploration such as problem‐based laboratory study or self‐directed field trails. Class quizzes and formal examinations, alone of the assessment strategies compared in this study, are associated with significantly higher marks from female students. It is recommended that the technique is used as part of a diversified assessment strategy.     

The Effect of Clickers in University Science Courses

In four studies on the use of student response systems, clickers, we sought to understand whether the use of clickers would impact students’ attitudes toward the use of technology for instruction and achievement on examinations. While the results varied some by study, overall, the results revealed no significant changes in the already positive student attitude toward the use of instructional technology. In all four studies, the majority of the students reported that they learned more when clickers were used in class. The use of clickers did not serve as useful predictor of student achievement in science classes. The findings of this study are similar to others which suggest that some classroom technologies (like clickers) may not necessarily have a direct connection with student achievement, despite positive student feedback regarding their experience using these technologies. Further studies are needed to better understand the true nature of the relationship between these technologies and classroom outcomes.     

Use of an audience response system during peer teaching among physical therapy students in human gross anatomy: Perceptions of peer teachers and students

An audience response system (ARS) has become popular among educators in medicine and the health professions because of the system's ability to engage listeners during a lecture presentation. No one has described the usefulness of ARS technology during planned nonlecture peer teaching sessions in gross anatomy instruction for health professionals. The unique feature of each peer teaching session was a nongraded 12–15 item ARS quiz assembled by six second‐year doctor of physical therapy (DPT) students and purposely placed at the beginning of the review session for those first‐year DPT students in attendance. This study used a ten‐item questionnaire and a five‐point Likert scale in addition to three open ended questions to survey perceptions of both first‐year and second‐year DPT students about the usefulness of ARS technology implemented during weekly interactive peer teaching sessions during a semester course in Anatomy for Physical Therapists. First‐year students overwhelmingly acknowledged the ARS system permitted each student to self‐assess his/her preparedness for a quiz or examination and compare his/her performance with that of classmates. Peer teachers recognized an ARS quiz provided them an opportunity to: (1) estimate first‐year students' level of understanding of anatomical concepts; and (2) effectively prepare first‐year students for their weekly quizzes and future examinations. On the basis of the mutual benefits derived by both students/tutees and teachers/tutors, physical therapist educators may wish to consider using ARS technology to enhance teaching methods for a class in gross human anatomy. Anat Sci Educ 2: 286–293, 2009. © 2009 American Association of Anatomists.     

A review of the characteristics of intermediate assessment and their relationship with student grades

In-course assessment, such as midterms, quizzes or presentations, is often an integral part of higher education courses. These so-called intermediate assessments influence students’ final grades. The current review investigates which characteristics of intermediate assessment relate to these grades. In total, 88 articles were reviewed that examined the relationship between intermediate assessment and student grades. Four main characteristics were identified: the use of feedback, whether the assessment is mandatory, who is the assessor, and the reward students get for participating. Results indicate that corrective feedback leads to the most positive results, but elaborate feedback may benefit lower achieving groups. No difference in results was found for mandatory versus voluntary intermediate assessments. Peer assessment seemed to be beneficial, and rewarding students with course credit improves grades more than other rewards. Three scenarios are presented on how teachers can combine the different characteristics to optimise their intermediate assessment.     

Do clickers work for students with poorer grades and in harder courses?

We studied the impact of clickers, also known as electronic student response systems, on the performance of students on two undergraduate finance courses. Consistent with some of the recent literature, we found that clickers have very little impact on student performance, as measured by final course grades. Further, we found that clickers do not have a significant impact on course grades for students in relation to their designated performance ability (weak versus strong) or whether the course in question is less or more difficult. However, after simultaneously controlling for course difficulty and student aptitude, we found that clickers have a meaningfully positive impact on the performance of poorly performing students on more challenging quantitative courses. Our results suggest that the impact of clickers on student performance may depend on the type of student (academically weak, average or strong) and the type of course (average or difficult). This finding has particular implications for curriculum planners at the post-secondary level, although the findings may also have application at the secondary school level.     

Testing to enhance retention in human anatomy

Recent work in cognitive psychology has shown that repeatedly testing one's knowledge is a powerful learning aid and provides substantial benefits for retention of the material. To apply this in a human anatomy course for medical students, 39 fill-in-the-blank quizzes of about 50 questions each, one for each region of the body, and four about the nervous system, were developed. The quizzes were optional, and no credit was awarded. They were posted online using Blackboard, which provided feedback, and they were very popular. To determine whether the quizzes had any effect on retention, they were given in a controlled setting to 21 future medical and dental students. The weekly quizzes included questions on regional anatomy and an expanded set of questions on the nervous system. Each question about the nervous system was given three times, in a slightly different form each time. The second quiz was given approximately half an hour after the first one, and the third was given one week after the second to assess retention. The quizzes were unpopular, but students showed robust improvement on the questions about the nervous system. The scores increased by almost 9% on the second quiz, with no intervention except viewing the correct answers. The scores were 29% higher on the third quiz than on the first, and there was also a positive correlation between the grades on the quizzes and the final examination. Thus, repeated testing is an effective strategy for learning and retaining information about human anatomy.     

Increased course structure improves performance in introductory biology

We tested the hypothesis that highly structured course designs, which implement reading quizzes and/or extensive in-class active-learning activities and weekly practice exams, can lower failure rates in an introductory biology course for majors, compared with low-structure course designs that are based on lecturing and a few high-risk assessments. We controlled for 1) instructor effects by analyzing data from quarters when the same instructor taught the course, 2) exam equivalence with new assessments called the Weighted Bloom's Index and Predicted Exam Score, and 3) student equivalence using a regression-based Predicted Grade. We also tested the hypothesis that points from reading quizzes, clicker questions, and other "practice" assessments in highly structured courses inflate grades and confound comparisons with low-structure course designs. We found no evidence that points from active-learning exercises inflate grades or reduce the impact of exams on final grades. When we controlled for variation in student ability, failure rates were lower in a moderately structured course design and were dramatically lower in a highly structured course design. This result supports the hypothesis that active-learning exercises can make students more skilled learners and help bridge the gap between poorly prepared students and their better-prepared peers.     

Improved Academic Performance and Student Perceptions of Learning Through Use of a Cell Phone‐Based Personal Response System

Personal response systems, such as clickers, have been widely used to improve the effectiveness of teaching in various classroom settings. Although hand‐held clicker response systems have been the subject of multiple prior studies, few studies have focused on the use of cell phone‐based personal response system (CPPRS) specifically. This study explores students’ academic performance and their perceptions of learning through the use of a CPPRS (TopHat) in an undergraduate Food Science class. In this study, students did not use the CPPRS during the first half of the semester‐long course, but did during the second half. When CPPRS was used, students responded to 2 multiple‐choice questions at 3 points during the class, (a) at the beginning of class, (b) in the middle of the class, and (c) at the end of the class. Student performance was measured by correctness rates on eight 10‐item multiple choice quizzes, 4 quizzes each covering the class content that was delivered with compared with without CPPRS. A survey was conducted at the end of the semester asking (n = 28) students’ perceptions of CPPRS. The average correctness rate for quizzes covering content delivered with CPPRS (85% ± 9%) was significantly higher than for content delivered without CPPRS (82% ± 10%) (P = 0.016). In addition, students perceived that CPPRS was easy to use (5.04 ± 0.58 on a 1 to 6 scale with 1 being strongly disagree and 6 being strongly agree) and positively impacted their learning (4.52 ± 0.99 using the same scale). When used correctly, CPPRS can facilitate student learning in lectures.     

The influence of flow on learning outcomes: An empirical study on the use of clickers

Flow is a state of total absorption and concentration in an activity that is desirable for students, as it enhances the learning experience. Due to the importance of flow for learning, this research investigates the influence of three flow preconditions—namely balance of skill and challenge, feedback and goal clarity—on students' flow, operationalized as heightened concentration, sense of control and autotelic experience, while using clickers—a type of polling device. The study also explores the impact of concentration, sense of control and autotelic experience on students' perceived learning and satisfaction. Based on a survey of 204 undergraduate students who use clickers in the classroom, the findings show that balance of skill and challenge has a positive influence on students' concentration, sense of control and autotelic experience. Both feedback provided by clickers and goal clarity have a positive influence on concentration and sense of control, but do not influence the autotelic experience. Findings also corroborate the positive impact of concentration and sense of control experienced by students on perceived learning. Finally, autotelic experience predicts both perceived learning and satisfaction.     

An audience response system may influence student performance on anatomy examination questions

This study integrated an in-house audience response system (ARS) in the human anatomy course over two years to determine whether students performed better on high-stakes examinations following exposure to similar interactive questions in a large lecture format. Questions in an interactive ARS format were presented in lectures via PowerPoint presentations. Students who chose to participate in the anonymous ARS sessions submitted answers via their personal wireless devices (e.g., laptops, smartphones, PDAs, etc). Students were surveyed for feedback. Student participation in ARS activities was greatest (65-80%) in the first lecture. The number of students who actively participated in ARS activities decreased over the next four sessions, and then slightly increased in the last two sessions. This trend was the same for both years. Use of the ARS did not dramatically enhance overall student performance on examination questions that dealt with content similar to content presented in the ARS sessions. However, students who scored in the lower quartile of the examination performed better on the examination questions after the ARS was implemented. Accordingly, our findings suggest that the effect of ARS to improve student performance on examinations was not uniform. The overall benefit of an ARS to enhance the lecture experience was confirmed by student surveys.     

Does Displaying the Class Results Affect Student Discussion during Peer Instruction?

The use of personal response systems, or clickers, is increasingly common in college classrooms. Although clickers can increase student engagement and discussion, their benefits also can be overstated. A common practice is to ask the class a question, display the responses, allow the students to discuss the question, and then collect the responses a second time. In an introductory biology course, we asked whether showing students the class responses to a question biased their second response. Some sections of the course displayed a bar graph of the student responses and others served as a control group in which discussion occurred without seeing the most common answer chosen by the class. If students saw the bar graph, they were 30% more likely to switch from a less common to the most common response. This trend was more pronounced in true/false questions (38%) than multiple-choice questions (28%). These results suggest that observing the most common response can bias a student''s second vote on a question and may be misinterpreted as an increase in performance due to student discussion alone.     

Articulating Scientific Reasoning Improves Student Learning in an Undergraduate Anatomy and Physiology Course

In many life science classrooms, instructors rely upon lecture presentations to efficiently present course content. Students, in this case, act as passive learners with little opportunity to test their knowledge for gaps or misconceptions. The goal of the project described here was to determine whether a collaborative quiz protocol that guided students to discuss their understanding with their peers would improve learning and academic performance. The project took place during a single semester and was composed of two studies: a preliminary study that incorporated short-answer quizzes into the curriculum and a comprehensive study that incorporated short-answer quizzes and justify/explain quizzes in which students were expected to select an answer and then justify or explain it. Students took all quizzes twice, first independently and then collaboratively with classmate(s). Learning was assessed using multiple-choice exam questions based upon quiz topics. Students scored significantly higher on exam questions associated with justify/explain quiz topics than on those associated with short-answer quiz topics.     

Classroom Questioning with Immediate Electronic Response: Do Clickers Improve Learning?

A number of studies have focused on how students and instructors feel about digital learning technologies. This research is focused on the substantive difference in learning outcomes between traditional classrooms and classrooms using clickers. A randomized block experimental design involving four sections of undergraduate Operations Management classes was used to determine if clicker systems increase student learning of both quantitative and conceptual material in Operations Management. Learning was measured using the difference between the scores on an entrance examination and the final examination. The findings of this research provide evidence that the use of immediate feedback using a technology like clickers can have a positive impact on student learning as measured by test scores.     

关于部分高一学生对测验与考试态度的调查

在对220名来自广东省和广西壮族自治区的高一学生问卷调查中，获得了这两个地区部分高一学生对目前的考试制度的认识。发现高一年级的学生对目前的考试制度非常不满，主要表现在以下三个方面：一是认为考试次数太多，试题太难；二是考查内容过于狭隘，不能体现学生的真实的、全面的情况；三是考试成绩的呈现方式不够人性化。此外，不同地区和不同性别的学生对考试次数和内容的态度有明显的差异。     

Improving the integrated experience of in-class activities and fine-grained data collection for analysis in a blended learning class

Blended learning has steadily gained in popularity at the higher levels of education. This marks a change in pedagogical approaches from one-directional instruction to an interactive and technology-aided class. However, to manage fluent in-class activities and proper data analysis, real-time and fine-grained data collection activities are still needed. We propose an approach which provides rich information about student activities and automates processes which are time-consuming and which otherwise require extraneous effort. First, we implemented a program to collect real-time and fine-grained data and to provide an integrated experience during in-class activities. Second, we undertook a data analysis with the collected real-time, fine-grained data. Our blended learning is a type of flipped learning with personal response systems (PRSs) of the type commonly known as clickers. We used clickers for attendance, quizzes, and daily surveys, and collected the resulting data. Our outcome shows that the blended learning approach improves student achievement levels with a relatively small standard deviation compared to traditional classes. In addition, the present findings are factors related to student satisfaction and seat position, as analyzed from the data collected using the clickers.