The Grass Isn’t Always Greener: Perceptions of and Performance on Open-Note Exams

Undergraduate biology education is often viewed as being focused on memorization rather than development of students’ critical-thinking abilities. We speculated that open-note testing would be an easily implemented change that would emphasize higher-order thinking. As open-note testing is not commonly used in the biological sciences and the literature on its effects in biology education is sparse, we performed a comprehensive analysis of this intervention on a primary literature–based exam across three large-enrollment laboratory courses. Although students believed open-note testing would impact exam scores, we found no effect on performance, either overall or on questions of nearly all Bloom’s levels. Open-note testing also produced no advantage when examined under a variety of parameters, including research experience, grade point average, course grade, prior exposure to primary literature–focused laboratory courses, or gender. Interestingly, we did observe small differences in open- and closed-note exam performance and perception for students who experienced open-note exams for an entire quarter. This implies that student preparation or in-test behavior can be altered by exposure to open-note testing conditions in a single course and that ­increased experience may be necessary to truly understand the impact of this intervention.     

Even after thirteen class exams,students are still overconfident: the role of memory for past exam performance in student predictions

Students often are overconfident when they predict their performance on classroom examinations, and their accuracy often does not improve across exams. One contributor to overconfidence may be that students did not have enough experience, and another is that students may under-use their knowledge of prior exam performance to predict performance on their upcoming exams. To evaluate the former, we examined student prediction accuracy across 13 exams in an introductory course on educational psychology. For the latter, we computed measures that estimate the extent to which students use the prior exam score when predicting performance and whether students should use the prior exam scores. Several outcomes are noteworthy. First, students were overconfident, and contrary to expectations, this overconfidence did not decline across exams. Second, students’ prior exam scores were not related to subsequent predictions, even though prior exam performance showed little bias with respect to predicting future performance. Thus, students appear to under-use prior performance despite its utility for improving prediction accuracy about future exam performance.     

Collaborative and Competitive Video Games for Teaching Computing in Higher Education

This study measures the success of using a collaborative and competitive video game, named Space Race, to teach computing to first year engineering students. Space Race is played by teams of four, each with their own tablet, collaborating to compete against the other teams in the class. The impact of the game on student learning was studied through measurements using 485 students, over one term. Surveys were used to gauge student reception of the game. Pre and post-tests, and in-course examinations were used to quantify student performance. The game was well received with at least 82% of the students that played it recommending it to others. In some cases, game participants outperformed non-participants on course exams. On the final course exam, all of the statistically significant (p<0.05) comparisons (42% of the relevant questions) showed a performance improvement of game participants on the questions, with a maximum grade improvement of 41%. The findings also suggest that some students retain the knowledge obtained from Space Race for at least 7 weeks. The results of this study provide strong evidence that a collaborative and competitive video game can be an effective tool for teaching computing in post-secondary education.     

College students' ratings of student effort,student ability and teacher input as correlates of student performance on multiple-choice exams

In the class session following feedback regarding their scores on multiple-choice exams, undergraduate students in a large human development course rated the strength of possible contributors to their exam performance. Students rated items related to their personal effort in preparing for the exam (identified as student effort in the paper), their ability to perform well on the exams (identified as student ability), and teacher input that might have affected their exam performance. Students rated most student effort items higher than teacher input and student ability items. Notwithstanding, across all exams, ratings of student ability and teacher input correlated more strongly with exam performance than did student effort ratings. High and low performers on the exams differed significantly on ratings of student ability and teacher input, but were more similar on ratings of student effort.     

The Impact of Exam Environments on Student Test Scores in Online Courses

While enrollment in online courses has tripled in ten years, little is known about the impact of different exam-taking environments on learning. A recent study of economics students found that online students taking un-proctored exams scored one letter grade higher than online students taking proctored exams. However, there were no apparent systematic safeguards against cheating in the un-proctored section. This study adds to the literature by comparing student’s performance in online classes with proctored exams to the performance of online students in a carefully controlled online testing environment (Respondus Lockdown Browser [RLB]). Methods: Data refer to 287 students enrolled in a criminology course at a Carnegie research-extensive university. The experimental group consisted of students in online sections who were called back to campus to take exams in a proctored environment. The control group took exams off campus using RLB. All sections were taught by the same instructor. The dependent variable is the score on the standardized final examination. The central independent variable is the type of exam environment: proctored vs. the RLB environment. Results: Controlling for other constructs, there was no significant difference between student exam scores in the proctored sections and the sections employing RLB. Conclusion: The results suggest that the judicious use of RLB can level the playing field between exam scores in proctored vs. nonproctored online sections. Technology such as RLB, which minimizes opportunities for cheating online, may provide tools for fairness in grading. Future work is needed for other courses, other fields, and other types of academic institutions.     

Undergraduate Students’ Preferences for Constructed Versus Multiple-Choice Assessment of Learning

Students (N = 161) in seven sections of an undergraduate educational psychology course rated ten performance-assessment options in collegiate courses. They rated in-class essay exams as their most preferred assessment and multiple-choice exams (in-class and out-of-class) as their least preferred. Also, student ratings of multiple papers and a term paper did not differ significantly from the rating for in-class essay exams. Overall, students preferred constructed forms of assessment over more objective assessment. With minor exceptions, student ratings of assessment preferences were generally consistent across gender and academic levels. In the main, student ratings of assessment options did not significantly correlate with exam performance in the course.     

Exploring Flipped Classroom Instruction in Calculus III

In an undergraduate Calculus III class, we explore the effect of “flipping” the instructional delivery of content on both student performance and student perceptions. Two instructors collaborated to determine daily lecture notes, assigned the same homework problems, and gave identical exams; however, compared to a more traditional instructional approach, the flipped instructor utilized videos to communicate more procedural course content to students out-of-class, with time in-class spent on more conceptual activities and homework problems. Findings from two semesters indicate similar performance on more procedural problems and small to moderate gains for the flipped students (N = 74) over their traditional counterparts (N = 77) on more conceptual exam problems. However, student perceptions remain mixed, with flipped students reporting increased communication during class but traditional students perceiving more effective use of class time, despite the gains in performance for flipped students.     

Increasing Student Success Using Online Quizzing in Introductory (Majors) Biology

Students often complain about their perceived disconnect between the time and effort spent studying and their subsequent performance on exams. Robert Bjork''s research asserts that retrieval of stored information acts as a memory modifier, and that using tests as learning events creates “desirable difficulties that enhance learning.” To determine the effect of utilizing testing as a learning event in the introductory (majors) biology classroom, we used an online homework platform to give required quizzes throughout the course. Analysis of exam grades earned by those taking 100% of pre-exam quizzes indicates that not only does this group have a significantly higher exam average than the group of students who took 0% of the pre-exam quizzes, but they also have a significantly higher exam average than the class average. Through detailed, statistical analysis, the benefit of quizzing is demonstrated to be significant for students of diverse academic abilities. Pre-exam quizzing using an online homework platform is an effective way to increase student performance on exams and allows class time to be utilized for teaching activities.     

Teaching to the Test…or Testing to Teach: Exams Requiring Higher Order Thinking Skills Encourage Greater Conceptual Understanding

In order to test the effect of exam-question level on fostering student conceptual understanding, low-level and high-level quizzes and exams were administered in two sections of an introductory biology course. Each section was taught in a high-level inquiry based style but was assigned either low-level questions (memory oriented) on the quizzes and exams, or high-level questions (application, evaluation, and analysis) on the quizzes and exams for the entirety of the semester. A final exam consisting of 20 low-level and 21 high-level questions was given to both sections. We considered several theoretical perspectives based on testing effect, test expectancy, and transfer-appropriate processing literature as well as the theoretical underpinnings of Bloom’s taxonomy. Reasoning from these theoretical perspectives, we predicted that high-level exams would encourage not only deeper processing of the information by students in preparation for the exam but also better memory for the core information (learned in the service of preparing for high-level questions). Results confirmed this prediction, with students in the high-level exam condition demonstrating higher performance on both the low-level final-exam items and the high-level final exam items. This pattern suggests that students who are tested throughout the semester with high-level questions acquire deep conceptual understanding of the material and better memory for the course information, and lends support to the proposed hierarchical nature of Bloom’s taxonomy.     

Short-term gain at long-term cost? How resit policy can affect student learning

Unlike many other high-stakes exams which test students only at the end of a course, the English A levels use a modular format where students are allowed to resit past units within the course. Since the introduction of resits for A levels in 2000, the A level results have been improving significantly and resits are seen as the main reason for the big increases. Using the findings of research based on the accounts of students and teaching staff, this article examines some of the less obvious effects of resits on student learning than that reflected by exam results in terms of students’ approach to learning. It concludes that allowing unlimited resits in high-stakes exams could produce some undesirable consequences for student learning and could be unfair and unfit for the purposes of the exam.     

Incorporation of continuous student assessment into lectures in engineering education

A continuous student assessment system was incorporated into an advanced microelectronic course. This study investigated the relationship between the continuous assessment system based on home exams and individual student achievement. The perspective was based on the learning frameworks of the social constructivist theory. Six fourth-year engineering students participated in the study, which covered 13 lectures and 5 home exams. Feedback sessions concerning the particular exam were held after every exam. Correlations between the exams, the feedback, and individual student achievement were computed. The results indicated a positive correlation between continuous assessment and student achievement. Rather than being improved a lot, student achievement stabilised statistically at a higher level. Additionally, student's absence was very low (5%) despite the voluntary participation in the course. Continuous assessment realised with home exams induced two-way discussions between the teacher and the students. Unprompted, the students learned additional material and discussed it in the exam essays, confirming the principles of social constructivist theory.     

Collaborative Testing Improves Performance but Not Content Retention in a Large-Enrollment Introductory Biology Class

Collaborative testing has been shown to improve performance but not always content retention. In this study, we investigated whether collaborative testing could improve both performance and content retention in a large, introductory biology course. Students were semirandomly divided into two groups based on their performances on exam 1. Each group contained equal numbers of students scoring in each grade category (“A”–“F”) on exam 1. All students completed each of the four exams of the semester as individuals. For exam 2, one group took the exam a second time in small groups immediately following the individually administered test. The other group followed this same format for exam 3. Individual and group exam scores were compared to determine differences in performance. All but exam 1 contained a subset of cumulative questions from the previous exam. Performances on the cumulative questions for exams 3 and 4 were compared for the two groups to determine whether there were significant differences in content retention. Even though group test scores were significantly higher than individual test scores, students who participated in collaborative testing performed no differently on cumulative questions than students who took the previous exam as individuals.     

Proctored Versus Unproctored Online Exams: Studying the Impact of Exam Environment on Student Performance

Increasing numbers of universities are offering courses in online and hybrid formats. One challenge in online assessment is the maintenance of academic integrity. We present a thorough statistical analysis to uncover differences in student performance when online exams are administered in a proctored environment (i.e., in class) versus an unproctored environment (i.e., offsite). Controlling for student grade point average (GPA), no significant differences in mean overall course performance or exam performance between the two groups were found, nor were there any differences in the mean vectors of individual exam scores. The study reveals that the group taking online exams in the unproctored environment has significantly more variation in their performance results. In examining potential causes of the greater variation, analyses were performed to assess whether an increased level of possible cheating behavior could be observed from performance results for students in the unproctored section. No evidence of cheating behavior was found.     

Students’ continuity norms in the university and exam calendar: do they affect university academic performance? / Normas de permanencia y calendario de exámenes: ¿afectan al rendimiento académico universitario?

Students’ academic performance is a key factor in evaluating the efficiency and quality of university degree programmes. Not only do personal characteristics and the students’ own performance affect these results, but so does the university’s academic organization. Based on a database that contains the overall results by course and exam period in three different degree programmes from 2007–15, we estimate what external factors influenced the percentages of students sitting for and passing exams. The analysis of the data panel shows that the order of the exams and the students’ continuity norms established by the university to penalize failing grades are two incentives that improve student performance only in the ordinary exam periods. These results also imply first keeping the incentive system at the university and secondly strategically using the exam calendar for the courses with the worst overall results.     

电大远程教育传统办学思路的课程考核弊端探究

课程考核是远程教育教学环节的重要组成部分,是检查教师执行教学情况和反映学生学习效果的重要手段,也是评定学生学习成绩的主要依据。我国电大远程教育课程考核目前主要存在两大问题：形成性考核形同虚设、终结性考核缺乏科学设计,这与电大系统长期以来固守的办学思路密不可分。电大远程教育课程考核首先应转变思路,改革考核方式。在形成性考核的改革方面应健全制度、规范管理、强化监督力度,在终结性考核的改革方面应努力构建考核方法灵活多样、题型丰富多彩、内容宽厚兼容的科学化的考核模式。     

Cognitive Test Anxiety and Academic Performance

A new measure that focused explicitly on the cognitive dimension of test anxiety was introduced and examined for psychometric quality as compared to existing measures of test anxiety. The new scale was found to be a reliable and valid measure of cognitive test anxiety. The impact of cognitive test anxiety as well as emotionality and test procrastination were subsequently evaluated on three course exams and students' self-reported performance on the Scholastic Aptitude Test for 168 undergraduate students. Higher levels of cognitive test anxiety were associated with significantly lower test scores on each of the three course examinations. High levels of cognitive test anxiety also were associated with significantly lower Scholastic Aptitude Test scores. Procrastination, in contrast, was related to performance only on the course final examination. Gender differences in cognitive test anxiety were documented, but those differences were not related to performance on the course exams. Examination of the relation between the emotionality component of test anxiety and performance revealed that moderate levels of physiological arousal generally were associated with higher exam performance. The results were consistent with cognitive appraisal and information processing models of test anxiety and support the conclusion that cognitive test anxiety exerts a significant stable and negative impact on academic performance measures.     

Assessing Assessment: The Effects of Two Exam Formats on Course Achievement and Evaluation

This research examines the effect of two testing strategies on academic achievement and summative evaluations in an introductory statistics course. In 2001, 63 students underwent an hourly midterm format; and in 2002, 68 students underwent a bi-weekly exam format. Other than the exam format, the class lectures and labs were identical in terms of content, structure, pace, and the cumulative final exam. Findings from the regression analyses show that students in the bi-weekly format performed better than the students in the hourly midterm format. On average, students who took the bi-weekly exams performed about 10 percentage points higher (one letter grade) on the exams during the semester and about 15 percentage points higher on the cumulative final exam compared to their peers who took hourly midterms. The benefits of the bi-weekly format were significantly greater among female students than male students. Finally, students in the bi-weekly format were less likely to drop the class and evaluated the class far more favorably. Carrie B. Myers is an Assistant Professor of Adult and Higher Education at Montana State University. She received her Ph.D. in Higher Education Administration from Washington State University. Her research focuses on student and faculty development and assessment and evaluation. Scott M. Myers is an Associate Professor of Sociology at Montana State University. His areas of research are family demography and education. He received a Ph.D. in Sociology and a Ph.D. in Demography from the Pennsylvania State University.     

Do clickers work for students with poorer grades and in harder courses?

We studied the impact of clickers, also known as electronic student response systems, on the performance of students on two undergraduate finance courses. Consistent with some of the recent literature, we found that clickers have very little impact on student performance, as measured by final course grades. Further, we found that clickers do not have a significant impact on course grades for students in relation to their designated performance ability (weak versus strong) or whether the course in question is less or more difficult. However, after simultaneously controlling for course difficulty and student aptitude, we found that clickers have a meaningfully positive impact on the performance of poorly performing students on more challenging quantitative courses. Our results suggest that the impact of clickers on student performance may depend on the type of student (academically weak, average or strong) and the type of course (average or difficult). This finding has particular implications for curriculum planners at the post-secondary level, although the findings may also have application at the secondary school level.     

High stakes testing and student perspectives on teaching and learning in the Republic of Ireland

There is now a well developed literature on the impact of high stakes testing on teaching approaches and student outcomes. However, the student perspective has been neglected in much research. This article draws on a mixed method longitudinal study of secondary students in the Republic of Ireland to explore the impact of two sets of high stakes examinations on student experiences. The analyses are based on surveys completed by 897 lower secondary students and 748 upper secondary students, along with 47 lower secondary and 53 upper secondary group interviews with students. Findings show the presence of impending high stakes exams results in increased workload for students, with many reporting pressure and stress. Throughout their schooling career, students clearly favour active learning approaches. However, for some students, particularly high-aspiring middle-class students, these views change as they approach the terminal high stakes exam, with many showing a strong preference for a more narrowly focussed approach to exam preparation. This article highlights how students shift from a position of critiquing exam-focused teaching methods as inauthentic to accepting such methods as representing ??good teaching??.     

Verbal Final Exam in Introductory Biology Yields Gains in Student Content Knowledge and Longitudinal Performance

We studied gains in student learning over eight semesters in which an introductory biology course curriculum was changed to include optional verbal final exams (VFs). Students could opt to demonstrate their mastery of course material via structured oral exams with the professor. In a quantitative assessment of cell biology content knowledge, students who passed the VF outscored their peers on the medical assessment test (MAT), an exam built with 40 Medical College Admissions Test (MCAT) questions (66.4% [n = 160] and 62% [n = 285], respectively; p < 0.001);. The higher-achieving students performed better on MCAT questions in all topic categories tested; the greatest gain occurred on the topic of cellular respiration. Because the VF focused on a conceptually parallel topic, photosynthesis, there may have been authentic knowledge transfer. In longitudinal tracking studies, passing the VF also correlated with higher performance in a range of upper-level science courses, with greatest significance in physiology, biochemistry, and organic chemistry. Participation had a wide range but not equal representation in academic standing, gender, and ethnicity. Yet students nearly unanimously (92%) valued the option. Our findings suggest oral exams at the introductory level may allow instructors to assess and aid students striving to achieve higher-level learning.