Reduced performance on examinations following untimed short assessments

The internet has allowed for the online asynchronous assessment of acquired knowledge; however, the delivery formats of these online assessments do require evaluation. To this end, the summative examination and preceding formative quiz performances of students enrolled in a freshman-level course were evaluated between four cohorts in which each cohort was administered formative quizzes differing in testing location (in-class versus online), time limitation and ability to use notes. Results indicate decreased monitoring of formative quizzes such as those that are untimed and delivered online leads to increased formative performance but decreased performance on proceeding summative examinations. While the use of online testing may appear enticing, care must be taken to ensure student learning.     

Example of good practice of a learning environment with a classroom response system in a mechanical engineering bachelor course

Results of a successful pilot study are presented, in which quizzes are introduced in a second year bachelor course for mechanical engineering students. The pilot study course entailed the basic concepts of mechanical vibrations in complex, realistic structures. The quiz is held weekly using a SharePoint application. The purpose of the quizzes is to repeat important course material, give instantaneous feedback (i.e. formative assessment), stimulate peer instruction and, as a consequence, increase the students’ comprehension of the basic concepts taught in the course so that their deeper understanding of the subject matter improves. Students can earn half a point bonus, on a scale from 0 to 10, on top of their exam mark if they correctly answer 55% of all the quiz questions. The efficacy of the pilot study is determined by investigating the percentage of students that pass the course on their first attempt, i.e. the first time pass rate, and asking students for feedback through questionnaires. The first time pass rate of the students in the pilot study groups has, on average, increased significantly in comparison to groups in which the quizzes are not performed. Students indicated that the feedback from the quizzes helps them to identify gaps in their knowledge. Therefore, the pilot study is considered effective.     

Testing to enhance retention in human anatomy

Recent work in cognitive psychology has shown that repeatedly testing one's knowledge is a powerful learning aid and provides substantial benefits for retention of the material. To apply this in a human anatomy course for medical students, 39 fill-in-the-blank quizzes of about 50 questions each, one for each region of the body, and four about the nervous system, were developed. The quizzes were optional, and no credit was awarded. They were posted online using Blackboard, which provided feedback, and they were very popular. To determine whether the quizzes had any effect on retention, they were given in a controlled setting to 21 future medical and dental students. The weekly quizzes included questions on regional anatomy and an expanded set of questions on the nervous system. Each question about the nervous system was given three times, in a slightly different form each time. The second quiz was given approximately half an hour after the first one, and the third was given one week after the second to assess retention. The quizzes were unpopular, but students showed robust improvement on the questions about the nervous system. The scores increased by almost 9% on the second quiz, with no intervention except viewing the correct answers. The scores were 29% higher on the third quiz than on the first, and there was also a positive correlation between the grades on the quizzes and the final examination. Thus, repeated testing is an effective strategy for learning and retaining information about human anatomy.     

关于部分高一学生对测验与考试态度的调查

在对220名来自广东省和广西壮族自治区的高一学生问卷调查中，获得了这两个地区部分高一学生对目前的考试制度的认识。发现高一年级的学生对目前的考试制度非常不满，主要表现在以下三个方面：一是认为考试次数太多，试题太难；二是考查内容过于狭隘，不能体现学生的真实的、全面的情况；三是考试成绩的呈现方式不够人性化。此外，不同地区和不同性别的学生对考试次数和内容的态度有明显的差异。     

Quizzes Used in Oral English Assessment in EFL

In order to find out the best way to assess students’ oral achievement and to see if quiz can be used as a valid measurement of oral ability,we conducted an experiment.Quizzes were given to students each week.The results of final exam and that of quizzes were compared to see if there is discrepancy between the two.The results of our experiment showed a high correlation between students’ quiz scores and exam scores.The class teacher can very well predict how a student will perform in the final exam.A way to assess students’ oral achievement is also suggested.     

The Effect of Team‐Based Learning on Student Attitudes and Satisfaction

We examined student attitudes toward a team‐based learning method known as the readiness assurance process encompassing team exams to model how student satisfaction is initially shaped and subsequently changed over time as a function of scholastic performance and perceived development of professional skills (PS). We found that students were generally positively disposed toward the learning method and recognized its benefits in terms of developing teamwork skills. A regression analysis of student responses to an instrument distributed directly after each of four quizzes given over the course of a semester leads to the inferences that satisfaction with the method depends minimally upon the immediate feedback provided by student performance on a quiz and more critically upon student perceptions of how it has enhanced their PS. There is also shown to be a strong carryover effect in satisfaction with the method in successive uses. The results suggest that student attitudes are shaped by multiple, high‐level goals, and not just scholastic performance. The study also evidences the need to study learning interventions over multiple uses rather than through a one‐shot design.     

Time pressure in scenario-based online construction safety quizzes and its effect on students’ performance

Online quizzes have been shown to be effective learning and assessment approaches. However, if scenario-based online construction safety quizzes do not include time pressure similar to real-world situations, they reflect situations too ideally. The purpose of this paper is to compare engineering students’ performance when carrying out an online construction safety quiz with time pressure versus an online construction safety quiz without time pressure. Two versions of an online construction safety quiz are developed and administered to randomly assigned engineering students based on a quasi-experimental post-test design. The findings contribute to scenario-based learning and assessment of construction safety in four ways. First, the results confirm earlier findings that ‘intrinsic stress’ does not seem to impair students’ performance. Second, students who carry out the online construction safety quiz with time pressure are less likely to ‘learn by trial and error'. Third, students exposed to time pressure appreciate that they become better prepared for real life. Finally, preparing students to work under time pressure is an important industry requirement. The results of this study should encourage engineering educators to explore and implement ways to include time pressure in scenario-based online quizzes and learning.     

The Value of Applied Research: Retrieval Practice Improves Classroom Learning and Recommendations from a Teacher, a Principal, and a Scientist

Over the course of a 5-year applied research project with more than 1,400 middle school students, evidence from a number of studies revealed that retrieval practice in authentic classroom settings improves long-term learning (Agarwal et al. 2009; McDaniel et al., Journal of Educational Psychology 103:399–414, 2011; McDaniel et al. 2012; Roediger et al., Journal of Experimental Psychology: Applied 17:382–395, 2011a). Retrieval practice, or the use of quizzes and exams to engage and enhance retrieval processes, has been widely established as an effective strategy for facilitating learning in laboratory settings (e.g., Roediger et al. 2011c). In this article, we review recent findings from applied research that demonstrate that retrieval practice enhances long-term classroom learning, delayed quizzes are particularly potent for retention, quizzes benefit students’ transfer to novel quiz items, and quizzes with feedback improve students’ learning and metacognitive awareness. In addition to generating evidence to support retrieval-based learning, these applied research studies also enhanced the professional development of the teachers, administrators, and scientists involved in the project. In this article, it is our hope that by sharing what we have learned from a variety of perspectives, applied scientific research in K-12 classrooms will continue to be explored and generated at local, state, and national levels, improving student learning and educational decision-making.     

Supporting active learning in an undergraduate geotechnical engineering course using group-based audience response systems quizzes

The use of audience response systems (ARSs) or ‘clickers’ in higher education has increased over the recent years, predominantly owing to their ability to actively engage students, for promoting individual and group learning, and for providing instantaneous feedback to students and teachers. This paper describes how group-based ARS quizzes have been integrated into an undergraduate civil engineering course on foundation design. Overall, the ARS summary quizzes were very well received by the students. Feedback obtained from the students indicates that the majority believed the group-based quizzes were useful activities, which helped to improve their understanding of course materials, encouraged self-assessment, and assisted preparation for their summative examination. Providing students with clickers does not, however, necessarily guarantee the class will be engaged with the activity. If an ARS activity is to be successful, careful planning and design must be carried out and modifications adopted where necessary, which should be informed by the literature and relevant student feedback.     

Articulating Scientific Reasoning Improves Student Learning in an Undergraduate Anatomy and Physiology Course

In many life science classrooms, instructors rely upon lecture presentations to efficiently present course content. Students, in this case, act as passive learners with little opportunity to test their knowledge for gaps or misconceptions. The goal of the project described here was to determine whether a collaborative quiz protocol that guided students to discuss their understanding with their peers would improve learning and academic performance. The project took place during a single semester and was composed of two studies: a preliminary study that incorporated short-answer quizzes into the curriculum and a comprehensive study that incorporated short-answer quizzes and justify/explain quizzes in which students were expected to select an answer and then justify or explain it. Students took all quizzes twice, first independently and then collaboratively with classmate(s). Learning was assessed using multiple-choice exam questions based upon quiz topics. Students scored significantly higher on exam questions associated with justify/explain quiz topics than on those associated with short-answer quiz topics.     

Implementation and student perceptions of e-assessment in a Chemical Engineering module

This paper describes work carried out at the Department of Chemical Engineering at UCL into the use of e-assessment in a second year module and, in particular, the student perceptions of this mode of assessment. Three quizzes were implemented in Moodle, the first two as formative assessment and the final quiz as summative assessment. The results were very encouraging and practically all students engaged with the process. An online survey was delivered to all students after the module, which showed that the students felt that e-assessment added value to their learning and they would like to see it implemented in other modules. The quizzes were intended to be mainly beneficial to the weaker students as it gave them an opportunity to go over key aspects of the material in their own time. Interestingly, the stronger students were even more in favour of e-learning than the weaker students, for whom the quizzes were originally designed.     

A written,reflective and dialogic strategy for assessment feedback that can enhance student/teacher relationships

In response to the shortcomings of current assessment feedback practice, this paper presents the results of a study designed to examine students’ and teachers’ experience of engaging in a written, reflective and dialogic feedback (WRDF) strategy. The strategy was designed to enhance the learning experience of students undertaking a large first-year core course at a regional Australian university in semester 2, 2012. The evaluation consisted of three components: student surveys pre- and post-WRDF; a student focus group post-WRDF; and a teacher survey post-WRDF. Participating students’ and teachers’ perceptions of the WRDF assessment feedback suggested that students value feedback highly, and show a preference for feedback combining written, reflective and dialogic processes. The research findings suggest that the WRDF framework can be utilised to address the immediate, practical problem of students’ and teachers’ dissatisfaction with the practice of assessment feedback. Thus, WRDF may be used to nurture teacher/student relationships and enhance the learning process. Although a relatively intensive process, the WRDF strategy can serve an integral role in enhancing feedback practices and supporting students.     

Supporting student learning: the use of computer–based formative assessment modules

This paper describes the development of a variety of computer–based assessment opportunities, both formative and summative, that are available to a large first year biology class at The University of Sydney. These materials include: weekly quizzes; a mock exam; quiz sections in tutorials; and special self–assessment modules (SAMs). The weekly quiz is password protected and secure but the remaining materials are available on–line from a Virtual Learning Environment (http://FYBio.bio.usyd.edu.au/VLE/L1/). Evaluations over a number of years of the use and usefulness of the formative assessment materials indicate that the student population is making significant use of materials and that these materials are helping students in their learning     

Learning Style under Two Web‐Based Study Conditions

A sample of 48 college students prepared for in‐class examinations using two web‐based study conditions. The A condition used web‐based study groups and the B condition used web‐based quizzes. The Index of Learning Styles positioned students on four dimensions of learning style (active‐reflective, visual‐verbal, sequential‐global, and sensing‐intuitive). Students who were more active than reflective expressed a preference for face‐to‐face study groups rather than online study groups and for online quizzes rather than pencil‐and‐paper quizzes. Students who were more visual than verbal expressed a preference for online quizzes rather than online study groups. Such preferences were validated by decreased achievement in the less‐preferred study condition. At college level, students are aware of their learning style and understand the conditions that facilitate their mastery of course content. Instructional applications of web‐based technology may provide mechanisms for more consistently accommodating student learning style in higher education.     

Use of an audience response system during peer teaching among physical therapy students in human gross anatomy: Perceptions of peer teachers and students

An audience response system (ARS) has become popular among educators in medicine and the health professions because of the system's ability to engage listeners during a lecture presentation. No one has described the usefulness of ARS technology during planned nonlecture peer teaching sessions in gross anatomy instruction for health professionals. The unique feature of each peer teaching session was a nongraded 12–15 item ARS quiz assembled by six second‐year doctor of physical therapy (DPT) students and purposely placed at the beginning of the review session for those first‐year DPT students in attendance. This study used a ten‐item questionnaire and a five‐point Likert scale in addition to three open ended questions to survey perceptions of both first‐year and second‐year DPT students about the usefulness of ARS technology implemented during weekly interactive peer teaching sessions during a semester course in Anatomy for Physical Therapists. First‐year students overwhelmingly acknowledged the ARS system permitted each student to self‐assess his/her preparedness for a quiz or examination and compare his/her performance with that of classmates. Peer teachers recognized an ARS quiz provided them an opportunity to: (1) estimate first‐year students' level of understanding of anatomical concepts; and (2) effectively prepare first‐year students for their weekly quizzes and future examinations. On the basis of the mutual benefits derived by both students/tutees and teachers/tutors, physical therapist educators may wish to consider using ARS technology to enhance teaching methods for a class in gross human anatomy. Anat Sci Educ 2: 286–293, 2009. © 2009 American Association of Anatomists.     

Evaluating a technology supported interactive response system during the laboratory section of a histology course

Monitoring of student learning through systematic formative assessment is important for adjusting pedagogical strategies. However, traditional formative assessments, such as quizzes and written assignments, may not be sufficiently timely for making adjustments to a learning process. Technology supported formative assessment tools assess student knowledge, allow for immediate feedback, facilitate classroom dialogues, and have the potential to modify student learning strategies. As an attempt to integrate technology supported formative assessment in the laboratory section of an upper‐level histology course, the interactive application Learning Catalytics^TM, a cloud‐based assessment system, was used. This study conducted during the 2015 Histology courses at Cornell University concluded that this application is helpful for identifying student misconceptions “on‐the‐go,” engaging otherwise marginalized students, and forming a new communication venue between students and instructors. There was no overall difference between grades from topics that used the application and grades from those that did not, and students reported that it only slightly helped improve their understanding of the topic (3.8 ± 0.99 on a five‐point Likert scale). However, they highly recommended using it (4.2 ± 0.71). The major limitation was regarding the image display and graphical resolution of this application. Even though students embrace the use of technology, 39% reported benefits of having the traditional light microscope available. This cohort of students led instructors to conclude that the newest tools are not always better, but rather can complement traditional instruction methods. Anat Sci Educ 10: 328–338. © 2016 American Association of Anatomists.     

Quantifying participation in,and the effectiveness of,remediating assessment in a university mathematics module

In Maths for Business, a large first-year mathematics module, the continuous assessment component comprises 10 weekly quizzes which combine to contribute 40% of the final module mark. If students did not receive the full five marks on their weekly quiz, they were provided with the opportunity to resubmit their corrected weekly quiz with an explanation of their error(s) for one additional mark. We refer to this process as ‘remediation’. Of the students who had the opportunity to remediate, ～70% did. Through examining learning management system data, we show that the remediation process encouraged students to access module resources. Furthermore, by using a Bayesian hierarchical model to account for students’ level of participation, achievement and prior knowledge, we show that participation in the remediation process positively impacted the final examination marks of moderate to high-achieving students (based on initial continuous assessment marks). However, participation in the remediation process provided limited benefit to low-achieving students. We conjecture this is because these students had not achieved a level of understanding whereby participation in the remediation process could progress their knowledge.     

Students’ experience of team assessment with immediate feedback in a large accounting class

Team assessment has been suggested as a competency-based collaborative learning technique. Critical to the success of an assessment for learning, in competency-based education, is the use of formative feedback. This study reports on the development of, and the students’ experience of, a Team Assessment with Immediate Feedback (TAIF), in which immediate formative feedback is provided to the students by their peers and the assessment instrument (the IF-AT^® form). Results of the quantitative and qualitative data, collected in a survey, suggest that the majority of the students experienced the TAIF positively. Many students highlighted that they had constructed new knowledge and understanding of the content and practiced numerous skills during the team assessment. The learning benefits of the immediate feedback component of the team assessment were widely acknowledged by the students. The study also provided some initial evidence that team assessment in a culturally diverse student cohort may enhance intercultural collaboration. Team assessment may also contribute towards re-establishing the link between professional accounting education and practice.     

Designing effective,contemporary assessment on a flipped educational sciences course

ABSTRACT

Evidence shows flipped learning increases academic performance and student satisfaction. Yet, often practitioners flip instruction but keep traditional curricula and assessment. Assessment in higher education is often via written exams. But these provide limited feedback and do not ask students to put knowledge into practice. This does not support the tenets of flipped learning. For two years, the author flipped instruction but retained traditional curricula and assessment. However, on the author’s current course, all three aspects were redesigned to better support flipped learning. The aim of this research is to test the effectiveness of this redesign regarding student engagement and satisfaction. Thus, it is asked: How, on this course, can meaningful, continuous assessment be provided as well as effective, personalized feedback, while staying in line with the philosophy of flipped learning? Action research took place from September 2016 to June 2017. Quantitative data from a student survey, and qualitative data from a research diary and student focus group were gathered. What emerged is: a little-and-often assessment approach is effective for learning and engagement; tasks must be authentic and test demonstration of knowledge, not memory; quality, not quantity, is key for student learning; and students desire individualized feedback.     

A Classroom Study on the Relationship Between Student Achievement and Retrieval-Enhanced Learning

Retrieval practice has been shown to produce powerful learning gains in laboratory experiments but has seldom been explored in classrooms as a means of enhancing students’ learning of their course-relevant material. Furthermore, research is lacking concerning the role of individual differences in learning from retrieval. The current study explored the effects of retrieval in a large undergraduate introductory biology course as a function of individual differences in student achievement. Students completed in-class exercises that required them to retrieve course information (e.g., recalling definitions for terms and labeling diagrams) followed by feedback or to simply copy the information without retrieving it. A later quiz over the information showed that high-performing students benefited more from retrieving than copying, whereas middle- and low-performing students benefited more from copying than retrieving. When asked to predict their quiz scores following the in-class exercises, high-performers demonstrated better overall metacognitive calibration compared to middle- or low-performers. These results highlight the importance of individual differences in learning from retrieval and encourage future research using course-relevant material to consider the role of student achievement in classroom-based interventions.