Using continuous assessment to promote student engagement in a large class

The authors have developed a first-year fluids course for a class of around 230 aerospace, civil and mechanical engineering students. This paper aims to show how the teaching and assessment methodology was applied to the challenge of a large class. The lectures featured formal teaching interspersed with active learning elements. Smaller group (about 25–30 students) tutorial classes involved student practice. A 10-minute test occurred in each tutorial during weeks 3–11. Each test was based on the previous week's lecture material and the marks contributed towards 20% of the course mark. A condition for passing the course was that a student must pass at least six of the nine tests. The assessment promoted student involvement with the course – tutorial attendance was greater and more uniform than previously and exam performance improved significantly. Students recognised that the assessment system was useful in encouraging continuous learning over the semester and building confidence.     

Implementing summative assessment with a formative flavour: a case study in a large class

Teaching a large class can present real challenges in design, management and standardisation of assessment practices. One of the main dilemmas for university teachers is how to implement effective formative assessment practices with accompanying high-quality feedback consistently over time with large classroom groups. This article reports on how elements of formative practices can be implemented as part of summative assessment in very large undergraduate cohorts (n = 1500 in one semester), studying in different modes (on- and off-campus), with multiple markers, and under common cost and time constraints. Design features implemented include the use of exemplars, rubrics and audio feedback. The article draws on the reflections of the leading teacher, and argues that, for summative assessment to benefit learners, it should contain formative assessment elements. The teaching practices utilised in the case study provide some means to resolve the tensions between formative assessment and summative assessment that may be more generally applicable.     

Where angels fear to tread: online peer-assessment in a large first-year class

In the context of widening participation, large classes and increased diversity, assessment of student learning is becoming increasingly problematic in that providing formative feedback aimed at developing student writing proves to be particularly laborious. Although the potential value of peer assessment has been well documented in the literature, the associated administrative burden, also in relation to managing anonymity and intellectual ownership, makes this option less attractive, particularly in large classes. A potential solution involves the use of information and communication technologies to automate the logistics associated with peer assessment in a time-efficient way. However, uptake of such systems in the higher education community is limited, and research in this area is only beginning. This case study reports on the use of the Moodle Workshop module for formative peer assessment of students’ individual work in a first-year introductory macro-economics class of over 800 students. Data were collected through an end-of-course evaluation survey of students. The study found that using the feature-rich Workshop module not only addressed many of the practical challenges associated with paper-based peer assessments, but also provided a range of additional options for enhancing validity and reliability of peer assessments that would not be possible with paper-based systems.     

Perceptions of Portuguese undergraduate students about assessment: a study in five public universities

This paper draws upon a broader piece of research on assessment in higher education, particularly focusing on issues regarding the fairness and effectiveness of the assessment methods and their implications for the learning process. The perceptions of undergraduate students are analysed taking into account the effectiveness and fairness of both traditional and learner-centred assessment methods, as well their influence on the learning process. In total, 624 students participated in this study in five Portuguese Public Universities in different areas of knowledge and programmes. Data were collected through questionnaires. Findings suggest that assessment is seen as more effective and fairer when it is done through the use of learner-centred assessment methods rather than by traditional assessment (e.g. written tests or exams). The students also claim that they devote more time to study when assessment is performed through learner-centred assessment methods than by traditional ones. The most used assessment methods are written tests and oral presentations in group. However, differences in the programmes were identified as well as differences according to gender. Implications of the findings for assessment and for the teaching and learning process are discussed.     

Quantifying the assessment loads of students and staff: the challenge of selecting appropriate metrics

Assessment is central to learning. It is also central to the cost of providing higher education. Choosing how much and what forms of assessment are questions not only of good teaching but of good policy. Measuring the amount of assessment set in each course provides a basis on which to determine equitable and appropriate workloads for students and staff across disciplines and institutions and to use institutional budgets and staff time to best effect. It is, however, more difficult than it might at first appear to select metrics appropriate to this task. This article considers the advantages and disadvantages of four options. It also suggests the potential value of ratios and proposes that further consideration be given to removing the distinction commonly found in student workload formulae between time spent on learning out of class and that spent on assessment.     

Evaluating the use of computers in science assessment: Considerations and recommendations

The use of computers in science assessment is viewed through the eyes of the program evaluator by examining six considerations: (1) purpose of computer use in assessment, (2) value of program evaluation models, (3) possible harmful side effects of assessment, (4) nature of imbedded questions, (5) definition of treatment, and (6) computers and the classroom context. Following a discussion of the considerations, four recommendations are offered in regard to continuing to study the use of computers for assessment (examples provided), utilizing the ideas contained in program evaluation models, capitalizing on several interesting, novel possibilities for evaluation design, and combining qualitative and quantitative techniques (mixed methodologies) into the evaluation procedures.     

Formative assessment: the role of participatory action research in blending policy and practice in Uganda

This paper documents teachers’ assessment practices and pupils’ learning to read and write in large classes. To gain insights into the assessment practices and pupils’ learning, the principles of Vygotsky’s zone of proximal development and participatory action research (PAR) design were adopted. Collaboratively, teachers reflected on their assessment practices, developed, implemented and monitored the assessment practices. Through observation, in-depth interview and review of exercise books, data were obtained. We argue that teachers’ involvement in PAR has contributed to changing assessment practices in large classes and in improving pupils’ competencies in reading and writing. On the other hand to promote better assessment practices, we advocate for reduced number of pupils in a class and teachers’ workload to enable them offer more support to the pupils during assessment of reading and writing.     

浅谈本科评估对民办本科教育质量的促进作用

对于新建的民办本科院校来说,主动提出参加教育部第一轮的本科教学工作水平评估是严峻考验,也是发展机遇。迎接评估和做好评估准备工作,是民办本科院校的一项重要任务,也是新建本科院校的一个共同课题。本文结合自己在学校迎评创建中工作,浅谈了本科评估对民办本科教育质量的促进作用。     

Predicting transition and adjustment to college: biomedical and behavioral science aspirants’ and minority students’ first year of college

The purpose of this study is to explore key factors that impact the college transition of aspiring underrepresented minority students in the biomedical and behavioral sciences, in comparison with White, Asian students and non-science minority students. We examined successful management of the academic environment and sense of belonging during the first college year. Longitudinal data were derived from the Higher Education Research Institute’s (HERI) 2004 Cooperative Institutional Research Program (CIRP) Freshman Survey and the 2005 Your First College Year (YFCY) Survey. Using a reformulation of the integration model (Nora, Barlow, and Crisp, 2005), we find concerns about college financing, negotiating family support and responsibility, and campus racial dynamics (perceived and behavioral) affect student adjustment and sense of integration in the first year. This study was made possible by the support of the National Institute of General Medical Sciences, NIH Grant Number 1 RO1 GMO71968-01. This independent research and the views expressed here do not indicate endorsement by the sponsor.     

Assessment for learning: using programmatic assessment requirements as an opportunity to develop information literacy and data skills in undergraduate students

Departments and programmes in higher education are required to participate in an increasing number of programme, course and student assessments. These assessment requirements are also opportunities to develop student skills related to scientific literacy and research, if students are included in the process of developing, administering and interpreting these assessments. This paper describes a course designed to build student research skills through incorporating undergraduate students into the process of programme review for a psychology department, a comprehensive assessment required of this department every five years. This course proved to be an effective way to engage students, as students developed and administered assessment surveys, analysed and interpreted results, and prepared both a professional report for the department as well as a research presentation. The paper discusses recommended course activities, and shows how this opportunity can benefit students and faculty in a myriad of ways.     

Implicit aspects of paper and pencil mathematics assessment that come to light through the use of the computer

This article explores the effect on assessment of ‘translating’ paper and pencil test items into their computer equivalents. Computer versions of a set of mathematics questions derived from the paper-based end of key stage 2 and 3 assessments in England were administered to age appropriate pupil samples, and the outcomes compared. Although in most cases the change to the different medium seems to make little difference, for some items the affordances of the computer profoundly affect how the question is attempted, and therefore what is being assessed when the item is used in a test. These differences are considered in terms of validity and legitimacy, that is whether the means used to answer a question in a particular medium are appropriate to the assessment intention. The conclusion is not only that translating paper and pencil items into the computer format sometimes undermines their validity as assessments, it is also that some paper and pencil items are less valid as assessments than their computer equivalents would be.     

Using and rejecting peer feedback in the science classroom: a study of students’ negotiations on how to use peer feedback when designing experiments

Background: Research on peer assessment has noted ambiguity among students in using peer assessment for improving their work. Previous research has explained this in terms of deficits in the student feedback, or differences in student views of what counts as high-quality work.

Purpose: This study frames peer assessment as a social process in the science classroom. The aim is to explore peer assessment in science education as social practice in order to contribute to an understanding of the affordances and constraints of using peer assessment as a learning tool in science education.

Design and Method: The study was conducted in four lower secondary school classes, school years 8 and 9, in two different schools. An intervention study was designed focussing on the topic of experimental design. It involved the students in a process of peer assessment where they designed experiments individually, and then exchanged their designs, conducted each other’s experiments, provided feedback to each other and revised their original design after discussing the feedback in groups. Data were collected in the form of audio recordings of student discussions and written work.

Results: The results show that, although not all peer feedback resulted in revisions, peer feedback was useful to the students in group interaction when negotiating quality in their work.

Conclusions: To conclude, the potential for using peer assessment in science education should not only be evaluated through the students’ revisions but also in terms of in what ways the feedback constitutes interactional resources for defining quality in student work.     

Guidelines to assist the implementation of differentiated learning activities in South African secondary schools

Despite previous research and recommendations in South Africa, secondary-school teachers still encounter economic, social and cultural challenges in implementing differentiated learning activities in the classroom. The diversity of learners with learning barriers inevitably leads to an increase in workload for the teachers. This article draws on data generated from the research conducted in South Africa and from questionnaires completed by secondary-school teachers who identified existing challenges to implementing differentiated learning activities, as well as on student teachers who implemented three differentiated learning activities (for the slow, average and gifted learners), and reflects on their experiences of good and bad practices. The literature review and specialists' views were integrated to determine how to overcome the challenges that the implementation of differentiated learning faces. Several challenges to the implementation of differentiated learning were highlighted by the research. The research indicated that a total of 97% of teachers never or seldom use a flexible curriculum and extra time to accommodate the diverse learning needs of learners. This article provides guidelines on how to implement differentiated learning activities in secondary-school classes and offers ideas on how to start with differentiated teaching.     

Vibrant student voices: exploring effects of the use of clickers in large college courses

Teachers have begun using student response systems (SRSs) in an effort to enhance the learning process in higher education courses. Research providing detailed information about how interactive technologies affect students as they learn is crucial for professors who seek to improve teaching quality, attendance rates and student learning. This study investigates social, educational and emotional effects of the use of SRSs – clickers – at the University of Colorado at Boulder. Methods include participant observation, survey data from over 2000 students enrolled in three semesters of General Chemistry, and in‐depth interviews exploring the nature of student experiences with clickers. Findings suggest clickers significantly alter the social environment experienced by students as they learn. Clickers create learning environments characterized by greater activity, cooperation and conceptual application compared to traditional, lecture‐based instruction. Gender also influences whether students choose to work with peers during clicker‐prompted interaction. The qualitative analysis presented here extends upon themes identified in existing research on the effects of clickers for learning.     

Applicability of non-modular assessment in construction management and allied undergraduate programmes: perspective of the academics involved

Undergraduate programmes on construction management and other closely related built environment disciplines are currently taught and assessed on a modular basis. This is the case in the UK and in many other countries globally. However, it can be argued that professionally oriented programmes like these are better assessed on a non-modular basis, in order to produce graduates who can apply knowledge on different subject contents in cohesion to solve complex practical scenarios in their work environments. The examples of medical programmes where students are assessed on a non-modular basis can be cited as areas where this is already being done. A preliminary study was undertaken to explore the applicability of non-modular assessment within construction management undergraduate education. A selected sample of university academics was interviewed to gather their perspectives on the applicability of non-modular assessment. General acceptance was observed among the academics involved that integrating non-modular assessment is applicable and will be beneficial. All academics stated that at least some form of non-modular assessment was being currently used in their programmes. Examples where cross-modular knowledge is assessed included comprehensive/multidisciplinary project modules and creating larger modules to amalgamate a number of related subject areas. As opposed to a complete shift from modular to non-modular, an approach where non-modular assessment is integrated and its use further expanded within the current system is therefore suggested. This is due to the potential benefits associated with this form of assessment for professionally aligned built environment programmes.     

Student perceptions of their learning and engagement in response to the use of a continuous e-assessment in an undergraduate module

Student engagement is an important issue in higher education, and is related to the quality of the student experience. Increasing student engagement is one way of enhancing quality at a higher education institution. An institution is able to influence student engagement in a number of ways, one being through curriculum design. The use of a low-stakes continuous weekly summative e-assessment had a positive influence on student engagement in an optional level 5 (second year) undergraduate geography module. Students considered their increased engagement was a direct consequence of this assessment method. It was also found that students thought they improved their learning, particularly their understanding, as a result of the continuous assessment. This study suggests that carefully designed assessments can be used to increase student engagement and learning, and, as a result, contribute to improving the quality of the overall student experience.     

A longitudinal quantitative investigation into the concurrent validity of self and peer assessment applied to English-Chinese bi-directional interpretation in an undergraduate interpreting course

One of the productive lines of research on self-assessment (SA) and peer assessment (PA) concerns their concurrent validity with respect to a criterion measure. However, similar research has rarely been conducted for spoken-language interpreting. This article therefore reports on a longitudinal study that investigated the validity of self and peer ratings on three performance dimensions of English-Chinese consecutive interpretation (i.e., information completeness, fluency of delivery, and target language quality), taking teachers’ ratings as a yardstick. Major findings include: although the students as a group were unable to replicate teachers’ ratings, they were able to rank-order their performances in a fairly accurate manner and improved their SA and PA accuracy over time. Interpreting directionality seems to moderate the correlational strength of self/teacher ratings and peer/teacher ratings. These results are discussed in relation to previous literature, and pedagogical suggestions are provided to improve SA and PA for bi-directional interpretation.     

Providing formative assessment to students solving multipath engineering problems with complex arrangements of interacting parts: an intelligent tutor approach

Problems faced by engineering students involve multiple pathways to solution. Students rarely receive effective formative feedback on handwritten homework. This paper examines the potential for computer-based formative assessment of student solutions to multipath engineering problems. In particular, an intelligent tutor approach is adopted and tested out on problems of truss analysis, studied in engineering statics. With a cognitive model for solving the class of problems, the tutor allows the student wide latitude in solution steps, while maintaining sufficient constraints for judging the solution and offering feedback. Proper selection of judging points prevents interference with productive student work, while avoiding accumulated errors. To monitor student learning, efforts to apply distinct skills were extracted on the fly from student work. Using statistical methods developed for intelligent tutoring systems, metrics of the effectiveness of the feedback and areas for further improvements were gleaned from error rates in successive opportunities to apply distinct skills.     

Using activity theory to evaluate a professional learning and development initiative in the use of narrative assessment

Analysis of the impact of professional learning and development (PLD) programmes for educators is complex. This article presents an analysis of a PLD initiative in which classroom teachers learned to use narrative assessment for students with ‘high’ and ‘very high’ learning needs. Using Cultural Historical Activity Theory (CHAT), the analysis showed how various tensions arose across the activity system of participants during the initiative. Tensions were associated with the roles of those involved, the narrative assessment approach, and the rules of the initiative. While the new narrative assessment approach resulted in benefits for the students and their parents, role conflict emerged in relation to established assessment approaches already used by the educators. It is argued that CHAT enables a more nuanced understanding of the complex ways in which teachers actually engage with official curriculum, pedagogy or assessment PLD initiatives, than do theories that position teachers as simply resistant to change.