Students’ perspectives of early assessment tasks in their first-year at university

Assessment plays an important role in first-year students’ transition to university, influencing how they learn. Poorly designed assessment can be demotivating and may even cause students to withdraw from university. An early low-stakes assessment task is recommended in first year, to provide information to students and staff on student progress, provide students with a positive experience and help them prepare for future assessments. This paper reports on first-year students’ experiences of two different early assessment tasks for two disciplines, one using an online quiz and the other a ‘research challenge’ that served as a precursor to writing an essay. The paper also presents lecturers’ reflections on what they learned, what they would change and the implications for others planning early assessment tasks for first years. Finally, ideas for future research are provided.     

Explicitness of criteria in peer assessment processes for first-year engineering students

This article will outline the motives for the implementation of peer assessment as put into action at the first year of the Civil Engineering course of the University of Minho. The implementation of new assessment methods was a consequence of the successful implementation of peer assessment at other engineering courses. During the semester, three assessment moments took place, in which students assessed the work of their peers. Assessment criteria were defined in a negotiation process between students and teacher. The students subsequently graded the work of their colleagues and had to provide a clear justification for each given grade. The aim of this method is to involve students in the subject, enhance their motivation and deepen their learning. Advantages and disadvantages of peer assessment are discussed. The results that have been obtained so far draw attention to the nature of assessment criteria and the corresponding explicitness.     

The common first year programme: some lessons from a construction science course

In 2005, the School of Property, Construction and Project Management at RMIT University, Melbourne, introduced a new curriculum format for all first year students. All students enrolling in one of the four undergraduate degrees offered by the school commenced a common first year programme. This new curriculum was adopted to provide students with a broader depth of knowledge and experience across all study areas and to provide greater skill enhancement for graduates. The common first year university experience allows students to build a multidisciplinary degree based upon their interests and skills. But the common first year has created a number of challenges for the lecturing staff: extremely large classes, space and resourcing issues, assessment and administration problems; greater strains upon technology; and increase in the impersonal nature of the learning environment. This paper examines how one of these large first year classes (construction science) was conducted to address some of the learning issues arising from a common first year. It describes how students were encouraged over the semester to electronically build and create a classroom resource of e-reference material on construction science topics, which was the basis for classroom discussion, interaction and assessment. The result was an electronic reference folder on CD that provided students with both a starting point for assignments, class interaction and assessment, and the development of vital information technology literacy skills.     

Computer-aided authoring of assessment instruments: An activity-theoretical approach

Abstract

Various researches have been conducted on the role and importance of assessment in education as well as its impact on the learner and the overall learning process. In fact, the way assessment is formulated in a particular subject shapes the way students learn. They focus their learning to comply with assessment requirements that they anticipate. In this article, the study is focused on the written examination papers (teacher-made tests) that are normally prepared at the end of a semester or an academic year to assess students of secondary and tertiary levels. The study also investigates how well papers are set and balanced according to the cognitive levels defined by Bloom (1956) and the learning outcomes/objectives as defined for the subjects. A collaborative process model as a framework for the design of such tests that can enhance the evaluation process is proposed. A brief argument is made for a case for a computer-supported collaborative environment to implement such a framework and which is based on activity theory. Such a framework is implemented in the form of MYSTIC; a collaborative authoring software for assessment instruments. The software allows stand-alone as well as collaborative authoring of examination papers and also helps academics' decision-making concerning the examination paper balancing and moderating process by graphically displaying and comparing marks allocated per question paper against the learning objectives     

Calibrating assessment literacy through benchmarking tasks

Abstract

In calibration tasks students assess exemplar texts using criteria against which their own work will be assessed. Typically, these tasks are used in the context of training for peer assessment. Little research has been conducted on the benefits of calibration tasks, such as benchmarking, as learning opportunities in their own right. This paper examines a dataset from a long-running benchmarking task (～500 students per semester, for four semesters). We investigate the relationship of benchmarking performance to other student outcomes, including ability to self-assess accurately. We show that students who complete the benchmarking perform better, that there is a relationship between benchmarking performance and self-assessment performance, and that students appreciate the support for learning that benchmarking tasks provide. We discuss implications for teaching and learning flagging the potential of calibration tasks as an under-explored tool.     

Assessment by Interview and Portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in higher education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a 1-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with preservice early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the 4-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.     

Assessing students’ performance by measured patterns of perceived strengths: does preference make a difference?

This paper is an empirical field study of whether college students’ preferences for assessment type correspond to their performance in assessment that tests that particular strength. For example, if students say they prefer assessment that tests their creativity, do they actually perform better on assessment tasks requiring the use of creativity? Seventy-eight students in three different courses were surveyed to determine their preferences in four types of assessment: memorisation, analysis, creativity and practical application. These preferences were then compared to student grades on corresponding forms of assessment to see if the preferences corresponded to actual performance. The study found that, while students had a clear preference for memorisation, they were not likely to deliver their best performances on memorisation tasks. There was no relationship at all between student preferences in assessment type and their performance in the respective assessments. These results indicate that, while in theory assessing students based on their preferences is reasonable for improved learning, we were not able to find evidence that it actually leads to higher performance.     

Implementing Outcomes Assessment in an Academic Affairs Support Unit

While outcomes assessment has become a focus for institutions of higher education, assessment in academic support units remain sparse. Traditionally, assessment has been comprised of one-time student satisfaction surveys and/or supervisor evaluations tied specifically to job criteria. Although informative, these methods fail to account for or measure specific student learning outcomes completed by students via their interaction with faculty and staff. This article presents the development and implementation of a program of outcomes assessment at a 4-year public university in the northeast. Results indicate that students come to college with varying expectations of the role of academic advisors and range on a continuum of academic and social preparation to meet the demands of higher education. A majority of students are meeting the stated learning outcomes. Feedback from this assessment model is being used to improve the quality of services provided to successive cohorts of students at this institution.     

A scaffolded approach to Discussion Board use for formative assessment of academic writing skills

Mastery of academic writing skills remains one of the greatest challenges for university students, especially in the first year. Amongst the reasons offered for the challenges are lack of clarity about the university’s expectations and low levels of teacher feedback on work submitted, a failure to engage, and low levels of contact with teaching staff and other students. Academic staff are challenged by increased class numbers and increased student diversity in classes and university policies to adopt a wide range of information technologies into teaching modes. In this paper, we offer one attempt at addressing these three important contemporary academic challenges: use of information technology to provide timely feedback through formative assessment to help students with a range of abilities to acquire the academic writing skills necessary to succeed in higher education. Early indications show that students find this form of formative assessment very useful. They value the timely and focused feedback from the lecturer and are developing collegiality as they learn from each others’ writing and feedback. We believe that this strategy is sustainable and can be adapted to facilitate academic and social integration for students across many disciplines.     

An assessment innovation as flywheel for changing teaching and learning

This contribution shows an example of how an assessment innovation can serve as a flywheel for changing teaching and learning. This article first explains the development of an authentic, competence-based performance assessment in pre-vocational secondary education (pre-VET). Using these assessments in pre-VET, that is preparatory to VET, is important for motivating students for a future in VET. Second, in an action research 34 teacher teams of 11 pre-VET institutions implement the new assessment, supported by researchers and teacher coaches, to illuminate how it motivates students, prepares them for VET, and influences teaching and learning. Data from 76 teachers, 68 students, 24 teacher coaches and 3 researchers showed how implementing these assessments raised questions about changing educational content and pedagogy to fit a competence-based approach. Increasing teachers’ expectations of students, changing student-teacher interaction patterns, and developing teachers’ practical understanding of competencies and how they can be observed and discussed in assessments are some of the intriguing challenges that require further support for proper implementation of competence-based assessments and developing an aligned competence-based teaching and learning process.     

Integrative assessment: reframing assessment practice for current and future learning

The requirement to provide timely formative tasks that are designed to facilitate student learning and autonomy has provoked a wider examination of the role of assessment in higher education and encouraged further investigation of the alignment of learning, teaching and assessment in curriculum design frameworks. Many current authors have proposed that the primary purpose of assessment is to enhance current and future learning and that current practice tends to overemphasise the importance of assessment for progression and certification purposes. This paper proposes that a clearer distinction be made between assessment tasks designed to facilitate and test current learning through the use of formative and summative assessments, and those tasks primarily designed to enhance future learning, which could be better termed integrative assessments. This distinction would allow students and teachers to have greater clarity around the proposed outcomes and reward mechanisms associated with assessment tasks and feedback. This paper proposes that teachers should strive to incorporate four different types of assessment tasks throughout a programme of study, namely diagnostic, formative, integrative and summative tasks, and that the outcomes and reward mechanisms for different assessment types be explained more clearly to students.     

Interventions in teaching first-year law: feeding forward to improve learning outcomes

Aligned assessment is a cornerstone of higher education curriculum design. Yet, it does not address the problem of how students learn how they should proceed when faced with a new assessment task. That teaching task is often left to the role of ‘feedback’. This article examines changes to a first year law unit, introduced following negative student feedback about an assessment task. The feedback made apparent a lack of alignment between staff and student expectations as to what was being assessed and how it was being assessed. The article considers formative assessment through a feed-forward model, and relates this to the design and process of the intervention. The teaching method of the feed-forward model is detailed. The analysis of the results shows that a number of key misperceptions were held by students as to the points of difficulty in the assignment. A significant number of students also found it extremely difficult to judge the quality of past assignments against a marking guide. This direct feeding forward allowed some of the students’ tacit and false assumptions to emerge and be addressed, before they began their first major assessment, resulting in improved pass rates for the assessment.     

A preliminary investigation and analysis of student learning style preferences in further and higher education

In the current further education (FE) and higher education (HE) environment, students are under increasing pressure to perform well and achieve good results. As educators we must strive to enable students to make the most of their higher education by providing an education of the highest quality and enhance the learning experience. This study was undertaken as a preliminary investigation of how students learn and how we, as educators, can improve their learning. In this study, a range of students on different (FE and HE) courses completed the VARK (visual, audio, read/write, kinaesthetic) questionnaire on learning style preferences at the beginning of the semester. Responses were analysed and the author adapted various teaching techniques into course materials for the semester to accommodate the results obtained in the initial VARK survey. Students' responses were encouraging, with many being keen to participate with a view to improving their course performance. The author found that using a range of teaching techniques encouraged student participation in the course and, for some, enhanced their performance in assessment. This investigation provides an insight into the awareness of learning style preferences and how such awareness can be positively exploited in teaching and learning processes.     

An assessment framework for inclusive education: integrating assessment approaches

Teachers committed to inclusive education have the potential to revolutionise pedagogical and assessment practices within regular classrooms simply because students with high needs challenge traditional assumptions about what it means ‘to learn’ and ‘to assess’. This creates opportunities for teachers to find creative ways to ascertain what and how a child learns, and how these assessment results can be communicated to the child, parents, the school and funding bodies to enable further learning. This paper explores diverse assessment practices including criterion-based, normative, ipsative and self-assessment, with both formative and summative functions, reported as being used by teachers in New Zealand who teach students with high needs. These multiple approaches can be integrated into learning stories to ‘narrate’ student learning. An assessment framework is introduced to support teachers to appreciate the functionality of an integrated assessment approach to document student learning and outcomes, arguably a framework applicable for all learners.     

WHAT YOU KNOW AND HOW YOU WRITE IT: A PROJECT FOR TEACHING AND ASSESSING WRITING ACROSS THE CURRICULUM

Writing evaluation conventionally relies on essay tests, but more informal methods can help reveal students' writing skills. A classroom project was designed to examine students' awareness of the demands posed by various academic writing, tasks, to discover how that awareness develops with experience, and to orient new students to the roles writing plays in their academic lives. The project involved three groups: freshmen enrolled in introductory writing classes for the first time, freshmen and others repeating the introductory classes, and upperclass students enrolled in a course in professional writing. At the beginning of the semester, all were asked to report any information they could find that would help them complete the semester's writing tasks. At the end of the semester they added information they had gained in the interval. Reports from all groups contained the same kinds of information, but students in professional writing noted more often that purposes of assignments related to goals for the course, while the freshmen added more late information about writing processes. The project was a valuable learning activity and suggested what roles writing plays in students' academic lives. Similar projects should be included in a thorough assessment of writing programs.     

Case studies in making assessment efficient while developing student professionalism and managing transition

It is known that assessment drives learning and hence a good assessment design is key to effective student development. This paper gives some case studies in effective assessment strategies within engineering. The main contribution is to demonstrate how one can simultaneously meet a number of requirements with individual assessments and therefore be efficient in both the student and staff assessment load. The paper also proposes that assessments should be challenging and the benefits of expecting students to rise to this challenge and also how one can meet many independent learning objectives in a single assignment in order to manage the overall assessment load for staff and students.