Towards the improvement of the student experience of assessment and feedback in construction management education

It is widely accepted across Higher Education that assessment practices have a link with learning and a key factor in this link is formative assessment. Formative assessment is generally defined as taking place during a module/programme with the express purpose of improving and enhancing student learning. It is important to understand how lecturers in construction engineering education perceive their own roles and the roles of their students in using effective assessment strategies. An investigation into lecturers’ perceptions of their roles and their conceptions related to the assessment process of students in those programmes is reported. An on-line survey was conducted with over 30 Irish academics involved in the area of construction management. Discussion is focused on a critical evaluation of the findings of the study and how it relates to the current literature on the roles of academics in the formative assessment process. Recommendations are made on how lecturers/teachers might better formulate appropriate assessment strategies that will encourage deep and effective learning.     

Special educational needs,e-learning and the reflective e-portfolio: implications for developing and assessing competence in pre-service education

Diagnostic and formative assessment practices have been widely endorsed in the educational research literature. This article reports the findings of a small-scale study which investigated the extent to which these practices have been embraced in classroom teaching. The interview data from six lecturers and six students at a polytechnic in Singapore illustrate how lecturers described their strategies and students experienced them. The data indicate that, among the research participants, there was little clear evidence to suggest that diagnostic and formative assessment were coherently conceptualised or strategically applied. Further, instances of pedagogical actions that could have been taken as applications of diagnostic and formative assessment appeared to have occurred serendipitously rather than purposefully. The implications of this for the students’ learning are discussed.     

“It is complicated!”: Practices and challenges of generic skills assessment in Vietnamese universities

Contributing to a lack of studies related to generic skills (GS) assessment, especially in non-Western university contexts, this article reports a study that explored practices and challenges of assessing students’ GS in the Business Administration programmes in six Vietnamese universities. Content analysis of interviews with 41 teachers of skills subjects and specialised subjects revealed that teachers were organising different formative and summative GS-assessment activities. Unfortunately, the analysis indicated that their GS-assessment practices were fragmented across subjects in the curriculum. Teachers’ beliefs regarding their roles in the university, teachers’ expertise and several contextual factors were found to influence their assessment practices. The article argues that leadership should be exercised more effectively in order to remove obstacles and engage teachers with assessing GS, which will yield washback effect on students’ learning of these skills.     

Working with uncertainty to support the teaching of critical reflection

This paper explores the cumulative reflections of lecturers examining their tacit assumptions of teaching practice. Despite extensive literature on the educational value of reflection, there is less visible research on teachers assessing their own reflective thinking. This longitudinal interpretive study uses Larrivee's assessment framework with a purposive sample of UK business students. Findings reveal insights for teaching reflection; acknowledging the discomfort of reflexive practice encourages learners to experiment with knowledge interpretation. The students' struggle to engage in reflection resonated with lecturers' parallel difficulties. The teaching approach balances deliberate structure with uncertain outcomes to trigger fresh interpretation of developmental theory and workplace relevance. Practice implications for lecturers are that harnessing uncertainty can provoke deeper insights that enable students to direct their learning and develop reflective skills. This case study offers a practical assessment example to enrich reflexive teaching, with scope to compare and replicate in different disciplinary settings.     

Formative assessment in Confucian heritage culture classrooms: activity theory analysis of tensions,contradictions and hybrid practices

Formative assessment has recently become a preferred assessment strategy in educational institutions worldwide. However, it is not easy to implement in Asian classrooms, because local cultures and institutional constraints potentially hinder the practice. This one-semester study aimed to use the ‘third space’, as the core of the third generation of activity theory, as a frame to capture how Vietnamese teachers took into account both traditional practices and contemporary influences to transform formative assessment practices to make them feasible in their classrooms. Participants were 2 lecturers and 250 students from two college classes in Vietnam. The results showed that Vietnamese students’ conceptions of learning were heavily influenced by examinations and their traditional learning culture. Consequently, the teachers needed to transform the initiative to align with these features in Vietnamese classrooms. When the revisions were made, the students were evidenced to achieve a growth in learning, change their beliefs about learning and develop both self-learning and collective learning.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

The visual representation,by electrical methods,of the elementary principles of sound

Abstract

This paper describes an institutionally based research project examining the problems encountered in introducing curriculum change to an engineering programme in a further education college. The project required tutors to integrate assessment of core skills with their engineering assessment. Evaluation of the impact of these changes was made using both interviews and questionnaires. Tutors experienced some problems in taking on this new responsibility. Students, particularly adult students, welcomed a move to more active learning, but required more guidance from lecturers on what was required of them. The project explored the practical problems experienced by lecturers and students when change was introduced. The findings of this study highlight the extent of change in attitude and in teaching style that may be required by many lecturers implementing General National Vocational Qualifications programmes.     

Students’ experience of team assessment with immediate feedback in a large accounting class

Team assessment has been suggested as a competency-based collaborative learning technique. Critical to the success of an assessment for learning, in competency-based education, is the use of formative feedback. This study reports on the development of, and the students’ experience of, a Team Assessment with Immediate Feedback (TAIF), in which immediate formative feedback is provided to the students by their peers and the assessment instrument (the IF-AT^® form). Results of the quantitative and qualitative data, collected in a survey, suggest that the majority of the students experienced the TAIF positively. Many students highlighted that they had constructed new knowledge and understanding of the content and practiced numerous skills during the team assessment. The learning benefits of the immediate feedback component of the team assessment were widely acknowledged by the students. The study also provided some initial evidence that team assessment in a culturally diverse student cohort may enhance intercultural collaboration. Team assessment may also contribute towards re-establishing the link between professional accounting education and practice.     

Feedback as an assessment for learning tool: How useful can it be?

This study investigates the feedback practices and perceptions of lecturers and students in a UK university setting. To assess how lecturers give feedback in practice, 47 pieces of lecturer-written feedback were categorised into a total of 571 analytical points. Analysing the feedback from lecturers’ perspectives in terms of the value of feedback, the role of feedback and the effectiveness of feedback helps in an understanding of the rationale for and effects of feedback provision. The results of feedback analyses from students’ perspectives show the impact of individual background and intercultural communication barriers on the effective reception of feedback. Differences were identified between students and lecturers’ views of feedback as an assessment for learning tool.     

Learning to mark: exemplars,dialogue and participation in assessment communities

The problems of shifting from norm-referenced assessment to criterion-referenced assessment have been identified by several scholars in recent years. These important critiques touch on a number of areas, but neglect a key question about how assessors learn to accomplish what Shay calls a ‘socially situated interpretive act'. Research that does exist tends to focus on salaried, full-time academics. This overlooks the heterogeneity of the academic labour force in higher education and the substantial contribution made by contract (hourly-paid) lecturers, particularly in applied disciplines such as Business and Management. This study explores how nine newcomers to a UK Business School – including salaried and contract staff – attempt to understand local assessment practice. We use a situated learning lens to analyse their diary entries and interviews about their experiences of learning to mark. Drawing on scholars such as Sadler, we examine the suggestion that exemplars are important for newcomers coming to understand local assessment practice. We argue for the fundamental importance of dialogue about exemplars and other aspects of practice, both to develop inter-subject understandings of assessment ‘anchor points' and also to foster among newcomers (and especially contract lecturers) a greater sense of participating in, and being valued by, the local assessment community.     

Comparison between conceptions and assessment practices among secondary education teachers: more differences than similarities (Comparación entre concepciones y prácticas de evaluación en profesores de Educación Secundaria: más diferencias que semejanzas)

ABSTRACT

Teachers’ conceptions can affect any teaching practice, including assessment. Compared with the previous learning stages in Spain, the accreditation-based focus increases in secondary education. Therefore, it is necessary to study the conceptions teachers have of assessment during this stage and the role these play in their teaching practices. The study participants comprised 219 secondary education teachers. A mixed methodology including a questionnaire, dilemmas and the analysis of test contents was used. An analysis was implemented of the relationship between the conceptions of assessment and the type of tests used, self-assessment and peer assessment, and characteristics of feedback. The teachers reported having a formative conception, but this was incoherent with their assessment methods characterized by a scarce use of self-assessment and peer assessment and a hardly formative feedback. In conclusion, we highlight the relevance of the teaching-related conceptions in the education system and the need for working jointly with teachers to implement an authentically formative assessment in the classroom, with an emphasis on consistency between conceptions and practices.     

Making learning effective – quantity and quality of pre-service teachers’ feedback

ABSTRACT

Feedback is an essential formative assessment practice that has the potential to influence student learning and achievement positively. Providing effective feedback, however, is a challenging task for teachers. Especially beginning teachers struggle with the provision of information that supports students in developing and improving their competences. Learning to provide feedback thus is an important aspect of teacher education. The present exploratory study investigates pre-service chemistry teachers’ practices regarding the judgement of students’ level of achievement and the provision of feedback in the context of the control-of-variables strategy. A sample of N?=?40 bachelor and master students at Kiel University judged students’ written artefacts and provided feedback with the aim to support students in their progression towards the learning goals. The quality of the feedback was coded with respect to its correct judgement of the students’ current levels of achievement and the support it provided regarding next steps in learning. The results show that only a few of the pre-service teachers could correctly judge students’ current levels of achievement and provide feedback that is expected to be effective. Overall, the findings indicate a need for more research in this field and a need for the implementation of formative assessment practices as a topic in pre-service teacher education.     

A Study of the Views of Full-time Further Education Lecturers Regarding their College Corporations and Agencies of the Further Education Sector

Full-time lecturers in further education colleges in England form an occupational group which has been subject to many varied and demanding changes, particularly since the incorporation of colleges in 1993. Prior to 1993 lecturers were employees of local education authorities and, as such, were part of an often remote local authority personnel administration framework. Since 1993 full-time lecturers have become employees of college corporations. Most corporations have introduced human resource management practices which have changed the distant employment relationship lecturers had with LEAs. At the same time, the consequence of financial constraints and increasing competition in the further education sector has emphasised the already existing core-periphery organisational model in colleges which has now led to fewer full-time lecturers (core) and more part-time lecturers (periphery). The question of the professional status of lecturers has also been raised by, for example, College Employers Forum rhetoric in the early post-incorporation phase to encourage contractual change; the development of Qualified Teacher Status for primary and secondary teachers only; the debate about further education membership of a General Teaching Council for England, and the expansion of a new vocational curricula which seemed to dilute the educational experience of students. This article considers the views that a sample of full-time lecturers have about their employment experience and is an initial report of a research study which looks at the employment relationship between full-time lecturers and their college corporations. Views and perceptions of 687 full-time lecturers' responses to a postal questionnaire are presented and reviewed. This initial report suggests that, unlike the picture nationally for the UK workforce (as presented in a recent Institute of Personnel and Development report - Guest & Conway, 1998), full-time lecturers in further education colleges may be experiencing a violated psychological contract with the consequences for their employment relationship of loss of trust and a significant, depressing effect on commitment, job satisfaction and work performance.     

Using summative and formative assessments to evaluate EFL teachers’ teaching performance

Using classroom observations (formative) and student course experience survey results (summative) to evaluate English lecturers’ teaching performances is not new in practice, but surprisingly only a few studies have investigated this issue in a higher education context. This study was conducted in an English department of a large university in Vietnam. The data include: (1) semi-structured interviews with all the full-time lecturers, (2) two department heads and (3) course experience surveys from English as a foreign language (EFL) students (N?=?2886). Three lessons can be learned: (1) formative assessments do not seem to have an effect on promoting better teaching practices when their feedback is not helpful in improving high-stakes summative assessment results, (2) without sharing a common definition of good teaching practices among assessors, summative assessments appear to make the feedback from formative assessments less meaningful and applicable, and (3) as a result, the combination of formative and summative assessments tends to make EFL lecturers’ self-assessment practices less effective.     

Students’ views of assessment in project-led engineering education: findings from a case study in Portugal

According to the demands of the Bologna process, new educational methods and strategies are needed in order to enhance student-centred learning. Project work is one of those approaches. This paper aims to evaluate the impact of project-led education (PLE) on students’ learning processes and outcomes, within the context of a first-year engineering programme. It explores students’ perceptions about assessment procedures and processes. Data collection was based on individual surveys at the end and the beginning of each PLE edition and through focus groups, after a period of six months. Findings are presented according to emerging themes from the data analysis, focusing mainly on students’ perspectives of learning and assessment, the role of formative and summative assessments in PLE and their impact on learning. Implications for improving assessment practices are discussed.     

Contextualising higher education assessment task words with an ‘anti-glossary’ approach

Key ‘generic’ assessment task words such as ‘discuss’ and ‘critically evaluate’ are integral to higher education assessment. Although sources such as study skills guides give generic decontextualised glossaries of these words, much research rightly argues for greater dialogue between students (particularly ‘non-traditional’ students) and lecturers to help students understand and use such words. This paper presents the results from ‘staged’ focus groups with lecturers and students from the UK and China that created a forum for such dialogue, where many of these words and their interpretations were talked about. Results show very different interpretations, informed by factors such as ‘language’, ‘culture’ and ‘subject’. We propose these factors be used in an ‘anti-glossary’ approach, which we describe here. This approach is not against glossaries per se, but counteracts the assumption that glossary definitions are explicit, and adopts a social constructivist contextualisation of the task words through teacher-led dialogue.     

Formative self-and peer assessment for improved student learning: the crucial factors of design,teacher participation and feedback

Self and peer-assessment are becoming central aspects of student-centred assessment processes in higher education. Despite increasing evidence that both forms of assessment are helpful for developing key capabilities in students, such as taking more responsibility for their own learning, developing a better understanding of the subject matter, assessment criteria and their own values and judgements, and developing critical reflection skills, both forms of assessment are still not the norm at universities. This paper provides the findings of a two-year study of formative self and peer-assessment at an Australian university. The study supports other research showing that students tend to regard formative self and peer-assessment as beneficial for gaining more insights about the assessment process and for improving their own work. We argue that self and peer-assessment requires careful design and implementation for it to be an effective tool for formative assessment processes; and that the development of students’ capacities for giving feedback, and the continuous and timely involvement of the teacher, are central aspects for successful self and peer-assessment. The move to self and peer-assessment is not simple for teachers and students but is worthwhile and necessary for twenty-first century higher education.     

独立学院大学英语形成性评价实证研究——以宁夏大学新华学院为例

目前我国独立学院大学英语教学工作的一个突出问题,是过分注重终结性教学评价,轻形成性教学评价。本文尝试运用形成性评价与终结性评价有机结合的方式进行教学改革,在改革过程中发现问题,解决问题,以期推动独立学院大学英语教学评价体系顺利进行。     

Using formative assessment to promote argumentation in a university bilingual science course

Formative assessment, bilingualism, and argumentation when combined can enrich bilingual scientific literacy. However, argumentation receives little attention in the practice of bilingual science education. This article describes the effect of a formative assessment-based pedagogical strategy in promoting university students’ argumentation. It examines the written and oral arguments produced by 54 undergraduates (28 females and 26 males, 16–21 years old) in Colombia during a university bilingual (Spanish-English) science course. The data used in this analysis was derived from students’ written responses, and audio and video recordings. The first goal of this study was to determine how this teaching strategy could help students increase the use of English as a means of communication in argumentation in science. The second goal was to establish the potential of the strategy to engage students in argumentative classroom interactions as an essential part of formative assessment. The findings show that the strategy provided participants with opportunities to write their argumentation in Spanish, in English and in a hybrid version using code-switching. Educational implications for higher education are discussed.