Academics’ conceptions of assessment and their assessment practices

The present study focuses; firstly, on analysing academics’ conceptions of the purpose of assessment; secondly, on their assessment practices; and thirdly, on the relationship between their conceptions and practices. The data consisted of interviews with 28 pharmacy teachers. The analysis resulted in a continuum of categories of conceptions, from reproductive conceptions with an emphasis on measuring the reproduction of correct information, to more transformational conceptions with an emphasis on the development of students’ thinking and understanding. Although broad variation in assessment practices was recognised, teachers mostly described the use of traditional forms of assessment. Analysis of the relationship between conceptions and practices revealed high consistency between conceptions and practices.     

Self‐assessment in university assessment of prior learning procedures

Competency‐based university education, in which lifelong learning and flexible learning are key elements, demands a renewed vision on assessment. Within this vision, Assessment of Prior Learning (APL), in which learners have to show their prior learning in order for their goals to be recognised, becomes an important element. This article focuses on a first step in APL, namely students’ self‐assessment of their prior learning before entering university education. The main aim of the presented study is to examine the suitability of the use of self‐assessment in APL. First, in an explorative study, the main sources for self‐assessment are derived and the relation between sources and domain of study is investigated. Second, in a pre‐test post‐test research design, the hypothesis that students’ self‐assessment of prior learning related to a course changes after studying a domain‐specific course is tested. Pre‐test results reveal that students indicate that they have prior knowledge related to the chosen university programme. In general, this prior learning is obtained from study experience, work experience, books, newspapers, magazines, the Internet, TV, radio, film or video. A relation is found between the type of source and the university programme. The hypothesis that students change their self‐assessment after a study period could not be confirmed. Based on these results, it is concluded that self‐assessment in APL might be a suitable tool. Implications for further research are discussed.     

Students’ views of oral performance assessment in mathematics: straddling the ‘assessment of’ and ‘assessment for’ learning divide

This paper explores the views of a group of students who took an oral performance assessment in a first-year mathematics module. Such assessments are unusual for most subjects in the UK, but particularly within the generally homogenous assessment diet of undergraduate mathematics. The evidence presented here resonates with some, but not all, of the existing literature on oral assessment and suggests that, despite concerns about anxiety and fairness, students see oral assessments as encouraging a focus on understanding, being relatively authentic and reactive to their needs. We argue that, suitably implemented, oral assessment may be a viable assessment method for straddling the ‘assessment for’ and ‘assessment of’ learning divide in higher education.     

Variation in the development of teachers’ understandings of assessment and their assessment practices in higher education

This paper reports a study into the development of staff understanding of assessment and assessment practice. Eight teachers from two universities constructed an initial concept map about assessment that was discussed in a one-to-one semi-structured interview. A year later, a new map was created and the interview focused on change in thinking and practice. Multiple models of assessment were evident in the participants’ understandings at the same time and change was characterised by subtle evolution in thinking. Development in practice was more significant and often associated with the foregrounding of assessment for learning. Vignettes are used to illustrate the variation in nature and scale of development. Interplay between this development of practice and understanding was multidirectional and external context played an important role. The approach offers detailed insight into the relationship between assessment thinking and practice and demonstrates that both research and academic development need to go beyond conventional approaches to conceptualising the development of academics and take account of the finer grained complexities of assessment thinking and practices.     

Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.     

Student teachers’ appraisal of the importance of assessment in teacher education and self-reports on the development of assessment competence

Abstract

Competence in assessment has been identified as a key feature in teachers’ professional success. However, assessment competence is a complex field, comprising capacity in both summative and formative assessment. Hence, a detailed view on how student teachers perceive assessment is the focus of this study. Based on an official catalogue of assessment standards, over 900 student teachers repeatedly rated the importance of the standards and the frequency with which they behaved in accordance with the standards in practicum situations. Analyses revealed that (a) students perceived assessment competence as a contextual entity distinguishable from other domains, (b) while they assigned high importance ratings to assessment standards in general, standards concerned specifically with external evaluation were seen as relatively unimportant, and (c) they perceived a rise in their own assessment competence during their teacher education. Taken together, this suggests that in the student view assessment competence is important and develops over time.     

Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment

This study aims to provide a greater insight into how formative assessments are experienced and understood by students. Two different formative assessment methods, an individual, written assessment and an oral group assessment, were components of a pathology course within a medical curriculum. In a cohort of 70 students, written accounts were collected from 17 students and group interviews were carried out to explore the students’ experiences of these two forms of assessment. All students were engaged in both assessment methods, which were conducted a few weeks apart, and data were collected soon after each assessment. Our findings suggest that formative assessments motivate students to study, make them aware of what they have learned and where they need to study more. Thus, formative assessment can act as a tool for learning, contributing to the process and outcomes of learning. A closer look at students’ experiences of each form of assessment reveals interesting differences.     

Application of system dynamics for assessment of sustainable performance of construction projects

INTRODUCTION Sustainable development is commonly definedas meeting the needs of the present without compro-mising the ability of future generations to meet theirown needs (WCED, 1987). All industries, includingthe construction industry should contribute to themission. Compared to other industries, constructionactivities are generally considered to have more im-pact on the environment, which provides the basicconditions for the sustainability and development oflife on the Earth. The…     

Students’ assessment preferences, perceptions of assessment and their relationships to study results

The purposes of this study are to gain more insight into students’ actual preferences and perceptions of assessment, into the effects of these on their performances when different assessment formats are used, and into the different cognitive process levels assessed. Data were obtained from two sources. The first was the scores on the assessment of learning outcomes, consisting of open ended and multiple choice questions measuring the students’ abilities to recall information, to understand concepts and principles, and to apply knowledge in new situations. The second was the adapted Assessment Preferences Inventory (API) which measured students’ preferences as a pre-test and perceptions as a post-test. Results show that, when participating in a New Learning Environment (NLE), students prefer traditional written assessment and questions which are as closed as possible, assessing a mix of cognitive processes. Some relationships, but not all the expected ones, were found between students’ preferences and their assessment scores. No relationships were found between students’ perceptions of assessment and their assessment scores. Additionally, only forty percent of the students had perceptions of the levels of the cognitive processes assessed that matched those measured by the assessments. Several explanations are discussed.     

Construction of life cycle assessment software system platform

There has not been life cycle assessment (LCA) software applicable to China's products. To faciliate the development of LCA software system in China, we built an object-oriented LCA software system plantform based on LCA international standards ISO 14040 to ISO 14043 and the commonness of diverse products. The system includes six modules: disassembly module, data collection module, arithmetic module, drawing module, database module and control module. It evaluates all economic and environmental impacts during the whole life cycle of a product. The integrated life cycle inventory database system allows dynamic expansion, which makes the effort required for data collection reduce with the increase of the system's application. With the improvement of human environmental-awareness, the demand of environment-friendly products is increasing, and ecological design of products has become a critical part in products development. Consummation of the LCA software system will provide a powerful tool for designing and developing Chinese ecological products.     

A collaborative assessment of students’ placement learning

The research informing this paper set out to investigate the qualitative experiences of students, supervisors and tutors involved in a summative collaborative assessment of placement learning on an undergraduate professional qualifying programme in the UK. Analysis of data gathered through semi-structured interviews provides valuable insights into its use. In particular, engagement in a collaborative assessment brings a degree of exposure for all concerned. Participants need to feel ‘able’ to participate, and ability to participate is linked to notions of agency and autonomy. Collaborative assessment design needs to acknowledge power relations and include strategies to reduce imbalances. The importance of recognising and working with the complexities of assessment should not be underestimated. Criterion referencing offers a guide to support consistency but can also falsely present assessment as mechanistic and instrumental. The research shows that it is in the ‘doing’ of assessment that a ‘shared language’ is developed. It demonstrates the value of active student engagement in assessment in relation to the construction and use of theory, developing reflective practice and assessment literacy. The collaborative assessment provides students with the opportunity to experience a ‘performance of understanding’ in a community of practice that, whilst pressured, reflects ‘real’ professional life.     

Modes of modelling assessment—a literature review

This paper presents a critical review of literature investigating assessment of mathematical modelling. Written tests, projects, hands-on tests, portfolio and contests are modes of modelling assessment identified in this study. The written tests found in the reviewed papers draw on an atomistic view on modelling competencies, whereas projects are described to assess a more holistic modelling competence but obstacles regarding reliability of assessing projects are identified. The outcome of this investigation also indicates that the criteria used in frameworks or modes of assessment seldom are derived from a theoretical analysis, but more often based on ad hoc constructions, experience from assessment situations or empirical studies of students’ work. Finally, this study suggests that an elaborated view on the meaning of quality of mathematical models is needed in order to assess the quality of students’ work with mathematical models.     

Why school based assessment is not a universal feature of high stakes assessment systems?

Accepting that school based assessment may have the potential to bring additional reliability to the assessment outcomes of an educational system, this research uses Generalizability Theory to address the question “why school based assessment is not a universal feature of high stakes assessment systems”? Three major issues are identified: (a) there is a conflict between the psychometric model and classroom assessment practice; (b) different schools are not equally effective; and, (c) teachers’ judgments are frequently accused of being biased. The role of public examination boards is discussed in this context.     

Are assessment environments gendered? An analysis of the learning responses of male and female students to different assessment environments

There is considerable variation between male and female Bachelor degree performance at Oxford and Cambridge (Oxbridge) where male students attain more First and Third Class degrees and female students attain more Second Class degrees. Various hypotheses have been put forward to explain this phenomenon including the possibility that the distinctive Oxbridge assessment environment, very different from those at both pre‐ and post‐92 universities, might account for the difference. Data from the Assessment Experience Questionnaire (AEQ; Oxbridge, pre‐ and post‐92 universities, one science, one humanities and one applied social science subject from each) were analysed to determine gendered perceptions of the assessment environment. Significant gender differences were found on five AEQ scales (Quantity of effort, Coverage of syllabus, Quantity and quality of feedback, Use of feedback and Appropriate assessment) but there was no significant interaction between gender and university. Consequently, there were few clues in students' responses to confirm that the Oxbridge assessment environment explains gendered differences in degree performance.     

Students’ conceptions of assessment: Links to outcomes

Students conceive of assessment in at least four major ways (i.e., assessment makes students accountable; assessment is irrelevant because it is bad or unfair; assessment improves the quality of learning; and assessment is enjoyable). A study in New Zealand of 3469 secondary school students’ conceptions of assessment used a self‐report inventory and scores from a standardised curriculum‐based assessment of reading comprehension. Four inter‐correlated conceptions based on 11 items were found with good psychometric properties. A path‐model linking the four correlated conceptions with student achievement in reading, while taking into account student ethnicity, student sex, and student year, had good psychometric properties. The conception that assessment makes students accountable loaded positively on achievement while the three other conceptions (i.e., assessment makes schools accountable, assessment is enjoyable, and assessment is ignored) had negative loadings on achievement. These findings are consistent with self‐regulation and formative assessment theories, such that students who conceive of assessment as a means of taking responsibility for their learning (i.e., assessment makes me accountable) will demonstrate increased educational outcomes.     

University students’ perceptions of summative assessment: The role of context

We report on a mixed-method study that compared students’ perceptions of summative assessment across two distinct disciplines – education and mathematics, at two research-intensive institutions in the UK. The disciplines chosen represent opposing positions in Biglan’s classification of academic disciplines, as well as having very different assessment practices. Results suggest that these education students prefer to be assessed by methods they perceive to discriminate on the basis of academic abilities. Moreover, they perceive the traditional closed-book examination as inadequate to assess the capabilities which are key to being successful in their subject, which fits some but not all of the general findings in the literature. However, comparing these results with those of an identical study with mathematics students, we find that the perceptions of summative assessment are very different. We account for that difference by suggesting that students’ epistemic beliefs play a role in shaping these perceptions and conclude that, in designing summative assessment in higher education, generalised and centralised forces for change need to be tempered by contextual and disciplinary factors.     

Qualitatively different ways of experiencing student self‐assessment

In the literature, student self‐assessment as a practice and as a goal in higher education is generally emphasized for academics. This paper reports a study that investigates what academics emphasize in their experiences of student self‐assessment. The investigation focused on the different ways academics described their understanding and practise of self‐assessment. A phenomenographic approach was used to research and identify a set of progressive variations of academics’ ways of experiencing student self‐assessment. Altogether, 16 academics from a variety of disciplines and programs of study in three Australian universities participated in the investigation. The consequent research findings describe five qualitatively different conceptions that depict how academics understand and use student self‐assessment. These findings are subsequently discussed in terms of the potential for academics to understand and use student self‐assessment to enhance students’ self‐assessment ability, to further students’ lifelong learning and to empower, rather than discipline, students.