A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies

National curricula need to change drastically to comply with the competences needed for the 21^st century. In this paper eight frameworks describing 21^st century competences were analysed. A comprehensive search for information about 21^st century competences was conducted across the official websites of the selected frameworks, resulting in 32 documents that were analysed in detail. Travers and Westbury’s framework of curriculum representations was used to determine horizontal and vertical consistency between the frameworks. The frameworks were compared on their underlying rationales and goals, their definition of 21^st century competences, and the recommended strategies for the implementation and assessment of these skills in educational practice. In addition three international studies were examined to analyse how various countries (EU member states, OECD countries) and schools (SITES studies) deal (or not) with 21^st century competences. The findings indicate a large extent of alignment between the frameworks about what 21^st century competences are and why they are important (horizontal consistency), but intentions and practice seemed still far apart, indicating lack of vertical consistency. The implications of the implementation of 21^st century competences in national curriculum policies are discussed and recommendations are provided.     

Exploring the role of assessment criteria during teachers’ collaborative judgement processes of students’ portfolios

Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition. This study aims to identify whether assessment criteria can improve content, argumentation and communication during teacher moderation while judging student portfolios. Six teachers scored 32 student portfolios in dyads with and without assessment criteria. Their judgement processes were qualitatively analysed. Results indicated that the quality of their judgement processes was low, since teachers based their judgements mainly on their own personal opinion and less on evidence found in the portfolio. Teachers barely paid attention to quality checks and easily agreed with each other. When teachers used assessment criteria, the quality of their judgements slightly improved. They based their judgements more on relevant evidence, used less personal experiences and more often checked the quality of their judgement processes. It is concluded that the quality of teacher portfolio judgement is low, and that the use of assessment criteria can enhance its quality.     

Towards an integrated model for developing sustainable assessment skills

One of the goals of current education is to ensure that graduates can act as independent lifelong learners. Graduates need to be able to assess their own learning and interpret assessment results. The central question in this article is how to acquire sustainable assessment skills, enabling students to assess their performance and learning throughout life, and preparing them to meet their own future learning needs. This article presents an integrated model for developing sustainable assessment skills, consisting of three components: conditions necessary for the development of sustainable assessment skills, elements of sustainable assessment and instructional methods for guiding students in the development of sustainable assessment skills. The article concludes with suggestions for future research to further develop the proposed model.     

大学英语网络自主学习有效评价机制探究

评价是大学英语教学的一个重要组成部分,科学的评价体系是实现大学英语教学目标的有利保障。目前,在培养学生英语自主学习能力这一大学英语教学改革的前提下,基于多媒体和网络的大学英语网络自主学习模式被广泛应用于大学英语教学中。基于此背景,该文重点研究了如何将结性评价与形成性评价有机结合,建立有效的大学英语网络自主学习评价体系,以消除自主学习过程中可能出现的消极因素,提高学生参与自主学习的积极性、稳定性及学习效率。     

An outcome-based assessment process for accrediting computing programmes

The calls for accountability in higher education have made outcome-based assessment a key accreditation component. Accreditation remains a well-regarded seal of approval on college quality, and requires the programme to set clear, appropriate, and measurable goals and courses to attain them. Furthermore, programmes must demonstrate that responsibilities associated with the goals are being carried out. Assessment leaders face various challenges including process design and implementation, faculty buy-in, and resources availability. This paper presents an outcome-based assessment approach that facilitates faculty participation while simplifying the assessment and reporting processes through effective and meaningful visualisation. The proposed approach has been implemented and used for the successful ABET accreditation of a computer science programme, and can be easily adapted to any higher education programme.     

Measuring Young People's Citizenship Competences

Citizenship has recently been introduced into the educational curriculum. Instruments to determine the effects of citizenship education are scarce. In this article, the concept of citizenship competences is explored in order to develop a measurement instrument. Four social tasks were derived from the literature as representative of young people's citizenship practices: acting democratically, acting in a socially responsible manner, dealing with conflicts, and dealing with differences. What adequate fulfilment of each social task presupposes in terms of knowledge, attitudes, skills, and reflection is defined per task and operationalised into items for a questionnaire. The sample (N = 16,000) concerns a representative sample of students in grade 6 and grade 9. Confirmatory factor analyses were conducted to determine the extent to which the structure in the data corresponded to the structure expected on theoretical grounds. The study reveals a reliable and valid instrument for the measurement of young people's citizenship competences. Future research should provide insight into how these competences relate to citizenship behaviour and whether measures of citizenship competences and behaviour will help schools to evaluate the effectiveness of their efforts.     

Laboratory assessment in chemistry: an analysis of the adequacy of the assessment process

The requirement that universities prepare students in practical competences, and assess the extent to which pre‐established objectives are achieved, is generally accepted to be of growing importance. As a result, on one hand, there is an increasing volume of research related to task performance in assessment. On the other hand, there are comparatively few studies which analyse the assessment process in a laboratory context. The laboratory offers itself as an educational and training tool of some importance, both in chemistry and in the experimental sciences in general. Studies which have been carried out to date into the importance of laboratory work as a source of value added have, however, been far from conclusive. This research uses interviews with laboratory teachers to analyse the typology of the competences which enter the assessment process, and to determine the extent to which the laboratory assessment process complies with standard validity requirements. Results obtained show that laboratory assessment in chemistry allows for a valuation of the degree of integration of theory and practice, and of the level of development of professional competence in the laboratory. Current assessment strategies do not, however, include all the competences developed in the laboratory context, nor are they sufficiently reliable to offer accreditation of those that are assessed.     

证据中心设计理论在PISA2021创造性思维测评中的应用及其启示

创造性思维是一种复杂的高阶能力,如何测评一直是教育测量的热点和难点之一。PISA2021创造性思维测评基于证据中心设计(ECD)理论设计和研制创造性思维测评工具。介绍ECD理论如何运用于PISA2021创造性思维这一高阶能力的测评,并从证据驱动实现测评标准实证化、信息技术增强促进测评问题情境化、多模态数据收集与证据多元化3个方面为我国基础教育素养测评提供参考建议。     

Assessing coping in children and adolescents: Research and practice

Although standardized and psychometrically-sound instruments for assessing children's coping are essential to both clinical practice and theory development, there have been few systematic efforts to design such measures. This review of assessment instruments compatible with the Lazarus and Folkman (1984) formulation of coping reveals a limited number of instruments but great diversity in the types of techniques employed to assess the coping of children and adolescents. Types of measures critiqued include projective techniques, interviews, questionnaires, and behavioral observation scales. A comprehensive assessment procedure is proposed and suggestions for future research are discussed.     

Implementation of criteria and standards-based assessment: an analysis of first-year learning guides

Assessment expectations are communicated to students in various ways and at different points in the semester. The provision of written information in learning guides given to students at the start of semester articulates what they are to do and how well they are to perform in assessment tasks. This paper examines how assessment expectations at an Australian university were communicated by staff in 159 first-year units (subjects) in the first year of university-wide implementation of criteria and standards-based assessment and learning guides policies. A framework was developed to analyse the extent and types of assessment information provided in learning guides. The paper provides a snapshot of the types of assessment used in the first year, including exams and analytical, reflective and authentic tasks. The paper contributes to an understanding of how university-wide assessment policy implementation can be evaluated through an examination of documents produced by staff.     

基层检察系统绩效考核的理念、制度与创新——以云南省基层检察院为例

我国的人民检察院是国家的法律监督机关,行使国家的检察权。检察机关既是司法机关,又具有某些行政的特征。基层检察系统绩效考核目标应当包括政治目标、法律目标、政策目标与技术目标。考核手段应当基于行为、基于业绩或者基于关系。现行的考核办法存在一系列问题,可以通过思路和制度的创新予以逐步完善。     

Competences for Learning to Learn and Active Citizenship: different currencies or two sides of the same coin?

In the context of the European Union Framework of Key Competences and the need to develop indicators for European Union member states to measure progress made towards the 'knowledge economy' and 'greater social cohesion' both the learning to learn and the active citizenship competences have been highlighted. However, what have yet to be discussed are the links and the overlaps between these two competences. Based on the development of research projects on these two fields, this article will compare the two sets of competences, both qualitatively and quantitatively. It will describe how the values and dispositions that motivate and inform active citizenship and learning to learn are related to each other, both empirically and theoretically. Both these competences are tools for empowering individuals and giving them the motivation and autonomy to control their own lives beyond the social circumstances in which they find themselves. In the case of active citizenship, the ability to be able to participate in society and voice their concerns, ensure their rights and the rights of others. In the case of learning to learn to be able to participate in work and everyday life by being empowered to learn and update the constantly changing competences required to successfully manage your life plans. When measuring both these competences then certain values relating positively towards democracy and human rights are common in their development.     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

Ethnic diversity in schools and bi-ethnic Dutch students’ educational outcomes and social functioning

The present study examined the relationship between ethnic diversity in school and educational outcomes, social-emotional functioning, and citizenship competences for bi-ethnic students. The focus of this study is bi-ethnic children with 1 non-migrant parent (with 2 non-migrant grandparents) and 1 migrant parent (with 2 foreign grandparents). It was found that the educational outcomes, social-emotional functioning, and citizenship competences of bi-ethnic students were not related to ethnic diversity. We also focused on the relationship between ethnic diversity in school and educational outcomes, social-emotional functioning, and citizenship competences for mono-ethnic students to determine whether this relationship is different for bi-ethnic and mono-ethnic students. Whereas the relationship was not significant for mono-ethnic minority students, mono-ethnic majority students’ educational outcomes, social-emotional functioning, and citizenship competences were related to a school’s ethnic diversity. This study indicates that the outcomes and social functioning of bi-ethnic students are not related to attending an ethnically diverse school.     

Assessing Key Competences across the Curriculum — and Europe

The development of key competences for lifelong learning has been an important policy imperative for EU Member States. The European Reference Framework of key competences (2006) built on previous developments by the OECD, UNESCO and Member States themselves. It defined key competences as knowledge, skills and attitudes applied appropriately to contexts. Now most Member States have incorporated key competences, or similarly broad learning outcomes, into their school curriculum frameworks. This is a necessary but insufficient step towards implementation; for the effective development of learners' key competences, assessment must also change. This article focuses on the challenge of assessing cross-curricular key competences in primary and secondary education. It is based on a major study for the European Commission (Gordon, et al., 2009), which drew on information gathered and validated with the help of experts in each of the 27 EU Member States. The study's typology of assessment provides a basis for reviewing some recent developments in Member States. Present challenges and innovative responses are addressed, including ‘unpacking’ key competences, ‘mapping’ them to contexts and ‘accessment’ of their full scope and range. Policy developments are considered in the context of the author's work with the European Commission's Thematic Working Group on the assessment of key competences. The article concludes with considerations for policy and practice.     

Teacher and student perceptions of intermediate assessment in higher education

Universities introduce intermediate assessment because it is understood to have positive effects on student behaviour and achievement. Yet, how intermediate assessment is perceived might be conditional for its success. The current study investigates both teachers’ and students’ perceptions of intermediate assessment. Teachers and students were interviewed and Student Evaluations of Teaching were examined. Results indicate that both teachers and students had generally positive perceptions of intermediate assessment. However, the two groups provided different reasons for their positive perceptions. Teachers and students agreed that intermediate assessment helps students to keep up with their study work. Moreover, teachers mentioned that they could assess various knowledge and skills with intermediate assessment, whereas students preferred intermediate assessments to test the same knowledge and skills as the final exam. This finding suggests that teachers and students in our study had different goals for intermediate assessment.     

Aligning assessment with the needs of work-integrated learning: the challenges of authentic assessment in a complex context

Abstract

Work-integrated learning (WIL) is a feature of university courses, both in professional areas, where it is commonplace, but also across many different disciplines. Assessment of WIL can be complex as it involves parties and settings external to the university, and it can be problematic because of difficulties in aligning learning activities during placements with what is or can be assessed by the university. This paper explores the relationship between students’ placement experiences and accompanying assessments in contexts where activities are tightly coupled with the curriculum, and in those where it is not. It draws on a qualitative analysis of student interviews and drawings by the interviewees of their WIL experiences, supplemented with analysis of unit guides. Our findings highlight that students’ perceptions of authenticity of assessment were undermined by misalignments between the student, university and industry. Assessment authenticity was perceived by students as based on alignment between their current and future selves in the assessment process, involvement of industry supervisors and relevance of placement activities to assessment activities. The paper discusses the complexity of coordination of educational activities with external partners, especially when one party drives assessment. It then suggests a reframing of WIL assessment to promote alignment and authenticity.     

Assessment of Phonological Awareness: Review of Methods and Tools

The importance of phonological awareness to the acquisition and development of reading skills is well documented. Recent attention to the critical nature of phonological awareness has highlighted the need for appropriate assessment tools. This article reviews the current state of phonological awareness assessment by examining norm-referenced, criterion-referenced, and curriculum-based instruments available for practitioners' and researchers' use. Prior to discussing specific assessment types, additional information about phonological awareness is provided, including a definition of phonological awareness, an overview of the relationship of phonological awareness to reading ability, factors influencing what to assess, and an overview of the effectiveness of phonological awareness training. Information about specific assessment instruments include technical adequacy, intended use, and limitations. Implications for practice are presented.     

The whole is greater than the sum of its parts: a large-scale study of students’ learning in response to different programme assessment patterns

Audits of 23 degree programmes in eight universities showed wide variations in assessment patterns and feedback. Scores from Assessment Experience Questionnaire returns revealed consistent relationships between characteristics of assessment and student learning responses, including a strong relationship between quantity and quality of feedback and a clear sense of goals and standards, and between both these scales and students’ overall satisfaction. Focus group data helped to explain students’ learning responses but also identified ambivalent responses to the use of formative-only assessment, particularly when it was optional. Frequently, students were unclear about goals and standards, and found feedback unhelpful when assessment demands differed across modules, and when marking standards and approaches varied widely, making it difficult for feedback to feed forwards. The methodology underpinning the Transforming the Experience of Students through Assessment study described here has been used in more than 20 universities worldwide and is helping teachers to redesign assessment regimes, so that teachers’ efforts support learning better.     

Responsible research and innovation indicators for science education assessment: how to measure the impact?

ABSTRACT

The emerging paradigm of responsible research and innovation (RRI) in the European Commission policy discourse identifies science education as a key agenda for better equipping students with skills and knowledge to tackle complex societal challenges and foster active citizenship in democratic societies. The operationalisation of this broad approach in science education demands, however, the identification of assessment frameworks able to grasp the complexity of RRI process requirements and learning outcomes within science education practice. This article aims to shed light over the application of the RRI approach in science education by proposing a RRI-based analytical framework for science education assessment. We use such framework to review a sample of empirical studies of science education assessments and critically analyse it under the lenses of RRI criteria. As a result, we identify a set of 86 key RRI assessment indicators in science education related to RRI values, transversal competences and experiential and cognitive aspects of learning. We argue that looking at science education through the lenses of RRI can potentially contribute to the integration of metacognitive skills, emotional aspects and procedural dimensions within impact assessments so as to address the complexity of learning.