A five-dimensional framework for authentic assessment

Authenticity is an important element of new modes of assessment. The problem is that what authentic assessment really is, is unspecified. In this article, we first review the literature on authenticity of assessments, along with a five-dimensional framework for designing authentic assessments with professional practice as the starting point. Then, we present the results of a qualitative study to determine if the framework is complete, and what the relative importance of the five dimensions is in the perceptions of students and teachers of a vocational college for nursing. We discuss implications for the framework, along with important issues that need to be considered when designing authentic assessments.     

Successful learning: balancing self-regulation with instructional planning

Many recent studies have stressed the importance of teacher candidates’ (TCs) self-regulated learning (SRL) skills for successful learning. Because of the promising consequences of SRL for academic performance, teacher educators (TEs) are encouraged to increase TCs’ SRL opportunities in educational programs. Because of the difficulty and complexity for TEs to successfully guide TCs towards SRL, the present study contributes to the discussion how to best facilitate TEs in finding a balance between student- and teacher-control. For this purpose, a conceptual model is presented. The model draws upon literature related to the perspective of the learner, the teacher and the learning task. Besides the context of teacher education, the model is beneficial for higher education as well as teaching and teacher professionalization. It will help instructors provide a more balanced approach between teacher- and student-controlled learning, and support students develop essential SRL skills.     

Investigating Feedback on Practice Among Teachers: Coherence of Observed and Perceived Feedback

Despite that benefits of feedback in student learning are reported in much research, little has been reported regarding the use of feedback from teachers to other teachers—a key tool in professional development. In this study, we triangulated data from videotaped peer coaching sessions, questionnaires, and interviews regarding 12 primary school teachers in four peer groups in the Netherlands. We focused our research on two issues: the interplay of observed feedback dimensions and elements and perceptions of that feedback. Feedback dimensions were generally effective and the influence of the elements on the dimensions mostly aligned with the expectations. Teachers generally perceived feedback as effective. Moreover, effective observed feedback was perceived as effective. Findings indicate that peer coaches should stimulate coached teachers to become goal directed, specific, detailed, and neutral (neither positive nor negative) by using feedback elements so as to optimize feedback processes.     

真实评价设计的五维框架

真实性(authenticity)是新型评价模式的核心要素之一.然而,对于什么是真实评价,学术界还未予以充分具体的探索,更远未达成共识.本文在评述有关真实评价的研究文献基础上,讨论了教学、学习与评价的关系,论述了基于真实能力评价的意义,探讨了真实性和真实评价的定义,建构了面向专业实践能力发展的真实教学和真实评价设计的五维框架.结合真实教学的五维框架,重点论述了真实评价的五个维度:真实任务、物理情境、社会情境、评价结果/形式和评价标准,并且提出了设计或开发真实评价应当考虑的三大问题.     

Using Mind Maps to Make Student Questioning Effective: Learning Outcomes of a Principle-Based Scenario for Teacher Guidance

Research in Science Education - Student questioning is an important learning strategy, but rare in many classrooms, because teachers have concerns if these questions contribute to attaining...     

Process-oriented design principles for promoting self-regulated learning in primary teacher education

Many recent studies have stressed the importance of students’ self-regulated learning (SRL) skills for successful learning. Consequently, primary teacher educators have been encouraged by policy makers to increase their students’ SRL opportunities in educational pre-service programs. However, primary teacher educators often find it difficult to implement these innovations in their teaching. In the present study, a literature search concerning SRL was conducted. Based on this search, seven process-oriented design principles were formulated, resulting in an SRL model for primary teacher education. This SRL model provides more insight into relevant SRL aspects and can support SRL implementation in pre-service teacher education.     

Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks

Because learning and instruction are increasingly competence-based, the call for assessment methods to adequately determine competence is growing. Using just one single assessment method is not sufficient to determine competence acquisition. This article argues for Competence Assessment Programmes (CAPs), consisting of a combination of different assessment methods, including both traditional and new forms of assessment. To develop and evaluate CAPs, criteria to determine their quality are needed. Just as CAPs are combinations of traditional and new forms of assessment, criteria used to evaluate CAP quality should be derived from both psychometrics and edumetrics. A framework of 10 quality criteria for CAPs is presented, which is then compared to Messick's framework of construct validity. Results show that the 10-criterion framework partly overlaps with Messick's, but adds some important new criteria, which get a more prominent place in quality control issues in competence-based education.     

New Learning Design in Distance Education: The impact on student perception and motivation

Many forms of e‐learning (such as online courses with authentic tasks and computer‐supported collaborative learning) have become important in distance education. Very often, such e‐learning courses or tasks are set up following constructivist design principles. Often, this leads to learning environments with authentic problems in ill‐structured tasks that are supposed to motivate students. However, constructivist design principles are difficult to implement because developers must be able to predict how students perceive the tasks and whether the tasks motivate the students. The research in this article queries some of the assumed effects. It presents a study that provides increased insight into the actual perception of electronic authentic learning tasks. The main questions are how students learn in such e‐learning environments with “virtual” reality and authentic problems and how they perceive them. To answer these questions, in two e‐learning programs developed at the Open University of the Netherlands (OUNL) designers’ expectations were contrasted with student perceptions. The results show a gap between the two, for students experience much less authenticity than developers assume.     

Teachers’ opinions on quality criteria for Competency Assessment Programs

Quality control policies towards Dutch vocational schools have changed dramatically because the government questioned examination quality. Schools must now demonstrate assessment quality to a new Examination Quality Center. Since teachers often design assessments, they must be involved in quality issues. This study therefore explores teachers’ opinions on assessment quality evaluation criteria. Pre-vocational and vocational teachers (N=211$N=211$) responded to a questionnaire. Contrary to expectations, results show that teachers deem classical and competency-based quality criteria equally important. Vocational teachers gave higher importance scores than pre-vocational teachers, possibly due to the pressure they experience to improve the quality of their assessments.