Linking a learning progression for natural selection to teachers' enactment of formative assessment

Learning progressions, or representations of how student ideas develop in a domain, hold promise as tools to support teachers' formative assessment practices. The ideas represented in a learning progression might help teachers to identify and make inferences about evidence collected of student thinking, necessary precursors to modifying instruction to help students advance in their learning. The study reported in this article took the novel approach of using a learning progression for natural selection to support teachers' enactment of formative assessment. Sources of data include interviews and videotapes of six high school biology teachers leading assessment conversations around the same formative assessment questions. Results indicate that while teachers picked out and made inferences about student ideas related to the learning progression during assessment conversations, they did not use all parts of the learning progression in the same way. Furthermore, several of the teachers seemed to use the learning progressions simply as catalogs of misconceptions to be “squashed” rather than drawing upon the developmental affordances offered by a learning progression. Results are framed in terms of the utility of learning progressions as supports for classroom practice. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1181–1210, 2012     

Feeding forward from summative assessment: the Essay Feedback Checklist as a learning tool

Owing to the increasing diversity of assessments in higher education, feedback should be provided to students in a format that can assist future and alternative work. This study aimed to assess the effectiveness of the Essay Feedback Checklist on future alternative assessments. Participants were assigned to one of two groups, one of which completed the checklist prior to assessment 1 (essay) and received feedback using this method. Attainment on assessment 1 and assessment 2 (examination) were taken as pre- and post-test scores. Results revealed increased assessment scores for the checklist group, compared to those who received conventional feedback. Focus group data indicated that students particularly liked elements of the checklist as a feedback method, but potential drawbacks were also highlighted. Implications and future use of the checklist is then discussed.     

形成性评价在大学英语教学中的实践意义

形成性评价在大学英语教学中具有重大的实践意义,最主要的功能是帮助教师了解学生进展,进而调整改进教学工作。     

A model formative assessment strategy to promote student-centered self-regulated learning in higher education

Adult learners are already involved in the process of self-regulation; hence, higher education institutions should focus on strengthening students＇ self-regulatory skills. Self-regulation can be facilitated through formative assessment. This paper proposes a model formative assessment strategy that would complement existing university teaching, and can be used in higher education to promote student-centered self-regulated learning with minimal effort and time input from teachers. Based on this model, a real-world teaching example on writing an essay as a challenge task has also been developed. This model strategy incorporates Nicol and Macfarlane-Dick＇s seven principles of good feedback practice that promotes self-regulation.     

Innovative assessment paradigm to enhance student learning in engineering education

Incorporation of student self-assessment (SSA) in engineering education offers opportunities to support and encourage learner-led-learning. This paper presents an innovative assessment paradigm that integrates formative, summative, and SSA to enhance student learning. The assessment innovation was implemented in a senior-level civil engineering design course. Direct evidence of the impact of employing this innovation on student learning and achievement was derived by monitoring student academic performance in direct assessment tasks throughout the semester. Students’ feedback demonstrated the effectiveness of this innovation to improve their understanding of course topics build their autonomy, independent judgement, and self-regulated learning skills.     

Students' illustrations of the human nervous system as a formative assessment tool

The purpose of this study was to explore students' knowledge and learning of the human nervous system (HNS) in an introductory undergraduate Human Anatomy and Physiology course. Classroom observations, demographic data, a preinstructional unit test with drawings, and a postinstructional unit test with drawings were used to identify students' overall knowledge and learning during the unit of study. Quantitative and qualitative analysis indicate that students have an initially poor understanding of the nervous system with many prevailing alternative conceptions. These alternative conceptions include both structural and functional components and often incorporate colloquial use of language. Findings reveal students include the heart as a major component of the HNS, a reflex arc illustrated by the action rather than structure, and types of neurons (unipolar, bipolar, or multipolar) differentiated by charge or number of cell bodies rather than structural arrangement. Classroom instruction coupled with concurrent laboratory participation provided experiences for students to overcome some of their alternative conceptions. The finding of this research suggest that instructors should be aware of the students' prevailing alternative conceptions prior to instruction and that use of drawings as a formative assessment tool is an excellent way to collect such information. Anat Sci Educ 3:227–233, 2010. © 2010 American Association of Anatomists.     

Classroom assessment as the co-regulation of learning

ABSTRACT

Until recently, the classroom assessment literature has emphasized the role of teachers and tests, for example investigating teachers’ assessment practices or the quality of classroom tests and other assessments. In contrast, current understandings of teaching and learning emphasize the role of students, as well as the complex interactions between teachers, students, and contexts. We use the literature review method to give substance to a theory of classroom assessment as the co-regulation of learning by teachers, students, instructional materials, and contexts. We organize the literature using a version of Pintrich and Zusho’s theory of the phases and areas of the self-regulation of learning, expanded to include the co-regulation of learning, in order to demonstrate how classroom assessment is related to all aspects of the regulation of learning. We conclude that this is a useful expansion for the field.     

Using formative assessment to promote argumentation in a university bilingual science course

Formative assessment, bilingualism, and argumentation when combined can enrich bilingual scientific literacy. However, argumentation receives little attention in the practice of bilingual science education. This article describes the effect of a formative assessment-based pedagogical strategy in promoting university students’ argumentation. It examines the written and oral arguments produced by 54 undergraduates (28 females and 26 males, 16–21 years old) in Colombia during a university bilingual (Spanish-English) science course. The data used in this analysis was derived from students’ written responses, and audio and video recordings. The first goal of this study was to determine how this teaching strategy could help students increase the use of English as a means of communication in argumentation in science. The second goal was to establish the potential of the strategy to engage students in argumentative classroom interactions as an essential part of formative assessment. The findings show that the strategy provided participants with opportunities to write their argumentation in Spanish, in English and in a hybrid version using code-switching. Educational implications for higher education are discussed.     

Building upon synergies among self-regulated learning and formative assessment research and practice

ABSTRACT

The synergies that result from synthesising conceptual models and findings from self-regulated learning and formative assessment research are launching a new era of scholarship. They drive new questions about how to help students to internalise complimentary self-regulatory and assessment knowledge, skills, and dispositions as well as how to prepare teachers and education systems to prioritise and support this work. The articles in this special issue illustrate the power and importance of studying how self-regulation and classroom assessment emerge from social, contextual, historical, and cultural factors. Four themes emerged from the articles in this special issue, including new conceptualisations of self-regulated learning and formative assessment, insights regarding teachers’ dual role in enacting and promoting self-regulation, recognition of the critical role of students’ ability to productively use assessment information, and the need to instantiate self-regulated learning and assessment literacy as formal and valued curricular outcomes.     

加强形成性评价 提高英语学习成效——探索提高英语B级测试成绩的途径

形成性评价是以学生为中心、注重能力培养的一种教学方式。在高职英语教学中,通过实施对学生课堂学习行为、课堂活动参与及作业的评价,建立学生学习档案,实行以评价学习过程为主的评价标准,能有效地提高学生英语B级测试成绩,极大地调动学生学习的积极性。     

Investigating the dynamics of formative assessment: relationships between teacher knowledge,assessment practice and learning

This exploratory study of elementary school science examines questions central to policy, practice and research on formative assessment: What is the quality of teachers’ content-pedagogical and assessment knowledge? What is the relationship between teacher knowledge and assessment practice? What is the relationship between teacher knowledge, assessment practice and student learning? Drawing on multiple measures, hierarchical linear modelling and path analysis, results suggest that despite weaknesses in teachers’ content-pedagogical and assessment knowledge, teachers’ formative assessment practices are positively related to student learning. Relationships between teachers’ knowledge and assessment practices are mixed. Findings underscore both the potential and challenge of bringing effective formative practice to fruition as well as the need for continued research.     

Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment

This study compares students’ experiences of two types of criteria-based assessment: in-text commentary and rubric-articulated feedback, in an assessment design combining the two feedback channels. The main aim is to use students’ responses to shed light on how feedback strategies for formative assessment can be optimised. Following action research methodology, the study discusses key categories of student responses from three sources: reflective texts, a questionnaire, and interviews. Results show that different functions were attributed to the two feedback channels: in-text commentary to lower-order concerns related to language proficiency, and rubric-articulated feedback to higher-order concerns related to an overview of writing achievement. We argue that the different functions have the potential of creating a sufficiently balanced assessment design with the possibility of serving both short-term and continuous learning goals. On the other hand, some students found it difficult to navigate between the two feedback channels. The article therefore ends with a ‘lessons learned’ section where we list possible ways in which the current assessment design can be improved for optimal use of the synergy effects emanating from a combination of in-text commentary and rubric-articulated feedback for formative purposes.     

The assessment cycle: a model for learning through peer assessment

This paper advances a model describing how peer assessment supports self-assessment. Although prior research demonstrates that peer assessment promotes self-assessment, the connection between these two activities is underspecified. This model, the assessment cycle, draws from theories of self-assessment to elaborate how learning takes place through peer assessment. The model is applied to three activity structures described in the literature to analyse their potential to support learning by promoting self-assessment. Broadly speaking, the model can be used to understand learning that takes place in a variety of peer assessment activities: marking/grading, analysis, feedback, conferencing and revision. This approach contrasts most studies on peer assessment, which have focused on calibration of instructor and peer grades, rather than learning opportunities.     

Feedback as dialogue: exploring the links between formative assessment and social software in distance learning

The paper explores the relationship between formative assessment and social software. Formative assessment practices though beneficial for student learning become marginalised and constrained in open and distance learning environments in higher education. Feedback is a key factor in formative assessment and learners can benefit from the deployment of emerging technologies and the opportunities for participation and dialogue afforded by social software. This paper explores and proposes a conceptual framework for this relationship. The claim is that the social dimensions of emerging technologies – specifically, blogs and wikis – allow for formative assessment practices to be re‐invented or at the very least facilitated by essentially participative and student‐focussed interventions. A comparison of these technologies against formative assessment mechanisms identifies the types of processes that these new tools might best support to encourage effective feedback approaches that both empower the learner and enhance their learning experience.     

Teachers’ beliefs about inquiry-based learning and its impact on formative assessment practice

ABSTRACT

Background

Inquiry pedagogy has been advocated as means to engage and motivate students to learn science. The development of teacher formative assessment practice in inquiry is key for a successful implementation of student-centred inquiry pedagogy in the classroom.     

Teacher agency within the context of formative teacher assessment: an in-depth analysis

Teachers’ agency has an effect on their own learning process at the workplace. In this study we explored the extent to which teachers participating in a formative teacher assessment procedure developed a sense of agency. We investigated not only whether teachers participating in a such an assessment procedure experienced agency and thus felt in control of the learning process and able to pursue their learning objectives, but also whether agency was visible, by looking at decision-making in real time: did teachers take an active role in their own assessment, especially regarding the learning objectives to be pursued, during the assessment meetings? We found that teachers experienced a high level of agency while participating in the assessment procedure, but did not consistently show this during the assessment procedure.     

From course assessment to redesign: a hybrid-vehicle course as a case illustration

Assessment has become a central aspect of engineering education for evaluating student learning, attaining accreditation, and ensuring accountability. However, the final step of the assessment process, which requires assessment results be used to redesign courses and programmes, is appreciably underdeveloped in the literature. As such, this work suggests a process, based on the engineering problem-solving method, to analyse and act on problems and successes identified in the assessment results. The process is illustrated through an application to Colorado State University's new programme for Hybrid-Electric Vehicle Engineering, for which the redesign process was originally created. Readers will benefit by simplifying and systematising the essential aspect of the assessment process – application to course redesign – for use in both research and practice applications.     

Assisting learning in e-assessment: a closer look at educational supports

This study analyses the educational support offered through information and communication technology during formative assessment in two different cases in higher education. We analysed one blended and one virtual case from two different universities. The study aimed at identifying specific patterns of educational support intended to foster two interaction processes: (1) the promotion of greater autonomy in the students and (2) the construction of more appropriate meanings by them. The analysis showed that these two processes were achieved with different attainment levels in each of the two study cases. Specific patterns of support mediated by technology were found underlying these different results. This led us to identify ‘suitable’ and ‘undesirable’ patterns of support in e-assessment practices.     

Conceptions of assessment: trainee teachers' practice and values

This study examines the values and practice in relation to assessment of a sample of 220 trainee teachers studying for a Postgraduate Certificate in Education, an initial teacher training and education (ITET) course, at the University of Cambridge, UK. The survey instrument was drawn from James and Pedder (2006 James, M. and Pedder, D. 2006. Beyond method: Assessment and learning practices and values. The Curriculum Journal, 17(2): 109–138. [Taylor & Francis Online] , [Google Scholar]), and was composed of questionnaire items that sought to elicit how trainees valued different classroom assessment practices, and the extent to which their own teaching complied with such values. The study draws additionally on the findings of James and Pedder (2006 James, M. and Pedder, D. 2006. Beyond method: Assessment and learning practices and values. The Curriculum Journal, 17(2): 109–138. [Taylor & Francis Online] , [Google Scholar]) to compare and contrast results with those for qualified teachers. Item and factor analyses revealed three dimensions that underpin trainees' classroom practice and values (promoting learning autonomy, performance orientation, making learning explicit). Values-practice gaps were greatest on promoting learning autonomy and performance orientation. Trainees valued practices associated with the former more than they implemented them in their teaching, while they implemented practices associated with the latter more than predicted by their values. Values-practice gaps suggested that trainees were constrained from implementing their values to a greater extent than qualified teachers, particularly with respect to these two factors.     

Designing and implementing peer formative feedback within online learning environments

With increasing need to achieve appropriate balance between learning support and self-regulation within the context of online learning, formative feedback has been identified as a viable means to achieve meaningful engagement. Specifically, this study sought to establish how peer–peer formative feedback was facilitated in an online course and to what extent this engaged students in meaningful learning experiences. This case study entailed an in-depth investigation into the design and implementation of an online course in a New Zealand university. The studied course was part of a postgraduate programme in continuing (in-service) teacher education. The study adopted a case study methodology with a bias on qualitative techniques. Online observations, analysis of the archived course discourse and interviews were utilised as sources of data. The data from multiple sources were subsequently triangulated to corroborate the evidence. The findings indicate that peer formative feedback promoted active learners’ participation and meaningful engagement. The findings further showed that opportunities for dialogic peer formative feedback promoted learning support and self-regulation.