Teachers’ practices in science learning environments and their use of formative and summative assessment tasks

This study was aimed at detecting the most frequently-used teaching and assessment activities in secondary school science classes, identifying links between these variables, and revealing possible challenges in these processes. To this end, data were gathered from 155 secondary school science teachers in 56 Israeli public schools and 380 grade eight and nine students from 22 of these using the What Is Happening In this Class? Teachers were also asked to indicate their perceptions of the extent to which they used formative assessment tasks provided by the curriculum and to specify, in their own words, the reason for insufficient usage of these tasks. Task orientation was highly used in science classes, whereas investigation was the least employed activity, according to both teachers’ and students’ perceptions. The most-frequently used tasks to evaluate students were final tests and quizzes. Path model analysis revealed that teachers who tended to use teacher-based approaches also employed traditional assessment tools, whereas teachers who allowed students to cooperate rather than compete with one another tended to use formative assessment tools. Implications limitations, and directions for future research are discussed.     

Teachers’ use of learning progression-based formative assessment to inform teachers’ instructional adjustment: a case study of two physics teachers’ instruction

ABSTRACT

To explore the affordances of learning progressions (LP) in support of teachers’ formal and informal formative assessment (FFA and IFA) practices, we conducted a case study with a fine-grain-sized energy LP. The study first theorises an LP-based formative assessment model, which proposes the use of LPs in clarifying learning objectives, eliciting and interpreting students’ understanding, and acting in instruction. Then, we examine multiple iterations of two high-school teachers’ lesson plans and their enactment of the lessons to identify the instructional adjustments teachers made as part of the LP-based FFA and IFA after professional training. We found that both teachers refined the learning objectives and activities and most of their adjustments promoted students’ learning progression; their adjustments have an interdependency between objectives and activities. Both made more adjustments in the IFA than in the FFA, but the alignment with the LP was higher in FFA than in IFA. Contrary to the researchers’ expectations, both teachers perceived the LP as a content structure. However, in practice, both employed it as a reference to interpret students’ responses by comparing these responses against their own expectations. The teachers also reported collecting assessment information during teacher-student interactive activities and using this material to infer the level of students’ understanding in order to decide on the next instructional activities. Both teachers reported that the process of directly engaging with the LP formatively resulted in their having a much more nuanced sense of students’ understanding when they revisited and altered the sequence of the learning activities.     

Teachers’ learning in a learning study

The point of departure in this study is the question: do teachers who develop theoretical knowledge of the variation theory change the way(s) they offer their pupils the object of learning due to the theoretical framework. The aim of the study is to describe this development, i.e. to find if and how teachers developed theoretical knowledge when planning instruction, and in what way(s) this has an impact on the pupils’ learning outcome when using contrasts in the instruction. The theoretical framework is strongly content related, and by analysing the learning object’s critical aspects the teachers are guided to focus on the content in this particular way. The question “what does it take to develop knowledge about the object of learning?” has to be answered by the teachers before choice of teaching method is made. The research method used is Learning Study, a fusion between lesson study and design experiment. The teachers (6) have carried out nine research lessons in three Learning Study cycles (containing three lessons each). The pupils belong to three different classes and are between 9 and 11 years old. The result shows how the teachers gradually use the variation theory when planning instruction and how the learning outcomes shown by the pupils improve. The developed theoretical insight seems to affect the teachers’ ways of seeing the object of learning, such as subtle changes of how to organize the critical features of the learning object, are discerned. In every learning study cycle contrasts are used in one lesson, and in the analysis of the effect of the contrasts, the two remaining lessons are used as control groups. The results show the impact of contrasts in the pupils’ learning outcomes. The need to complement a lesson study with a theoretical perspective on learning is that the teachers are then given the opportunity to make use of the theory when planning instruction individually, not only in a lesson study. There again, the Learning Study model seems to be a powerful model with which to develop teachers’ understanding of the theoretical framework.     

Teachers’ professional learning experiences and their engagement in reflective practice: a replication study

This study investigates the association between teachers’ exposure to different kinds of learning experiences and the degree to which they actively reflect on their teaching. We examine this association using data from 3 samples of teachers and schools in the United States. By examining multiple samples, we sought to strengthen the validity of our conclusions and understand whether and how the relationship between teachers’ engagement in reflection and their learning experiences varies across different kinds of work contexts. In all the 3 samples studied, we found that teachers engaged in reflective practice more often when they had more regular access to embedded learning opportunities which we define as collaborating with peers on instructional matters or working with instruction experts. This consistent result across all 3 samples suggests that embedded learning opportunities may provide a supportive context for teacher reflection across a range of settings.     

A case study of a formative assessment practice and the effects on students’ self-regulated learning

The study investigates one mathematics teacher’s implementation of formative assessment and its effects on students’ self-regulated learning (SRL). A questionnaire administered before and after the eight-month long intervention shows a significant effect, compared to two control classes, on students’ motivational beliefs involved in SRL. Qualitative data shows a notable enhancement of the students’ SRL behavior in the classroom. Analysis of the teacher’s implemented formative assessment shows a practice integrating several aspects of formative assessment, and provides empirical evidence of what formative assessment with large effects on students’ SRL may look like and how it fits with models of SRL development.     

Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment

This study aims to provide a greater insight into how formative assessments are experienced and understood by students. Two different formative assessment methods, an individual, written assessment and an oral group assessment, were components of a pathology course within a medical curriculum. In a cohort of 70 students, written accounts were collected from 17 students and group interviews were carried out to explore the students’ experiences of these two forms of assessment. All students were engaged in both assessment methods, which were conducted a few weeks apart, and data were collected soon after each assessment. Our findings suggest that formative assessments motivate students to study, make them aware of what they have learned and where they need to study more. Thus, formative assessment can act as a tool for learning, contributing to the process and outcomes of learning. A closer look at students’ experiences of each form of assessment reveals interesting differences.     

The relationship between students’ perceptions of portfolio assessment practice and their approaches to learning

This study focuses on students’ learning approaches in the context of a competency‐based program on Applied Sciences, with portfolio assessment as its core mode of assessment. The study examines students’ perceptions of these assessment practices and the relationships to their learning approaches. Additionally, differences in perceptions and learning approaches between first‐year students and second‐year students, who already have one year of experience with the portfolio assessment practice, are investigated. A total of 110 students completed two questionnaires at the end of the academic year: the Revised SPQ (Study process questionnaire) was used to measure their approaches to learning and the AEQ (Assessment experience questionnaire) was used to measure their perceptions of the assessment practice. The results indicate that, when implementing portfolio assessment, feedback is essential. Moreover, it seems not to be the assessment design, but rather how it is implemented, and how students’ learning is stimulated through the assessment, that influences the quality of learning.     

Teachers and testing: an investigation into teachers’ perceptions of formative assessment

Research conducted within the past decade contributes much to an understanding of the role and potential value of formative assessment in learning. As an Advisory Teacher within a local authority, the researcher was interested to find out how teachers actually perceive formative assessment. This study therefore set out to investigate the range and nature of such perceptions and whether any relationships exist between them and independent variables such as school phase and length of teacher experience. The sample was drawn from teachers working in 24 lower and middle schools within one local authority and the research was conducted in two phases. This paper will focus on Phase 1, during which data was drawn from a questionnaire survey which elicited both quantitative and qualitative responses from 67 teachers. Analysis of this data revealed a range of perceptions about formative assessment among teachers. In particular, they acknowledged the value of formative assessment in promoting learning. However, these findings suggest that perhaps teachers were less confident than they claimed to be in putting actual strategies in place, supporting the findings of Black, Harrison, Lee, Marshall, and Wiliam (2002 Black, P., Harrison, C., Lee, C., Marshall, B. and Wiliam, D. 2002. Working inside the black box: Assessment for learning in the classroom, London: Department of Education and Professional Studies, King’s College.  [Google Scholar]). Statistical analysis revealed some significant relationships between some of these perceptions and both school phase and length of teacher experience. Both theoretical and practical implications of these findings are discussed and recommendations made for future policy and practice.     

Teachers’ approaches to classroom assessment: a large-scale survey

Classroom assessment has become a cornerstone of today’s standards-based system of education. However, recent policy developments, professional standards, and variable assessment education have led to significant variability in teachers’ approaches to assessment. The primary purpose of this research was to use a new instrument predicated on recently published classroom assessment standards – the Approaches to Classroom Assessment Inventory – to measure teachers’ (a) approaches to assessment, (b) perceived skill in current assessment tasks and responsibilities, and (c) professional learning preferences and priorities. Based on 404 teachers from across North America, this study contributes initial evidence of how teachers approach classroom assessment with respect to four dimensions: Assessment Purposes, Assessment Processes, Assessment Fairness and Measurement Theory. Results from this study point to significant differences based on career stage and previous assessment education. The study concludes with four key implications for assessment research and practice.     

A better start to literacy learning: findings from a teacher-implemented intervention in children’s first year at school

Reading and Writing - This study investigated the feasibility of a teacher implemented intervention to accelerate phonological awareness, letter, and vocabulary knowledge in 141 children (mean age...     

E‐learning in higher education: some key aspects and their relationship to approaches to study

While there has been systematic and on‐going research into e‐learning in universities for over two decades, there has been comparatively less evidence‐based research into how key aspects of e‐learning are internally constituted from a student perspective and how these aspects might be related to university students’ learning experiences. The purpose of this paper is to explore key aspects of e‐learning that might be related to university student approaches to study, so that a better understanding of the internal structure of these aspects is achieved. Student responses to surveys are analysed at the level of each item to identify which items made the most sense to over 200 third‐year economics students. Data was also analysed both at the variable level, to identify which items coalesce to determine the structure of e‐learning variables, and at the student level, to see if there were groups of students in the sample that shared similar experiences of e‐learning when it was used to support a predominately campus‐based learning experience. The results suggest several implications for improving particular aspects of the student experience of e‐learning when it is used to support a campus‐based experience.     

Teachers’ learning experiences in relation to their ownership,sense-making and agency

The aim of this study was to gain understanding of how teachers familiarise themselves with a new pedagogy during their everyday practice, in this case the implementation of the coaching role in vocational education. For this purpose, 11 teachers reported their learning experiences in a digital log. An identity perspective was used as a lens to reflect and interpret these learning experiences. More specifically, it was looked at the extent to which teachers expressed ownership in their learning experiences with this new pedagogy, the ways they made sense of their learning experiences, and the extent to which they expressed agency in their learning experiences. On the basis of their initial positioning in terms of their ownership, sense-making and agency, these teachers were divided into an engaged and a reserved group. Differences were found in the learning experiences both between and within these groups. The digital logs of the engaged teachers showed more ownership than those of the reserved group and their sense-making was more active and explicit. Agency was present in the digital logs of both groups. Within the two groups, differences were found, particularly between teachers in the reserved group.     

Teachers’ perspectives on their use of ICT in teaching and learning: A case study

This article presents the perspectives of science and mathematics teachers on their use of information and communication technology (ICT) in teaching and learning in Tanzania. The findings show that few teachers used computers for teaching and learning purposes while majority of them used computers for administrative purposes. Additionally, teachers were found to have limited confidence in using technology to facilitate specific concepts or skills, to support creativity, and to support students to learn complex concepts. Therefore, it is suggested that schools explore strategies ICT integration strategies that focus more on making a shift from teaching technology or using technology for administrative purpose to appropriate pedagogical uses that could enhance student learning.     

Students’ approaches to learning and assessment preferences in a portfolio-based learning environment

This study focused on the relationships between experiences with portfolio assessment, students’ approaches to learning and their assessment preferences by means of a pre- and post-test design in an authentic class setting. The participants were 138 first-year professional bachelor’s degree students in office management. They were assessed by means of portfolio assessment in a course that combined constructivist design principles and lectures. Approaches to learning and assessment preferences were measured by means of the Revised Two-Factor Study Process Questionnaire and the Assessment Preferences Inventory. Results showed that students’ preferences for student participation in examination and for permanent evaluation decreased significantly. Moreover, deep approaches were not enhanced. On the contrary, surface learning increased significantly. Notwithstanding, the surface approach proved to be a significant negative predictor of the portfolio assessment score.     

Students’ assessment preferences, perceptions of assessment and their relationships to study results

The purposes of this study are to gain more insight into students’ actual preferences and perceptions of assessment, into the effects of these on their performances when different assessment formats are used, and into the different cognitive process levels assessed. Data were obtained from two sources. The first was the scores on the assessment of learning outcomes, consisting of open ended and multiple choice questions measuring the students’ abilities to recall information, to understand concepts and principles, and to apply knowledge in new situations. The second was the adapted Assessment Preferences Inventory (API) which measured students’ preferences as a pre-test and perceptions as a post-test. Results show that, when participating in a New Learning Environment (NLE), students prefer traditional written assessment and questions which are as closed as possible, assessing a mix of cognitive processes. Some relationships, but not all the expected ones, were found between students’ preferences and their assessment scores. No relationships were found between students’ perceptions of assessment and their assessment scores. Additionally, only forty percent of the students had perceptions of the levels of the cognitive processes assessed that matched those measured by the assessments. Several explanations are discussed.     

Irish student teachers’ beliefs about self,learning and teaching: a longitudinal study

This paper explores the beliefs about self-as-teacher, learning and teaching of preservice elementary teachers during a three-year undergraduate programme. Using a qualitative grounded theory analysis, the study examined the initial beliefs or personal theories of 27 preservice teachers during their first Semester. Longitudinal data were gathered from 7 of these students over the three-year duration of their teacher education programme through iterative interviews and reflective journal analysis. The findings demonstrate expansion in preservice teachers’ understandings of the teacher’s role, the value of reflective practice, the differential needs of learners and approaches to pedagogy. Findings point to lacunae in preservice teachers’ capacity for critical reflective practice and demonstrate how classroom management concerns can cause preservice teachers to adopt more cautious and traditional pedagogical approaches, despite their espoused commitment to child-centred principles.     

Students’ conceptions about a fair assessment of their learning

The objective of this study is to know the conceptions of primary and secondary school students about what constitutes a fair assessment. To achieve this aim, a phenomenographic study was carried out with 32 students. In a broad sense, the results showed that there were two types of conceptions. On one hand, a conception of fair assessment related to equality, transparency, objectivity, and evaluation of class content; that is, an egalitarian conception of fair assessment. On the other hand, a conception associated with ideas such as adaptation, diversification of tests, and qualitative assessment, even taking into account students' effort and attitudes, which define a conception of fair assessment linked to equity. These conceptions are associated with the concepts of legal justice and social justice, respectively and they contrast with the nature of external evaluations currently carried out.     

Re-defining ‘learning about religion’ and ‘learning from religion’: a study of policy change

The study of how policy processes shape religious education as a curriculum subject, rather than within faith schooling, is relatively unexplored. This paper applies a policy analysis perspective to an important distinction in non-confessional English religious education, which has also been adopted internationally: ‘learning about religion’ and ‘learning from religion’. The changing nature of the distinction in English policy documents from 1994 is examined in the light of three main voices of influence on educational policy: neo-conservatives, neo-liberals and progressives. These changes are also analysed through three policy contexts: influence, text production and practice. Revisions to policy wording are interpreted in the light of this theory, showing the growing significance of neo-liberalism, and the nature of compromise, amendment and ambiguity. The implications for an understanding of the inter-relationship between policy, pedagogy and practice are then considered.     

Students’ views of assessment in project-led engineering education: findings from a case study in Portugal

According to the demands of the Bologna process, new educational methods and strategies are needed in order to enhance student-centred learning. Project work is one of those approaches. This paper aims to evaluate the impact of project-led education (PLE) on students’ learning processes and outcomes, within the context of a first-year engineering programme. It explores students’ perceptions about assessment procedures and processes. Data collection was based on individual surveys at the end and the beginning of each PLE edition and through focus groups, after a period of six months. Findings are presented according to emerging themes from the data analysis, focusing mainly on students’ perspectives of learning and assessment, the role of formative and summative assessments in PLE and their impact on learning. Implications for improving assessment practices are discussed.