Relationship between ecology fieldwork and student attitudes toward environmental protection

This article is a summary of research carried out on Spanish secondary school students 14–16 years of age, with the intention of finding out what contributions fieldwork makes toward the understanding of concepts and principles of ecology, and also to ascertain the effects of fieldwork on the defense of the studied ecosystem. Before further research was conducted, an exploratory study was carried out consisting of an initial diagnosis of the pupils' ideas; fieldwork materials were prepared and an ecology unit for the study of a freshwater ecosystem was designed, along with evaluation instruments. The experimental design was given shape thanks to work done with two groups of students on whom a more exhaustive study was performed. The independent variable consisted of a field trip; the dependent variable was the learning of ecological concepts and their application to the assessment of an environmental problem. The study combined qualitative and quantitative research methods. A result of the research work was the conclusion that fieldwork helps clarify ecological concepts and intervenes directly in the development of more favorable attitudes toward the defense of the ecosystem. Both components are seen when making valid judgments for the resolution of problems which negatively affect the ecosystem and for showing the way toward the type of actions and solutions which should be adopted. © 1999 John Wiley & Sons, Inc. J Res Sci Teach 36: 431–453, 1999     

Using peer assessment of fieldwork to enhance students’ practical training

Fieldwork training is a key component of several practical disciplines. In this study, students’ peer assessment of fieldwork is explored as a method to improve their practical training. Peer assessment theories are first discussed. A framework for peer assessment of fieldwork is proposed, and the steps taken for preparation of students for this task are discussed. A developed marking, feedback and moderation tool of assessment are presented. Application of peer assessment in the field was investigated over a period of two years in one undergraduate unit in the geospatial discipline as an example. Reliability of peer assessment was estimated by measuring the difference between assessments carried out by groups of peer assessors, and its validity was measured by comparing students’ marks with those given by tutors. Results show that students have gained from the peer assessment process, mainly as a formative form of assessment, by better understanding and endeavouring to achieve the objectives of field tasks. Tutors use differences among assessments made by groups of students compared to tutors’ assessments to identify field components that need better explanation of their content and assessment criteria.     

The use of electronic media to develop transferable skills in science students studying anatomy

Transferable skills such as team working, communication, information gathering, critical thinking, and peer assessment are essential for graduates seeking employment in the competitive jobs market. Use of online discussion boards have grown to allow students to communicate with each other at a time and location of their choosing. This study aimed to develop transferable skills using specially developed online components supported by discussion boards and chat rooms. Students enrolled in the Human Anatomy and Histology module at the University of Manchester were put into groups of six or seven students (26 groups in total). Two e-learning components were constructed to develop transferable skills. Each group had a discussion board and chat room available to assist communication in completion of the components. Peer marking was also done on this media. Data collected showed the discussion boards were heavily utilized (average number of posts per group was 48). Eighty-three percent of students found the discussion boards useful to complete the tasks. Students felt their team building and critical analysis skills had improved. Peer assessment was well received by students. Using online discussion boards proved an excellent way to develop transferable skills in a large group of science students.     

Meaningful Understanding and Systems Thinking in Organic Chemistry: Validating Measurement and Exploring Relationships

The purpose of this study was dual: First, to develop and validate assessment schemes for assessing 11th grade students’ meaningful understanding of organic chemistry concepts, as well as their systems thinking skills in the domain. Second, to explore the relationship between the two constructs of interest based on students’ performance on the applied assessment framework. For this purpose, (a) various types of objective assessment questions were developed and evaluated for assessing meaningful understanding, (b) a specific type of systemic assessment questions (SAQs) was developed and evaluated for assessing systems thinking skills, and (c) the association between students’ responses on the applied assessment schemes was explored. The results indicated that properly designed objective questions can effectively capture aspects of students’ meaningful understanding. It was also found that the SAQs can elicit systems thinking skills in the context of a formalistic systems thinking theoretical approach. Moreover, a significant relationship was observed between students’ responses on the two assessment strategies. This research provides evidence that students’ systems thinking level within a science domain is significantly related to their meaningful understanding of relative science concepts.     

Automatic evaluation of open-ended questions for online learning. A systematic mapping

The assessment of students’ performances in Higher Education is one of the essential components of teaching activities. Open-ended tasks allow a more in-depth assessment of students’ learning levels, but their evaluation and grading are time-consuming and prone to subjective bias. Since the Covid-19 pandemic, most traditional Higher Education courses converted to online courses; automatic grading and feedback tools and methods (AGFTM) have become critical components of online learning systems, especially with regards to short answers and essays assessment. This work frames the recent advancement in AGFTM through a systematic mapping of the research field and a literature review. This analysis gives an overview of the trends, specific goals, methods, quality of proposals, challenges and limitations in this research area. The results indicate that it is a growing research area, with a large set of techniques involved, but still not mature, where practical implementations have yet to come.     

Easing the transition from school to HE: scaffolding the development of self-regulated learning through a dialogic approach to feedback

High quality feedback is known to be essential for learning, yet in higher education it has been highlighted as a problem area in the UK by both the Quality Assurance Agency (QAA) and National Student Surveys. Furthermore, a recent study has shown that there is a fault-line between the highly structured guidance system that exists in schools/colleges and the culture of ‘independent’ learning that is promoted in higher education and suggests that this is a significant barrier to a successful transition. This article reports research to improve the transition for first-year undergraduates by providing a structured set of guidance activities (scaffolding) as a means of an extended induction into the assessment processes in higher education. The activities are based on the dialogic feedback cycle, which encompasses principles of feedback as dialogue, emphasising guidance at the start of and during an assignment rather than summative written feedback. The intervention was evaluated by means of a questionnaire and supported by focus groups. The questionnaire was administered to a control group and an intervention group. Results showed statistically significant improvements (p < 0.05) in students’ perceptions of their understanding of assessment tasks and criteria and increased confidence in terms of completing assessment tasks and self-regulated learning.     

Upper Secondary Teachers' Knowledge for Teaching Chemical Bonding Models

Researchers have shown a growing interest in science teachers’ professional knowledge in recent decades. The article focuses on how chemistry teachers impart chemical bonding, one of the most important topics covered in upper secondary school chemistry courses. Chemical bonding is primarily taught using models, which are key for understanding science. However, many studies have determined that the use of models in science education can contribute to students’ difficulties understanding the topic, and that students generally find chemical bonding a challenging topic. The aim of this study is to investigate teachers’ knowledge of teaching chemical bonding. The study focuses on three essential components of pedagogical content knowledge (PCK): (1) the students’ understanding, (2) representations, and (3) instructional strategies. We analyzed lesson plans about chemical bonding generated by 10 chemistry teachers with whom we also conducted semi-structured interviews about their teaching. Our results revealed that the teachers were generally unaware of how the representations of models they used affected student comprehension. The teachers had trouble specifying students’ difficulties in understanding. Moreover, most of the instructional strategies described were generic and insufficient for promoting student understanding. Additionally, the teachers’ rationale for choosing a specific representation or activity was seldom directed at addressing students’ understanding. Our results indicate that both PCK components require improvement, and suggest that the two components should be connected. Implications for the professional development of pre-service and in-service teachers are discussed.     

课程考核方式对高校学生评教结果的影响

利用统计学方法检验不同"考核方式"对老师的"评教等级"与"学生成绩"间因果关系的影响,并以"考核方式"对"学生评教"的影响做t检验。结果显示:"学生成绩"与"学生评教"之间存在相关系数极小的正相关关系;课程"考核方式"与"学生评教"有显著的负相关关系,而与学生成绩无关。区别对待不同课程考核方式的学生评教结果,有利于教学管理部门正确认识和评定教师的教学水平,激励教师积极参与教学工作。     

Assessing Students’ Deep Conceptual Understanding in Physical Sciences: an Example on Sinking and Floating

This paper presents a transformative modeling framework that guides the development of assessment to measure students’ deep understanding in physical sciences. The framework emphasizes 3 types of connections that students need to make when learning physical sciences: (1) linking physical states, processes, and explanatory models, (2) integrating multiple explanatory models, and (3) connecting scientific models to concrete experiences. We carried out a 2-phase exploratory study that helped further develop and refine the framework. In the first phase, we developed 3 items on sinking and floating and pilot tested them with 18 undergraduate students. Analysis of student responses revealed various student misconceptions and the different connections students made among science ideas. Based on the findings, we revised the assessment, modified the instruction, and collected data from another cohort of 26 students. The second cohort of students showed significant improvement of understanding of sinking and floating after instruction. Implications and limitations of how our assessment framework can be used to improve students’ conceptual understanding in science are discussed.     

Pedagogy and practice in STEM field experiences: intersections of student and mentor identity and impacts upon student outcomes

Practicums, internships and field experiences are essential components in many fields. These varied experiences embed both students and their mentors in immersive experiences. Such immersive experiences are essential for STEM students preparing for future jobs, yet little is known about how these research-intensive and immersive experiences impact the practice of teaching in the natural sciences. In order to evaluate the impact, opportunities and challenges associated with such experiences, our team collected and analysed end-of-semester reflections from five students and their faculty mentor. Thematic analysis related to inferences and implications about the impacts of the experience showed a need to formalize and further develop an understanding of both students’ self-identity and the cultural attitudes of the students and the mentor.     

Feedback,feedforward: evaluating the effectiveness of an oral peer review exercise amongst postgraduate students

Assessment for learning approaches, such as peer review exercises may improve student performance in summative assessments and increase their satisfaction with assessment practices. We conducted a mixed methods study to evaluate the effectiveness of an oral peer review exercise among post-graduate students. We examined: (1) final assessment grades among students who did and did not take part in the peer review exercise; (2) student perceptions of the impact of the peer review exercise; and (3) student understanding of, and satisfaction with, this new assessment practice. We found that students who took part in the exercise had a significantly higher mean grade in a subsequent summative oral presentation assessment than students who did not take part in the exercise. Students gained a better understanding of assessment and marking criteria and expressed increased confidence and decreased anxiety about completing the subsequent summative assessment. Assessment for learning improves academic attainment and the learning experience in postgraduate students.     

Students’ perceptions about evaluation and assessment in higher education: a review1

In educational contexts, understanding the student’s learning must take account of the student’s construction of reality. Reality as experienced by the student has an important additional value. This assumption also applies to a student’s perception of evaluation and assessment. Students’ study behaviour is not only determined by the examination or assessment modes that are used. Students’ perceptions about evaluation methods also play a significant role. This review aims to examine evaluation and assessment from the student’s point of view. Research findings reveal that students’ perceptions about assessment significantly influence their approaches to learning and studying. Conversely, students’ approaches to study influence the ways in which they perceive evaluation and assessment. Findings suggest that students hold strong views about different assessment and evaluation formats. In this respect students favour multiple‐choice format exams to essay type questions. However, when compared with more innovative assessment methods, students call the ‘fairness’ of these well‐known evaluation modes into question.     

后现代主义视野下的理解性教学评价

理解性教学评价是理解教学中一个重要环节,它贯穿于教学环节的始终,试图摆脱传统师生对立、缺乏交流的评价模式,从而转向注重学生发展的评价方式。它重视评价标准的生成性,强调教学评价的过程性和理解性,以期达到教学评价结果的发展性。     

The validity and students’ experiences of peer assessment in a large introductory class of gene technology

Although studies have examined the validity of peer assessment, research including students’ own experiences of peer assessment is scarce. The present study aims to improve assessment practices in a context with a highly traditional assessment culture. The aim is first to examine the validity of peer assessment by analysing the compatibility of student and teacher evaluation and explore the differences between minor and major students’ evaluations. Second, the study examines students’ experiences of peer assessment. Peer assessment was implemented in a large bioscience course with 79 student participants. After the peer assessment, the students provided feedback. The results indicate that student subject understanding can be supported through a proper assessment practice. Peer assessment was successful in an introductory class with minor and major students, and most students experienced it as supportive of their learning.     

Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer‐group rating

Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer‐group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer‐group ratings using a rubric for an oral presentation was used in this 3‐year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be ‘gender neutral’ and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one‐to‐one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter‐rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer‐group (and self‐) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer‐group assessment.     

Students’ Perceptions of Their Science Teachers’ Pedagogical Content Knowledge

Pedagogical content knowledge (PCK) is a type of teacher knowledge to be developed by a teacher. PCK is said to contribute to effective teaching. Most studies investigated the development of PCK and its influence on students’ learning from the teachers’ perspectives. Only a limited number of studies have investigated the components of science teachers’ PCK that helped students’ learning from the perspective of students. Thus, it is the aim of this study to investigate the level of science teachers’ PCK from students’ perspective, in particular whether or not students of different achieving ability had different views of teachers’ PCK in assisting their learning and understanding. Based on the PCK research literature, six components of PCK have been identified, which were as follows: (1) subject matter knowledge, (2) knowledge of teaching strategies, (3) knowledge of concept representation, (4) knowledge of teaching context, (5) knowledge of students, and (6) knowledge of assessment in learning science. A questionnaire consisting of 56 items on a five-point Likert-type scale were used for data collection from 316 Form Four students (16 years old). One-way analysis of variance revealed that the differences in science teachers’ PCK identified by students of different achieving abilities were statistically significant. Overall, students of various academic achieving abilities considered all the components of PCK as important. The low-achieving students viewed all the components of PCK as being less important compared to the high and moderate achievers. In particular, low-achieving students do not view ‘knowledge of concept representation’ as important for effective teaching. They valued the fact that teachers should be alert to their needs, such as being sensitive to students’ reactions and preparing additional learning materials. This study has revealed that PCK of science teachers should be different for high and low-achieving students and knowledge of students’ understanding plays a critical role in shaping teachers PCK.     

A framework for scaffolding students' assessment of the credibility of evidence

Assessing the credibility of evidence in complex, socio‐scientific problems is of paramount importance. However, there is little discussion in the science education literature on this topic and on how students can be supported in developing such skills. In this article, we describe an instructional design framework, which we call the Credibility Assessment Framework, to scaffold high school students' collaborative construction of evidence‐based decisions and their assessment of the credibility of evidence. The framework was employed for the design of a web‐based reflective inquiry environment on a socio‐scientific issue, and was enacted with 11th grade students. The article describes the components of the Credibility Assessment Framework and provides the details and results of an empirical study illustrating this framework in practice. The results are presented in the form of a case study of how 11th grade students investigated and evaluated scientific data relating to the cultivation of genetically modified plants. Multiple kinds of data were collected, including pre‐ and post‐tests of students' conceptual understanding and their skills in assessing the credibility of evidence, and videotapes of students' collaborative inquiry sessions. The analysis of the pre‐ and post‐tests on students' conceptual understanding of Biotechnology and their skills in assessing the credibility of evidence revealed statistically significant learning gains. Students' work in task‐related artifacts and the analysis of two groups' videotaped discussions showed that students became sensitive to credibility criteria, questioned the sources of data and correctly identified sources of low, moderate, and high credibility. Implications for designers and educators regarding the application of this framework are discussed. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 711–744, 2011     

Between two stories: assessment of and for learning

The study was conducted in a school for special education with small classes of six to 12 students. The aim was to illuminate how students’ understanding of written assessments could be related to assessment for learning. Twenty-nine students were asked to describe their understanding of written assessment in three different subjects and, further, to describe their perceptions in follow-up interviews. The two-step analysis first focused on individual understanding. Thereafter Vygotsky’s zone of proximal development (ZPD) was used as analytical tool. In the first analysis three categories were identified. Students’ understandings were related to subject matter knowledge, generic skills and attitudes. The findings of the second analysis indicated that written assessment often lacked formative features and cannot be seen as learning in the ZPD. Difficulties with schoolwork were seen as problems of the individual and the measures were directed towards the student. Even though the guidelines ask for a relational perspective a categorical perspective sometimes was adopted in the assessments. The implications of the study relate to the ways teacher’s assessment competences can encompass students’ understanding and how this can be translated into action.     

Conceptual continuity and the science of baseball: using informal science literacy to promote students’ science learning

This project explores conceptual continuity as a framework for understanding students’ native ways of understanding and describing. Conceptual continuity suggests that the relationship between the use of words in one genre and the scientific genre can exist at varying levels of association. This perspective can reveal the varied relationships between ideas explained in everyday or vernacular genres and their association to scientific explanations. We conducted a 2-year study involving 15 high school baseball players’ understanding of the physics involved in baseball. First, we conducted a quantitative assessment of their science understanding by administering a test prior to season one (2006) and season two (2007). Second, we examined the types of linguistic resources students used to explain their understanding. Third, we revisited our data by using conceptual continuity to identify similarities between students’ conceptual understanding in the informal contexts and their similarities to canonical scientific ideas. The results indicated students’ performance on the multiple-choice questions suggested no significant improvement. The qualitative analyses revealed that students were able to accurately explain different components of the idea by using a diversity of scientific and non-scientific genres. These results call attention to the need to reconstruct our vision of science learning to include a more language sensitive approach to teaching and learning.