The Quality of Local District Assessments Used in Nebraska's School-Based Teacher-Led Assessment and Reporting System (STARS)

A sample of 293 local district assessments used in the Nebraska STARS (School-based Teacher-led Assessment and Reporting System), 147 from 2004 district mathematics assessment portfolios and 146 from 2003 reading assessment portfolios, was scored with a rubric evaluating their quality. Scorers were Nebraska educators with background and training in assessment. Raters reached an agreement criterion during a training session; however, analysis of a set of 30 assessments double-scored during the main scoring session indicated that the math ratings remained reliable during scoring, while the reading ratings did not. Therefore, this article presents results for the 147 mathematics assessments only. The quality of local mathematics assessments used in the Nebraska STARS was good overall. The majority were of high quality on characteristics that go to validity (alignment with standards, clarity to students, appropriateness of content). Professional development for Nebraska teachers is recommended on aspects of assessment related to reliability (sufficiency of information and scoring procedures).     

Relations of Student Perceptions of Teacher Oral Feedback With Teacher Expectancies and Student Self-Concept

In this article, the authors investigated the relations of students’ perceptions of teachers’ oral feedback with teacher expectancies and student self-concept. A sample of 1,598 Taiwanese children in Grades 3 to 6 completed measures of student perceptions of teacher oral feedback and school self-concept. Homeroom teachers identified students for whom they had high or low expectancies. Discriminant analysis indicated student perceptions of positive and negative academic oral feedback were more important than nonacademic feedback in predicting teacher expectancies. A 2-way multivariate analysis of variance showed that boys perceived more negative oral feedback than did girls, and fifth-grade students perceived more negative oral feedback on academic and nonacademic domains than did the third- and fourth-grade students. Furthermore, structural equation modeling results indicated a particularly strong relation between positive academic oral feedback and academic self-concept.     

Development of an instrument measuring student teachers’ perceived stressors about the practicum

The Stressors about Practicum Inventory, a self-report measure of perceived stressors about the practicum, was designed to provide those responsible for the training of primary school teachers with an informative, inexpensive and psychometrically sound tool. The present study describes the development and validation of the 94-item inventory in a sample of 138 Greek primary student teachers. It also investigates its initial factor structure and reliability. The scale was administered both before and after a four-week period of practicum. Content validity was examined using a panel of experts and student teachers, whereas convergent validity was assessed with the use of a measure of neuroticism. Factor analyses revealed four sources of perceived stress. No gender differences were found. However, the experience of the practicum significantly reduced student teachers’ perceived stress. All perceived stressors were moderately correlated with neuroticism, but after the practicum the size of the correlations was reduced.     

Student teachers’ psychological needs,subjective experience and perceived competence in teaching during practicum

ABSTRACT

This paper, using the Self-Determination Theory (SDT) as the underpinning framework, examines student teachers’ basic psychological needs, their subjective experience and their perceived teaching competence during practicum. It attempted to establish whether there were distinct groups of student teachers with different needs satisfaction, and how their levels of needs satisfaction were related to the groups’ subjective experience and perceived teaching competence. Quantitative data were collected. Data were analysed using cluster analysis and MANOVA. Overall, the results suggest that SDT can be effectively utilized as a framework for looking at how needs satisfaction is related to student teachers’ subjective experiences and perceived competence in teaching during practicum. The findings from this study are useful in providing evidence for teacher educators to strengthen their practicum model and plan mentoring workshops. The findings also provide much-needed insights into groups of student teachers that may need more support during practicum. Finally, the findings may help mentors understand their mentees better.     

Beliefs and gender differences: A new model for research in mathematics education

The major focus of this study is to propose a new research model, namely the Modified CGI gender model, for the study of gender differences in mathematics. This model is developed based on Fennema, Carpenter, and Peterson’s (1989) CGI model. To examine the validity of this new model, this study also examines the gender differences in teacher and student beliefs about mathematics and compares gender differences between teacher and student beliefs about the importance and difficulty of certain mathematics topics. Using the British Columbia Mathematics Assessment data, the study conducted a series of ANOVA. The findings of this study indicate that the new model appears to be a useful tool to describe gender differences in mathematics and to guide research in this area. The conclusions drawn from the data analysis show that male and female teachers differed significantly in their beliefs about Numbers and Operations. Male teachers perceived this topic to be more important than female teachers. Second, gender differences have been largely found in student beliefs about the difficulty of the selected topics. Finally, gender differences found in teacher beliefs are similar to the gender differences in student beliefs about the importance and difficulty of mathematics topics.     

What do we know and where do we go? Formative assessment in developing student teachers’ professional learning of teaching science

In the context of teacher education, it could well be suggested that assessment activities that build on formative interactions between student teachers and teacher educators might offer new windows into better understanding teaching and learning. This paper presents findings from a study into a primary science teacher education initiative that seeks to build the foundations on which 24 primary science student teachers, through the use of formative assessment of their science teaching and learning, can begin developing their pedagogical content knowledge (PCK). In the project, formative assessment consists of activities used by teacher educators to stimulate interactions, self- and peer-assessment in order to provide insights into how student teachers develop their PCK during a semester. Content Representations (CoRes), were used as a tool to unpack the student teachers’ approach to teaching a science topic and the reasons for that approach. The results indicate that the use of CoRes, together with subsequent self-assessment and formative interactions with teacher educators and peers, do have the potential for PCK development for student teachers. The results further highlight the need for developing reliable and valid tools for capturing and assessing student teachers’ PCK in pre-service teacher education.     

A review of the characteristics of intermediate assessment and their relationship with student grades

In-course assessment, such as midterms, quizzes or presentations, is often an integral part of higher education courses. These so-called intermediate assessments influence students’ final grades. The current review investigates which characteristics of intermediate assessment relate to these grades. In total, 88 articles were reviewed that examined the relationship between intermediate assessment and student grades. Four main characteristics were identified: the use of feedback, whether the assessment is mandatory, who is the assessor, and the reward students get for participating. Results indicate that corrective feedback leads to the most positive results, but elaborate feedback may benefit lower achieving groups. No difference in results was found for mandatory versus voluntary intermediate assessments. Peer assessment seemed to be beneficial, and rewarding students with course credit improves grades more than other rewards. Three scenarios are presented on how teachers can combine the different characteristics to optimise their intermediate assessment.     

Joint trajectories of behavioral,affective, and cognitive engagement in elementary school

The aim of the present study was to model student trajectories of behavioral, affective, and cognitive engagement from Grade 3 to Grade 6. The authors also examined whether teachers perceptions could predict student trajectory membership. The authors collected data from a sample of 831 students and 152 teachers. Using multiple-process growth mixture modeling, they identified 5 distinct trajectories of student engagement. Although a large majority of children presented a stable and high level of engagement on the three dimensions over time, more than one third of them showed a lower or changing level of engagement as the years progressed. These students were more likely to be boys and to be perceived by teachers as being less engaged. They also present more learning or behavioral problems and share less positive relationships with teachers. The results support the need to consider group-based differences when designing and adapting prevention and intervention strategies to favor student engagement.     

Teacher and student perceptions of intermediate assessment in higher education

Universities introduce intermediate assessment because it is understood to have positive effects on student behaviour and achievement. Yet, how intermediate assessment is perceived might be conditional for its success. The current study investigates both teachers’ and students’ perceptions of intermediate assessment. Teachers and students were interviewed and Student Evaluations of Teaching were examined. Results indicate that both teachers and students had generally positive perceptions of intermediate assessment. However, the two groups provided different reasons for their positive perceptions. Teachers and students agreed that intermediate assessment helps students to keep up with their study work. Moreover, teachers mentioned that they could assess various knowledge and skills with intermediate assessment, whereas students preferred intermediate assessments to test the same knowledge and skills as the final exam. This finding suggests that teachers and students in our study had different goals for intermediate assessment.     

Examining the associations between educators’ ethics position and ethical judgment in student assessment practices

The relationship between educators’ ethics position and ethical judgment in student assessment practices remain unclear. The current study filled the research gap utilizing a sample of 406 educators (in-service teachers, pre-service teachers, and educational administrators) who completed a survey with relevant questions. The respondents were classified into four ethics position groups – situationists, exceptionists, subjectivists and absolutists. They had divided opinions in making ethical judgments (ethical or unethical) on 13 out of the 18 assessment scenarios. The logistic regression results indicated that educators’ ethics positions were significantly associated with their ethical judgment in seven student assessment scenarios. Exceptionists were more likely to endorse certain student assessment practices that are not recommended by assessment books, while subjectivists were more likely to have similar opinions with assessment books in certain practices. The study helps us gain a deeper understanding of educators’ individual differences in making ethical judgments about student assessment practices.     

Standards-based performance assessment for the evaluation of student teachers: a consequential validity study

The instrument Samples of Teaching Performance (STP) was developed to assess student teachers' capacity to plan, deliver and evaluate a unit of instruction. The current study reports consequential validity data collected from supervisors (n?=?20) and student teachers (n?=?62) from three elementary and five secondary teacher preparation programs in Chile that participated in the field-testing of the STP. Student teachers described how this assessment had honed their sense of professionalism and promoted learning of the skills assessed. Supervisors reported enlarging the topics discussed with student teachers and making some changes to the supervisory process. These findings are complemented by an analysis of the STP scores obtained by 24 student teachers, which showed better development of instructional skills when compared to pedagogical reasoning and reflection. These results raise questions about the structure of student teaching to support the implementation of standards-based assessments that entail tasks at different levels of cognitive complexity.     

Learning science content through socio-scientific issues-based instruction: a multi-level assessment study

Science educators have presented numerous conceptual and theoretical arguments in favor of teaching science through the exploration of socio-scientific issues (SSI). However, the empirical knowledge base regarding the extent to which SSI-based instruction supports student learning of science content is limited both in terms of the number of studies that have been conducted in this area and the quality of research. This research sought to answer two questions: (1) To what extent does SSI-based instruction support student learning of science content? and (2) How do assessments at variable distances from the curriculum reveal patterns of learning associated with SSI-based instruction? Sixty-nine secondary students taught by three teachers participated in the study. Three teachers implemented an SSI intervention focused on the use of biotechnology for identifying and treating sexually transmitted diseases. We found that students demonstrated statistically and practically significant gains in content knowledge as measured by both proximal and distal assessments. These findings support the claim that SSI-based teaching can foster content learning and improved performance on high-stakes tests.     

Fostering teacher educators’ professional development in research and in supervising student teachers’ research

Most teacher educators who work at institutes for higher vocational education have faced a new role since the European Community aimed to upgrade the general quality of education. Research tasks have been added as a new important core business for institutes that used to be mainly focused on education. Teacher educators therefore have to become familiar with research knowledge and skills, and with the skills to supervise student teachers in conducting research. Professional development activities have been set up to prepare them for it. In this explorative study, we investigated the extent to which four different professional development activities within three Dutch institutes for teacher education contributed to the knowledge and skills needed for these new tasks. We gathered data by interviewing 12 teacher educators. In addition to some striking differences, we found corresponding positive experiences in all four activities. Exchanging experiences and discussing issues with colleagues was perceived to be the most outstanding part of each activity. This research has yielded necessary insights into constructing professional development activities. It is clear that any professional development activity about research should be consistent with teacher educators’ daily practices and concerns.     

Exploring the role of assessment criteria during teachers’ collaborative judgement processes of students’ portfolios

Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition. This study aims to identify whether assessment criteria can improve content, argumentation and communication during teacher moderation while judging student portfolios. Six teachers scored 32 student portfolios in dyads with and without assessment criteria. Their judgement processes were qualitatively analysed. Results indicated that the quality of their judgement processes was low, since teachers based their judgements mainly on their own personal opinion and less on evidence found in the portfolio. Teachers barely paid attention to quality checks and easily agreed with each other. When teachers used assessment criteria, the quality of their judgements slightly improved. They based their judgements more on relevant evidence, used less personal experiences and more often checked the quality of their judgement processes. It is concluded that the quality of teacher portfolio judgement is low, and that the use of assessment criteria can enhance its quality.     

Unpacking the data: an analysis of the use of Danielson’s (2007) <Emphasis Type="Italic">Framework for Professional Practice</Emphasis> in a teaching residency program

This mixed methods study examines one teacher preparation program’s use of Danielson’s 2007 Framework for Professional Practice, with an emphasis on how different stakeholders in the traditional student teaching triad rated student teachers, called residents, and justified their ratings. Data sources include biannual self-assessments of each resident as well as assessments by the residents’ cooperating teachers and university supervisors based on the Framework, including both a numerical score for each of the 22 indicators and a written justification for the highest and lowest scores in each of the four domains. Findings show significant differences in terms of how stakeholders are rating residents’ teaching practice. The variation in scores and rationales raises questions about the reliability and validity of the results of the Framework for use as a tool to evaluate student teachers. Implications for practice include the need to consider multiple and potentially conflicting roles, such as that of providing feedback while also evaluating student teachers. In addition, we consider the costs and benefits of more extensive training around the Framework within teacher preparation, if a lack of expertise with the rubric was the cause for the variation. Finally, we consider implications for student teachers around the different messages they may be receiving about what it means to learn to teach.     

0–60 MPH: Data-Phobic to Data-Driven

As educators, we need to stop fearing data and embrace its power. This article discusses how classroom teachers can design, implement, and analyze longitudinal assessments to diagnose issues related to student achievement and meet the demands of our evolving data-driven educational culture. Practical advice on exam production and data analysis provide a footprint which allows teachers to begin the process locally and immediately.     

Assessment of the practicum in teacher education: advocating for the student teacher and questioning the gatekeepers

This paper reports on research that suggests a new view of assessment of the practicum in teacher education. By transcending the stereotypes of “failing” student teachers who do not achieve traditional benchmarks, this new lens highlights the complexity, diversity and inequality of experiences through listening to the voices of the student teachers and their mentors. By valuing context and focusing on progress and development rather than absolute attainment, teacher educators are challenged to reflect on their own role as mentors and educators through guiding principles of practicum learning. These guiding principles of practicum learning are the result of significant observation in the practicum classroom followed by critical analysis of data provided as narrative. A more humane, trusting and respectful attitude towards assessment is suggested.