澳大利亚全国读写计算能力考评计划述评

全国读写计算能力考评计划是澳大利亚学业成就评价改革的重要举措。其旨在促进澳大利亚课程标准的统一,提高学生学业成绩跨州跨地区的可比性,提升澳大利亚教育体质的透明度。其启示在于:作为全国性的学业成就考试必须公正、透明;学业成就评价的信息来源应该是多渠道的,不应将考评结果作为惟一的参考依据;全国性的学业成就评价的考评报告内容应翔实,应充分反映学生具体的学业水平;学业成就考评报告应立足多元化。     

Development of the attitude toward science in school assessment and its use to investigate the relationship between science achievement and attitude toward science in school

There is much interest in science courses in high school and student attitudes toward those courses. A valid and reliable instrument that measures such attitudes is not available. This study first developed and validated the Attitude toward Science in School Assessment (ATSSA). The instrument was used to evaluate the relationship between such attitude and achievement in science. A low correlation was found between attitude and various achievement tests. A moderate correlation was found between attitude and achievement that included an evaluation of the quality of work, as in a course grade.     

高校学生学习成绩评价改革——《物理教学论》系列课程学生学习成绩评价方案报告

改革高校学生学习成绩评价,促进学生学习,是当前教学改革的一个重要研究课题.本文结合《物理教学论》系列课程教学改革实践和现代教学学生学习成绩评价思想,提出具体的评价改革方法和成绩评价主体、公式、流程,并对关键内容进行必要的论述和说明.     

Developing and validating an instrument measuring school leadership

In this study, we developed and validated an instrument that researchers can use to measure the collective effort of principals and teachers who excise their own unique leadership to generate (integrated) school leadership. Based on 644 teachers, we found sound psychometric properties of the scales of the instrument and the instrument as a whole. We also explored the predictive properties of the instrument in predicting student achievement at the school level. Based on 53 schools, we found that the instrument can indeed measure the kind of school leadership that really matters to student achievement. When predicting student achievement (at the school level), the instrument tends to be more sensitive to more difficult school subjects (e.g. mathematics), implying that improvement in school leadership would lead to larger improvement in student achievement (at the school level) in more difficult school subjects.     

Some problems in interpreting criterion-referenced test results in a program evaluation

The purpose of this paper is to delineate several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Specifically, the paper deals with: (1) alternative methods of aggregating individual student and group data on objectives, (2) the sensitivity of the instrument to program outcomes, and (3) the comparisons of criterion-referenced test data and standardized (norm-referenced) achievement test data.     

Transformational classroom leadership: a novel approach to evaluating classroom performance

In higher education, student evaluation of teaching is widely used as a measure of an academic’s teaching performance despite considerable disagreement as to its value. This paper begins by examining the merit of teaching evaluations with reference to the factors influencing the accuracy of the teaching evaluation process. One of the central assumptions on which student evaluation of teaching is based is that there is a relationship between student achievement and student rating of teachers. However, the findings of the majority of studies do not support this assumption. The absence of a strong link between student achievement and teaching evaluations suggests that there is scope for examining other approaches to measuring effective classroom dynamics. This paper presents such an approach based on the notion of transformational classroom leadership.     

Bilingual education and student performance in Guatemala

Bilingual education is often seen as one means of improving the educational attainment of indigenous children in developing countries. This paper presents the results of an evaluation of the National Bilingual Education Program serving approximately one-third of the indigenous primary school students in Guatemala. Findings show that program inputs of teacher training and instructional materials have had a significant effect on student achievement and a slight positive effect on promotion, repetition and drop-out rates. The superior performance of boys over girls and a teacher-centered approach to instructional delivery suggest that improvements should be made before expansion of the program.     

The impacts of student-, teacher- and school-level factors on mathematics achievement: an exploratory comparative investigation of Singaporean students and the USA students

Reports from the Trends in International Mathematics and Science Study (TIMSS) consistently show that there is a substantial gap in average mathematics achievement between Singapore and the USA. This study conducts an exploratory comparative investigation on the multilevel factors influencing the mathematics achievement of students from these two countries. A conceptual framework together with an integrated model is proposed for the analysis. The TIMSS 2011 eighth grader mathematics data were chosen for this study. Results reveal that the common features influencing mathematics achievement for the students of both countries are student self-confidence, school composition by student background and teacher confidence in teaching mathematics. The cause of the different effects of American students’ mathematics achievement is more associated with resources, whereas the effects of Singaporean students’ mathematics achievement are more related to attitudes, expectations and motivations. The major elements that affect Singaporean student mathematics performances are at the teacher level. Suggestions for future research are discussed.     

Pedagogical and Social School Climate: Psychometric Evaluation and Validation of the Student Edition of PESOC

Previous studies indicate that school climate is important for student health and academic achievement. This study concerns the validity and reliability of the student edition a Swedish instrument for measuring pedagogical and social school climate (PESOC). Data were collected from 5,745 students at 97 Swedish secondary schools. Multilevel confirmatory factor analyses were conducted, and multilevel composite reliability estimates, as well as correlations with school-level achievement indicators, were calculated. The results supported an 8-factor structure at the student level and 1 general factor at the school level. Factor loadings and composite reliability estimates were acceptable at both levels. The school-level factor was moderately and positively correlated with school-level academic achievement. The student PESOC is a promising instrument for studying school climate.     

Development and validation of Teacher Intentionality of Practice Scale (TIPS): A measure to evaluate and scaffold teacher effectiveness

Teacher evaluation instruments frequently fail to support teacher growth and improvement—particularly in critical constructs surrounding pedagogical content knowledge that promote student growth and achievement. The current study details the development and validation of the Teacher Intentionality of Practice Scale (TIPS), an observational protocol designed to measure intentional teaching practices and provide support for teacher growth over time. Findings suggest that TIPS provides a valid and highly reliable research-based teacher observational instrument that also serves as a professional development model to help scaffold the growth and improvement of K-12 educators. This paper details the theoretical foundations of TIPS, reports reliability and validity measures (including both Exploratory and Confirmatory Factor Analyses), and discusses applications and implications of TIPS for teacher evaluation and professional development.     

一流学科建设中大型精密贵重仪器设备培训体系的改革

以建设一流学科中大型精密贵重仪器设备培训体系为主题,针对培训体系存在的若干问题,通过创新调研方法获取精准的培训需求。维护培训需求与学生仪器测试要求的一致性;设计迭代式培训流程,制定多维度的培训方案,实现培训体系的闭环管理;全方位保障培训的实施,通过建立互动交流平台、组建梯队的培训人员、完善培训资料(纸质材料、媒介手段、音频材料);遵循柯克帕特里4级评估模型,从反应评估、学习评估、行为评估和成果评估4个层面上完成精准的培训评估反馈;补充文献支持体系、仪器设备维修体系、耗材保障体系、资金管理体系、学生助教等配套体系,优化长效性培训体系,从而达到重塑、建设、改革培训体系的目标。     

Correlations between teaching practices and class achievement in introductory algebra

Certain teaching practices were found to be linked to the educational achievement of students learning algebra for the first time. Collective teaching was observed with an instrument based on one developed by Stallings (1977). Student achievement appeared related, to some extent, to academic discourse. For this to be the case, this discourse had to come mainly from the teacher who was dispensing instruction, lecturing in a large-group context with or without teaching materials, asking questions, helping the student unable to give a correct answer, or giving feedback. The quantity of such discourse was also important. It appeared that it must be plentiful, but not excessive. Correlations with student achievement of large-group instruction and of instruction where the teacher monitors student work are the main focus of this paper. Student discourse in general, and non-academic discourse in particular, appear to have negative effects on achievement if they become frequent.     

Evaluating the Implementation of an Olympic Education Program in Greece

The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following six factors: ‘facilities’, ‘administration’, ‘educational material’, ‘student–teacher relationships’, ‘educational procedures’, and ‘training’. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with advanced statistical methods.     

基于网络的高职顶岗实习教学评价体系的构建

顶岗实习是高职专业人才培养的重要环节,为提高顶岗实习质量,必须设计科学合理的顶岗实习教学评价体系,从而客观评价学生顶岗实习成绩和顶岗实习教学效果。     

After-school tutoring in the context of no Child Left Behind: Effectiveness of two programs in the Pittsburgh Public Schools

The No Child Left Behind (NCLB) legislation has created pressure for districts to improve their students’ proficiency levels on state tests. Districts that fail to meet their academic targets for 3 years must use their Title I funds to pay for supplemental education services (SES) that provide tutoring or other academic instruction. Many districts, including the Pittsburgh Public Schools (PPS), have also adopted additional tutoring programs designed to help students reach proficiency goals. This paper examines student participation and achievement in two PPS tutoring programs—the NCLB-mandated SES program and a state-developed tutoring program. We examine the characteristics of students participating in each program, the effects of participation on student achievement, and the program features that are associated with improved achievement.     

回归分析与学生进步程度的评价

本文讨论一元回归分析方法在成绩评价中的应用.给出了学生进步程度的定义、成绩预测和综合成绩评价的公式,将自变量取值中心化后简化了学生进步程度的计算公式.     

Measuring Student Behavior during Group Instruction

Abstract

If teacher behaviors and learning conditions have an influence on student achievement, it seems likely that student behavior must mediate this relationship. An instrument designed to assess the physical and mental behaviors and activities of students during group instruction is described. The instrument was employed in a study of five tenth grade mathematics classrooms. The findings indicated that scores from die “Activities Checklist” correlate highly with more general measures of student participation obtained from direct observation and from the stimulated recall procedure. The student behavior measures were shown to be highly predictive of achievement, adding support to the notion that student behavior during instruction is strongly linked to student learning. Both aptitude and affective characteristics were found to be somewhat predictive of the various student participation measures. In contrast to the more general measures, the “Activities Checklist” readily allows for qualitative distinctions among various kinds of student participation.     

Teacher and Classroom Context Effects on Student Achievement: Implications for Teacher Evaluation

The Tennessee Value-Added Assessment System (TVAAS) has been designed to use statistical mixed-model methodologies to conduct multivariate, longitudinal analyses of student achievement to make estimates of school, class size, teacher, and other effects. This study examined the relative magnitude of teacher effects on student achievement while simultaneously considering the influences of intraclassroom heterogeneity, student achievement level, and class size on academic growth. The results show that teacher effects are dominant factors affecting student academic gain and that the classroom context variables of heterogeneity among students and class sizes have relatively little influence on academic gain. Thus, a major conclusion is that teachers make a difference. Implications of the findings for teacher evaluation and future research are discussed.     

Online student evaluation improves Course Experience Questionnaire results in a physiotherapy program

This paper reports the use of an online student evaluation system, Course Experience on the Web (CEW), in a physiotherapy program to improve their Course Experience Questionnaire (CEQ) results. CEW comprises a course survey instrument modelled on the CEQ and a tailored unit survey instrument. Closure of the feedback loop is integral in the CEW system. Analysis of the data shows that the students’ evaluation in their final year of the program is closely correlated with their CEQ results. Increases in the CEQ scores from 2001–04 included an increase in the Good Teaching Scale (27.5), Generic Skills Scale (10.3) and Overall Satisfaction Index (29.3). By using CEW, academics at the School of Physiotherapy were able to determine students’ perceptions during the course, make changes to teaching and learning, where appropriate, in a timely manner and, as a result, the CEQ scores were improved markedly.     

Validation of an Instrument for Measuring Students’ Understanding of Interdisciplinary Science in Grades 4-8 over Multiple Semesters: a Rasch Measurement Study

So far, not enough effort has been invested in developing reliable, valid, and engaging assessments in school science, especially assessment of interdisciplinary science based on the new Next Generation Science Standards (NGSS). Furthermore, previous tools rely mostly on multiple-choice items and evaluation of student outcome is linked only to their raw scores in standardized tests. In addition, educational research on student science achievement always limits in certain grade/subject according to application of raw scores. This study provides a way to design, validate, and further improve an instrument to assess student understanding in interdisciplinary science across grade and time. Meanwhile, student learning growth is investigated. The data are collected from elementary/middle school student survey from an Interdisciplinary Science and Engineering Partnership (ISEP) in Northeastern part of the USA. The results show a generally good quality of instrument through various aspects of empirical evidence, such as dimensionality, model-data-fit, and validity. Finally, student learning growth in understanding interdisciplinary science shows a sharp increase between elementary and middle school. The study sheds light on developing more reliable and valid instruments in assessing student science understanding based on the new standards and it also provides suggestions of implementation in both educational research and practice.