Development of Automated Scoring Algorithms for Complex Performance Assessments: A Comparison of Two Approaches

Performance assessments are typically scored by having experts rate individual performances. The cost associated with using expert raters may represent a serious limitation in many large-scale testing programs. The use of raters may also introduce an additional source of error into the assessment. These limitations have motivated development of automated scoring systems for performance assessments. Preliminary research has shown these systems to have application across a variety of tasks ranging from simple mathematics to architectural problem solving. This study extends research on automated scoring by comparing alternative automated systems for scoring a computer simulation test of physicians'patient management skills; one system uses regression-derived weights for components of the performance, the other uses complex rules to map performances into score levels. The procedures are evaluated by comparing the resulting scores to expert ratings of the same performances.     

Blueprint for Bologna: University of Prishtina and the European Union

Countries hoping to demonstrate an adequate educational infrastructure need a national framework that meets Bologna requirements, a national accreditation agency which sets out the approved framework, and national accreditation processes by which individual institutions can be measured against the standards set by the national acvcreditation agency. For many countries, the national framework remains to be articulated, the accreditation processes are non-existent, and individual institutions have no means by which to assess their internal readiness for accreditation scrutiny. While the status of Kosovo as a separate entity remains unresolved, the institutions within the potential country struggle to meet the infrastructure conditions necessary for inclusion in the European Union. Ironically, the Faculty of Education at the University of Prishtina is in a remarkably advantageous position if it were to overcome the current political bickering and start the preparations required for meeting the education infrastructure criteria. This paper articulates that advantage by laying out the process by which this could be realized – with optimistic disregard for the political uncertainties that mitigate against its realization. It also provides a summary of the tasks that would need to be undertaken as part of this process.     

Analysing the integration of engineering in science lessons with the Engineering-Infused Lesson Rubric

ABSTRACT

Science teachers are being called on to incorporate engineering practices into their classrooms. This study explores whether the Engineering-Infused Lesson Rubric, a new rubric designed to target best practices in engineering education, could be used to evaluate the extent to which engineering is infused into online science lessons. Eighty lessons were selected at random from three online repositories, and coded with the rubric. Overall results documented the strengths of existing lessons, as well as many components that teachers might strengthen. In addition, a subset of characteristics was found to distinguish lessons with the highest level of engineering infusion. Findings are discussed in relation to the potential of the rubric to help teachers use research evidence-informed practice generally, and in relation to the new content demands of the U.S. Next Generation Science Standards, in particular.     

Egocentrism, ethnocentrism, and altrocentrism: factors in individual and intergroup violence

Egocentrism and ethnocentrism are considered as cognitive biases which foster violence at both individual and group levels. Each is characterized as a lack of empathy or an inability to see reality as it appears to others. Altrocentrism is conceptualized as a more mature, socialized form of perceiving in which the individual can understand another person because he sees the facts as they appear to the other. Adolescents tend to see policemen and teachers as hostile and threatening because they cannot empathize with the roles of these authority figures. Evidence indicates that violent behavior is associated with egocentric and ethnocentric thinking. Devices such as role-playing, stating the case of the other, fantasy, and the culture-assimilator foster altrocentric thinking, and some evidence indicates that they reduce the frequency of resort to violence. Cross-cultural education must begin use of such procedures if we are to minimize domestic and international violence.