Development of Automated Scoring Algorithms for Complex Performance Assessments: A Comparison of Two Approaches

Performance assessments are typically scored by having experts rate individual performances. The cost associated with using expert raters may represent a serious limitation in many large-scale testing programs. The use of raters may also introduce an additional source of error into the assessment. These limitations have motivated development of automated scoring systems for performance assessments. Preliminary research has shown these systems to have application across a variety of tasks ranging from simple mathematics to architectural problem solving. This study extends research on automated scoring by comparing alternative automated systems for scoring a computer simulation test of physicians'patient management skills; one system uses regression-derived weights for components of the performance, the other uses complex rules to map performances into score levels. The procedures are evaluated by comparing the resulting scores to expert ratings of the same performances.     

Blueprint for Bologna: University of Prishtina and the European Union

Countries hoping to demonstrate an adequate educational infrastructure need a national framework that meets Bologna requirements, a national accreditation agency which sets out the approved framework, and national accreditation processes by which individual institutions can be measured against the standards set by the national acvcreditation agency. For many countries, the national framework remains to be articulated, the accreditation processes are non-existent, and individual institutions have no means by which to assess their internal readiness for accreditation scrutiny. While the status of Kosovo as a separate entity remains unresolved, the institutions within the potential country struggle to meet the infrastructure conditions necessary for inclusion in the European Union. Ironically, the Faculty of Education at the University of Prishtina is in a remarkably advantageous position if it were to overcome the current political bickering and start the preparations required for meeting the education infrastructure criteria. This paper articulates that advantage by laying out the process by which this could be realized – with optimistic disregard for the political uncertainties that mitigate against its realization. It also provides a summary of the tasks that would need to be undertaken as part of this process.     

Analysing the integration of engineering in science lessons with the Engineering-Infused Lesson Rubric

ABSTRACT

Science teachers are being called on to incorporate engineering practices into their classrooms. This study explores whether the Engineering-Infused Lesson Rubric, a new rubric designed to target best practices in engineering education, could be used to evaluate the extent to which engineering is infused into online science lessons. Eighty lessons were selected at random from three online repositories, and coded with the rubric. Overall results documented the strengths of existing lessons, as well as many components that teachers might strengthen. In addition, a subset of characteristics was found to distinguish lessons with the highest level of engineering infusion. Findings are discussed in relation to the potential of the rubric to help teachers use research evidence-informed practice generally, and in relation to the new content demands of the U.S. Next Generation Science Standards, in particular.     

Egocentrism, ethnocentrism, and altrocentrism: factors in individual and intergroup violence

Egocentrism and ethnocentrism are considered as cognitive biases which foster violence at both individual and group levels. Each is characterized as a lack of empathy or an inability to see reality as it appears to others. Altrocentrism is conceptualized as a more mature, socialized form of perceiving in which the individual can understand another person because he sees the facts as they appear to the other. Adolescents tend to see policemen and teachers as hostile and threatening because they cannot empathize with the roles of these authority figures. Evidence indicates that violent behavior is associated with egocentric and ethnocentric thinking. Devices such as role-playing, stating the case of the other, fantasy, and the culture-assimilator foster altrocentric thinking, and some evidence indicates that they reduce the frequency of resort to violence. Cross-cultural education must begin use of such procedures if we are to minimize domestic and international violence.     

Technique and timing in women's inward two and one half somersault tuck (405C) and the men's inward two and one half somersault pike (405B) 3 m springboard dives

The purpose of this study was to compare the inward two and one half somersault dive in a tuck position (405C) performed by females (n = 22) and the inward two and one half somersault dive in a pike position (405B) performed by males (n = 24) to determine changes required by females to successfully perform 405B. Key performance variables in inward dives were also compared to those of backward dives. Video data of the dives performed at the 1999 FINA World Diving Cup were captured and digitized to obtain times and postures of the divers at specific events including takeoff and entry. Estimates of flight height and mass-normalised work done on the springboard were obtained from flight times. Some females worked the springboard strongly enough to generate sufficient height and rotation to perform 405B. Males performed 405B comfortably because they achieved better height and rotation than the females. A comparison of backward and inward dives revealed that divers are able to attain greater height in backward dives than inward dives.     

Reciprocal Negative Affect in Parent-Child Interactions and Children's Peer Competency

The relationship between preschool children's peer competency and the exchange of reciprocal negative affect displays during physical play with parents was examined. Teacher ratings of children's peer competency were obtained from children's preschools. Parents and children (41 families) were observed during a physical play paradigm called "the hand game" which permitted physically stimulating play, yet which also permitted clear recording of participants' facial expressions. Interactions were coded second by second for 8 min using a system of 12 mutually exclusive and exhaustive codes to categorize the affect displayed by participants. Fathers who typically responded to their children's negative affect displays with negative affect of their own had children who shared less, were more aggressive, and avoided others. Implications of the findings for theories of family-peer relationships are discussed.     

Three-dimensional assessment of squats and drop jumps using the Microsoft Xbox One Kinect: Reliability and validity

The Microsoft Xbox One Kinect? (Kinect V2) contains a depth camera that can be used to manually identify anatomical landmark positions in three-dimensions independent of the standard skeletal tracking, and therefore has potential for low-cost, time-efficient three-dimensional movement analysis (3DMA). This study examined inter-session reliability and concurrent validity of the Kinect V2 for the assessment of coronal and sagittal plane kinematics for the trunk, hip and knee during single leg squats (SLS) and drop vertical jumps (DVJ). Thirty young, healthy participants (age = 23 ± 5yrs, male/female = 15/15) performed a SLS and DVJ protocol that was recorded concurrently by the Kinect V2 and 3DMA during two sessions, one week apart. The Kinect V2 demonstrated good to excellent reliability for all SLS and DVJ variables (ICC ≥ 0.73). Concurrent validity ranged from poor to excellent (ICC = 0.02 to 0.98) during the SLS task, although trunk, hip and knee flexion and two-dimensional measures of knee abduction and frontal plane projection angle all demonstrated good to excellent validity (ICC ≥ 0.80). Concurrent validity for the DVJ task was typically worse, with only two variables exceeding ICC = 0.75 (trunk and hip flexion). These findings indicate that the Kinect V2 may have potential for large-scale screening for ACL injury risk, however future prospective research is required.