An Automated Item Pool Assembly Framework for Maximizing Item Utilization for CAT

Computerized adaptive testing (CAT) has gained deserved popularity in the administration of educational and professional assessments, but continues to face test security challenges. To ensure sustained quality assurance and testing integrity, it is imperative to establish and maintain multiple stable item pools that are consistent in terms of psychometric characteristics and content specifications. This study introduces the Honeycomb Pool Assembly (HPA) framework, an innovative solution for the construction of multiple parallel item pools for CAT that maximizes item utilization in the item bank. The HPA framework comprises two stages—cell assembly and pool assembly—and uses a mixed integer programming modeling approach. An empirical study demonstrated HPA's effectiveness in creating a large number of parallel pools using a real-world high-stakes CAT assessment item bank. The HPA framework offers several advantages, including (a) simultaneous creation of multiple parallel pools, (b) simplification of item pool maintenance, and (c) flexibility in establishing statistical and operational constraints. Moreover, it can help testing organizations efficiently manage and monitor the health of their item banks. Thus, the HPA framework is expected to be a valuable tool for testing professionals and organizations to address test security challenges and maintain the integrity of high-stakes CAT assessments.     

美国加州:阳光照耀的留学生活(三) 母语和韩国白领李尚美

与此女的认识过程显然要轻松许多,原因是我能够在一定程度上使用她的母语。除了课堂以外,和她一起工作的经历,也成了我宝贵的留学回忆。她便是赴美进修的韩国白领李尚美。     

Developing experience-based (tacit) knowledge through reflection

This investigation examined the effectiveness of reflection methods derived from Sternberg's theory of practical intelligence [Sternberg, R.J., and Hedlund, J. (2002). Practical intelligence, g, and work psychology. Human Performance 15(1/2), 143–160.; Sternberg, R.J., Forsythe, G.B., Hedlund, J., Horvath, H.A., Wagner, R.K., Williams, W.M., et al. (2000). Practical intelligence in everyday life. New York: Cambridge University Press. 2000] on the acquisition of experience-based, tacit knowledge. Two related experimental studies were conducted to test the effect of brief tacit-knowledge reflection training on practical problem solving. Reflection methods were developed based on Sternberg's conceptualized condition–action structure of tacit knowledge. In the first study, 101 U.S. Army officers participated in a reflection intervention or practice control. Results showed an effect of reflection condition on post-test tacit-knowledge scores (F [3, 91] = 3.74, p = .01, 2 = .03). In the second study, 235 college students participated in a reflection intervention or an academic-type reflection control. Results showed that the reflection condition approached significance on post-test scores (F [1, 233] = 3.47, p = .06, p = .06, 2 = .01). The investigation suggests this line of inquiry warrants continued study.     

In practice: Engaging men in violence prevention

The University of South Carolina offers an innovative academic course about men's roles in violence prevention. Learn how Changing Carolina has successfully changed students' views on men, violence, and prevention.     

Overshadowing and CS duration: counteraction and a reexamination of the role of within-compound associations in cue competition

In the present experiments, we examined the role of within-compound associations in the interaction of the overshadowing procedure with conditioned stimulus (CS) duration, using a conditioned suppression procedure with rats. In Experiment 1, we found that, with elemental reinforced training, conditioned suppression to the target stimulus decreased as CS duration increased (i.e., the CS duration effect), whereas, with compound reinforced training (i.e., the overshadowing procedure), conditioned suppression to the target stimulus increased as CS duration increased. In subsequent experiments, we replicated these findings with sensory preconditioning and demonstrated that extinction of the overshadowing stimulus results in retrospective revaluation with short CSs and in mediated extinction with long CSs. These results highlight the role of the duration of the stimulus in behavioral control. Moreover, these results illuminate one cause (the CS duration) of whether retrospective revaluation or mediated extinction will be observed.     

Assurance of Learning in the MIS Program

This article describes the development of a systematic and practical methodology for assessing program effectiveness and monitoring student development in undergraduate decision sciences programs. The model we present is based on a student's progression through learning stages associated with four key competencies: technical, analytical, communicative, and managerial. Key learning activities are embedded in major courses, resulting in clear and documented demonstrated abilities from the student. The work is based upon what is formally known about student outcomes assessment and input from our own Management Information Systems (MIS) program stakeholders and accrediting bodies. The results of the assurance of learning model can be, in turn, used to refine curriculum and to meet accreditation standards.     

Talented athletes and academic achievements: a comparison over 14 years

The purpose of this study was to gain insight into the academic achievements of 200 talented athletes in 1992/1993 and 200 in 2006/2007, aged 14–16 years. When compared with the national average, the athletes in 2006/2007 attended pre‐university classes more often (χ² = 57.001, p<.05). Of the 2006/2007 athletes, a higher percentage participated in pre‐university programs compared with that of athletes in 1992/1993 (χ² (1, n = 400) = 32.003, p<.05), whereas the national averages showed stability (χ² = .325, p>.05). Investigating self‐regulation appears relevant, as talented athletes may have developed a high sense of self‐regulation in sports, which may enable them to optimally profit from their self‐regulatory skills in their academics.     

Evaluating municipal websites: A methodological comparison of three think-aloud variants

Usability methods have received relatively little methodological attention within the field of E-Government. This paper aims to address this gap by reporting on a usability test of the municipal website of Deventer (the Netherlands), carried out by means of three variants of the think-aloud method (concurrent/retrospective think-aloud protocols and constructive interaction). These three methods had proved successful in a previous evaluation of a different municipal website, yet we decided to replicate our study in order to investigate whether the three methods would reveal different results when applied to another municipal website with a different information architecture. The results of our study showed that, as in the previous municipal website evaluation, the three evaluation methods were largely comparable in terms of output. Nevertheless, we did find a number of differences between the present and previous municipal website evaluation regarding the workings of the three methods—differences that could be explained by the different information architectures of the municipal websites tested. This suggests that the three evaluation methods might indeed work differently depending on the nature of the website that is being evaluated, and calls for more research into the effect of task type on the validity of evaluation methods.