Human vs. Computer Diagnosis of Students’ Natural Selection Knowledge: Testing the Efficacy of Text Analytic Software

Our study examines the efficacy of Computer Assisted Scoring (CAS) of open-response text relative to expert human scoring within the complex domain of evolutionary biology. Specifically, we explored whether CAS can diagnose the explanatory elements (or Key Concepts) that comprise undergraduate students’ explanatory models of natural selection with equal fidelity as expert human scorers in a sample of >1,000 essays. We used SPSS Text Analysis 3.0 to perform our CAS and measure Kappa values (inter-rater reliability) of KC detection (i.e., computer–human rating correspondence). Our first analysis indicated that the text analysis functions (or extraction rules) developed and deployed in SPSSTA to extract individual Key Concepts (KCs) from three different items differing in several surface features (e.g., taxon, trait, type of evolutionary change) produced “substantial” (Kappa 0.61–0.80) or “almost perfect” (0.81–1.00) agreement. The second analysis explored the measurement of human–computer correspondence for KC diversity (the number of different accurate knowledge elements) in the combined sample of all 827 essays. Here we found outstanding correspondence; extraction rules generated using one prompt type are broadly applicable to other evolutionary scenarios (e.g., bacterial resistance, cheetah running speed, etc.). This result is encouraging, as it suggests that the development of new item sets may not necessitate the development of new text analysis rules. Overall, our findings suggest that CAS tools such as SPSS Text Analysis may compensate for some of the intrinsic limitations of currently used multiple-choice Concept Inventories designed to measure student knowledge of natural selection.     

Forgeries of Fossils in “Amber”: History,Identification and Case Studies

The appeal of ancient fossilized tree resin, or amber, has made pieces with animal and plant inclusions particularly prized. Unfortunately, amber forgeries are more convincingly and routinely made than most other kinds of fossils, by embedding organisms in natural resins (e.g., copal) or synthetic resins (especially polyester) or by filling a carved niche in a natural piece of amber with resin and a modern inclusion. The confusion of organisms in copal (forged and natural) for ones in amber has a long history. Reviewed here are simple tests for discerning forgeries and natural inclusions in both substances. We discuss an old but sophisticated technique for crafting amber forgeries from authentic amber and present several new examples from old collections in two large museum collections. Also discussed is the widespread use of polyester resin forgeries in the Dominican Republic and Mexico.     

Sales Teams or Salespersons: Performance Implications for Embracing Individualistic and Collectivistic Cultural Values in a Global Marketplace

Identifying antecedents of salesperson performance is a long‐standing objective in the sales management research field. The purpose of this article is to outline how the practical understanding of, and the willingness to embrace, sales employees' cultural value‐systems adds value while considering performance drivers, individualistic versus collectivistic values, and performance outcomes. The cultural dimensions under consideration, individualism and collectivism, cannot be approached as a dichotomy. As is the case for all cultural dimensions, they represent a continuum and not absolutes. In this study, the work preferences and predispositions of participants were compared using an international data set. Respondents were culturally classified based on research (i.e., Americans and Australians as individualists and Japanese and South Koreans as collectivists). Specifically, it was found that individualists were less attached to their current work situation; collectivists indicated less work/family conflict; and individualists valued independent work more while collectivists valued deciding work time. This is important because of the need to understand how to effectively connect with the values of people to encourage positive performance outcomes. The reality is that value holds differing degrees of emphasis; the performance formula is the theoretical framework to guide this research. The implications of the results for sales management professionals are discussed.