Research Abstracts and Bibliographies

ABSTRACT

The authors address the reliability of scores obtained on the summative performance assessments during the pilot year of our research. Contrary to classical test theory, we discussed the advantages of using generalizability theory for estimating reliability of scores for summative performance assessments. Generalizability theory was used as the framework because of the flexibility this approach provides for examining sources of inconsistency within a complex assessment. Two major sources of inconsistency on scores considered in this study were raters and agencies (teachers' rating vs. researchers' rating). Overall, results showed that the inconsistency in scores attributable to raters and agencies was relatively small. Suggestions regarding improvement of consistency in the subsequent years of our research were provided.     

The Novice-Expert Continuum in Astronomy Knowledge

The nature of expertise in astronomy was investigated across a broad spectrum of ages and experience in China and New Zealand. Five hypotheses (capable of quantification and statistical analysis) were used to probe types of expertise identified by previous researchers: (a) domain-specific knowledge-skill in the use of scientific vocabulary and language and recognising relationships between concepts in linguistic and schematic forms; (b) higher-order theory in terms of conceptual structure and enriched scientific knowledge and reasoning; with an expectation of cultural similarity. There were 993 participants in all, age 3–80 years, including 68 junior school pupils; 68 pre-school pupils; 112 middle-school students; 109 high-school students; 79 physics undergraduates; 60 parents; 136 pre-service primary teachers; 131 pre-service secondary teachers; 72 primary teachers; 78 secondary teachers; 50 amateur astronomers and astronomy educators; and 30 astronomers and physicists; with approximately equal numbers of each group in both cultures; and of boys and girls in the case of children. For them, the methodology utilised Piagetian interviews with three media (verbal language, drawing, play-dough modelling), and for adults a questionnaire inviting responses in writing and drawing was used. The data from each group were categorised into ordinal scales and then analysed by means of Kolmogorov–Smirnov two-sample tests. The findings supported the hypotheses with evidence of all forms of expertise increasing with experience in both cultures (α level 0.05). The relative gains, overlaps and deficits in expertise across the novice-expert continuum are explored in detail.     

Perceptions and Experiences of International Trainees in Counseling and Related Programs

International counseling trainees (ICTs) can play a critical role in multicultural training and enrich the lives of domestic trainers and trainees. However, they face unique barriers. This inquiry examined 14 areas related to their training and stay in the US. Findings largely correspond with those already in the literature (e.g., Ng, International Journal for the Advancement of Counseling, 28:1–19 2006a). Results indicate significantly higher mean scores for ICTs (n = 56) in 10 areas (e.g., English proficiency problems, experiencing discrimination in their learning environment) compared to domestic trainees (DTs) (n = 82). ICTs further reported a high level of confidence in their contribution to their programs and a strong belief in their performance, although these levels did not differ significantly from DTs. Findings also revealed there were no program-level differences among the ICTs in all the study areas. Compared to the master’s trainees as a whole, however, the doctoral trainees combined reported higher degrees of experiencing cultural adjustment problems and conflicts with Western understanding and approaches to treating mental health. Implications and recommendations are outlined. Findings in this study were represented at the 2008 Eastern Educational Research Association Conference in Hilton Head, South Carolina, United States of America.     

Globalization’s culture consequences of MBA education across Australia and Singapore: sophistry or truth?

A generally held view among international managers is that the cultural changes occurring in most modernizing societies may lead to similar outcomes and the erosion of cultural differences. Cultural convergence is posited to result from the homogenizing effect of technological transfers between societies. One major force which emerges from this technology transfer is the convergence of education (Webber 1969). The purpose of this study is to investigate the convergence of Masters of Business Administration (MBA) education along Hofstede’s (1997, 2001) five work-related cultural dimensions across Australia and Singapore. The pre-test and post-test quasi experimental design with control groups was employed. The findings revealed that there are convergences along Hofstede’s Individualism, Uncertainly Avoidance and Power Distance. However, the Singapore Chinese scored significantly higher on Long versus Short-term Orientation (or Confucian Work Dynamism) at both time points.     

Challenges in Building Usable Knowledge in Education

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and collected, evaluated, and made available the results of that work through the What Works Clearinghouse. Major challenges still remain for education research, however. One challenge is dealing with the replication crisis that has plagued other scientific fields and is likely to be a problem in education science. A second challenge is better supporting the generalizability of education research. A third challenge is adapting our rigorous research designs to the increasing complexity of our interventions and our questions about the mechanisms by which these interventions achieve their effects. Promising approaches to meet each of these challenges are suggested.     

A peer mentoring social learning perspective of cross-cultural adjustment: The rapid-acculturation mateship program

One of the persisting challenges facing societies and organizations is to socially integrate sojourners, expatriates, including migrants into the host culture whilst leveraging reciprocal cross-cultural learning experiences. In a quasi-experimental field study, using an embedded unequal design, incoming international students’ (i-Students’) adjustment processes were investigated via a comprehensive 18/19-week peer mentoring social learning cross-cultural adjustment program. Forty-three local mentors were paired with 126 i-Student mentees, and 238 i-Students served as a control group. Quantitative and complementary qualitative data were collected from mentees, mentors, and controls at three time-points. Results showed effects in intercultural communication, cultural adjustment, life skills, and well-being domains. Mentors’ 360-degree synchronous evaluation of mentees showed increases in all skills measured. Post-program responses from participants confirmed the increase in communication and life skills, supporting the social learning hypothesis. Theoretical and practical implications are presented to assist individuals studying and/or working with their acculturation in foreign nations.     

Intercultural competence in tourism and hospitality: Self-efficacy beliefs and the Dunning Kruger effect

This study aims to measure intercultural competence (awareness) of tourism and hospitality employees who tend to be in continuous interaction with intercultural customers. By comparing the results of a self-report awareness test/scale with the results of a knowledge-based test, the study shows that employees not only have extremely low intercultural competence, they also exaggerate their intercultural awareness/competence. Hence, in addition to the implications for intercultural competence/awareness of tourism and hospitality employees and for the businesses for which they work, the study has also implications regarding the measurement ability of self-report scales/tests.     

跨文化认同与政治修辞——基于对中美当代政治传播实践的考察

本文通过对当代中美政治修辞观念演进的历史梳理,对中美政治修辞文本构成的核心要素的比较,分析中美在政治修辞认识论与方法论上的异同,并尝试提出新时期中国政治修辞的策略要点。本文认为,政治修辞对实现跨文化认同具有重要的理论价值和实践意义。     

Generalizability of achievement goal profiles across five cultural groups: More similarities than differences

Previous results have shown possible cultural differences in students’ achievement goals endorsement and in their relations with various predictors and outcomes. In this person-centered study, we sought to identify achievement goal profiles and to assess the extent to which these configurations and their associations with predictors and outcomes generalize across cultures. We used a new statistical approach to assess latent profile similarities across adolescents from five cultural backgrounds (N = 2643, including Non-Indigenous Australians, Indigenous Australians, Indigenous American, Middle Easterners, and Asians). Our results supported the cross-cultural generalizability of the profiles, their predictors, and their outcomes. Five similar profiles were identified in each cultural group, but their relative frequency differed across cultures. The results revealed advantages of exploring multidimensional goal profiles.