Discrepancies Between Score Trends from NAEP and State Tests: A Scale-Invariant Perspective

State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most commonly used trend statistics—for example, the change in the percent of proficient students—are misleading in the context of cross-test comparisons. Substantively, it may not be reasonable to expect that NAEP and state test score trends should be similar. This paper motivates then applies a "scale-invariant" framework for cross-test trend comparisons to compare "high-stakes" state test score trends from 2003 to 2005 to NAEP trends over the same period. Results show that state trends are significantly more positive than NAEP trends. The paper concludes with cautions against the positioning of trend discrepancies in a framework where only one trend is considered "true."     

Do secondary school-leaving English examination results predict university students’ academic writing performance? A latent profile analysis

Abstract

Secondary school-leaving English examination results are often regarded as indicators of students’ competence to study in English-medium universities, which is usually demonstrated through source-based academic writing. In English as a second or foreign language (ESL/EFL) contexts, many English-medium universities require local undergraduates to enrol in an academic writing course, unless they received outstanding English results in secondary school-leaving examinations. This study investigates the relationship between ESL undergraduates’ secondary school-leaving English examination results and their academic writing performance through latent profile analysis. Results show that students can be grouped into four classes of academic writing performer (AWP), namely Complex-AWP, High-AWP, Medium-AWP and Low-AWP. Surprisingly, the Complex-AWP group had the highest means in structure, argument and language, but the lowest in citation. Secondary school-leaving English examination results can generally predict students’ class membership in language, argumentation and, to some extent, structure, but not citation. An important implication is that students with high English proficiency do not necessarily do well in all aspects of academic writing. This study can inform university senior management on how to set policies about who needs an academic writing course and provide appropriate training in various aspects of academic writing for university students with diverse English proficiency.     

Hong Kong Student Achievement in OECD-PISA Study: Gender Differences in Science Content, Literacy Skills, and Test Item Formats

This study examined gender differences in students' scientific literacy as measured by OECD-PISA. In particular, we focused on the 2437 students from 140 Hong Kong schools. Hong Kong boys' and girls' science scores did not differ overall. However, boys scored higher than girls at the higher percentiles (75th and above). Moreover, specific test components showed gender differences. Boys tended to score higher on tests with more earth and physical science items, understanding of scientific knowledge items, and closed items. Meanwhile, girls tended to score higher on recognizing questions and identifying evidence items. These results suggest that a science test assessing diverse content and literacy skills in a variety of response formats provides both a more comprehensive picture of students' capabilities and a more likely gender-equitable assessment.     

A comparative study of music education in Shanghai and Taipei: westernization and nationalization

This study compares the music taught and its associated cultural values in Shanghai and Taipei primary and secondary schools. Both owe their cultural ascendancy to traditional Chinese music and western musicology. How do the music education systems of these two Chinese communities reflect their respective public cultures and political ideologies? Data from a sample of 3204 Shanghai and Taipei Chinese school students showed that tensions between classroom music activities and pupils' musical preferences arose from the difficult preservation of cultural and political identity in both Mainland China and Taiwan. Dilemmas concerning the use of music for patriotic and ideological purposes are also discussed in this study.     

The Impact of Multidimensionality on Extraction of Latent Classes in Mixture Rasch Models

This study investigates the effect of multidimensionality on extraction of latent classes in mixture Rasch models. In this study, two‐dimensional data were generated under varying conditions. The two‐dimensional data sets were analyzed with one‐ to five‐class mixture Rasch models. Results of the simulation study indicate the mixture Rasch model tended to extract more latent classes than the number of dimensions simulated, particularly when the multidimensional structure of the data was more complex. In addition, the number of extracted latent classes decreased as the dimensions were more highly correlated regardless of multidimensional structure. An analysis of the empirical multidimensional data also shows that the number of latent classes extracted by the mixture Rasch model is larger than the number of dimensions measured by the test.     

Discipline and rules in four Hong Kong kindergarten classrooms: a qualitative case study

Classroom discipline is a topic of international interest and teachers are bombarded with advice regarding how to and why they should manage children’s behaviour in their classrooms. This paper draws on data related to classroom discipline gathered from a detailed classroom observation schedule, teacher interviews, and field notes with four purposively selected kindergarten teachers working in Hong Kong with children aged 5–6 years. The findings of this qualitative case study show that the teachers were concerned about disciplining children to ensure good behaviour. They expected all children to follow the rules and used characteristic discipline strategies such as stating expectations and ‘praising the opposite’ to maintain good behaviour. The paper discusses these findings in light of the Westernisation of kindergarten teaching practices in Hong Kong.     

In practice: Ball State University's faculty mentorship program: Enhancing the first‐year experience for students with disabilities

Students with disabilities at Ball State University have a unique mentorship opportunity—those who take advantage of it gain considerable benefits.     

Screening for Chinese Children with Dyslexia in Hong Kong: The use of the Teachers' Behaviour Checklist

Primary school teachers rated the frequency of occurrence of 65 reading‐related behavioural characteristics in a sample of 251 Grade 1 to Grade 6 Chinese school children in Hong Kong. These behavioural characteristics were in the areas of general performance, reading, dictation, writing, mathematics, language, memory, concentration, sequential ability, motor co‐ordination, spatial orientation, and social/emotional adjustment. Of these 12 areas, 10 yielded scale scores that could distinguish children with dyslexia from those without dyslexia, identified on the basis of their performance in five domains of literacy and cognitive skills. Using a summary score derived from the 10 relevant scales, an optimal cut‐off score was suggested to arrive at a balance between high sensitivity and an acceptable rate of false positives in screening for children with dyslexia. The need for cross‐replication in screening children with dyslexia using the behaviour checklist with different samples of school students is emphasised.