Discrepancies Between Score Trends from NAEP and State Tests: A Scale-Invariant Perspective

State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most commonly used trend statistics—for example, the change in the percent of proficient students—are misleading in the context of cross-test comparisons. Substantively, it may not be reasonable to expect that NAEP and state test score trends should be similar. This paper motivates then applies a "scale-invariant" framework for cross-test trend comparisons to compare "high-stakes" state test score trends from 2003 to 2005 to NAEP trends over the same period. Results show that state trends are significantly more positive than NAEP trends. The paper concludes with cautions against the positioning of trend discrepancies in a framework where only one trend is considered "true."     

Making sense of teacher leadership in early childhood education in China

ABSTRACT

The purpose of this paper is to offer a theoretical discussion on teacher leadership in early childhood education (ECE) in Chinese contexts. Since 2010, the Chinese government has initiated a comprehensive education reform in ECE, with strategies for developing teacher leadership and promoting education quality. However, at the school level there is a lack of leadership preparation and development, along with a gap between policy initiative and its implementation. How to narrow this gap between policy and practice in teacher leadership has become a critical issue for ECE in China. This paper suggests that ‘formal role or informal role’ and ‘role or practice’ are important dimensions of teacher leadership in a Chinese, policy-driven context. In this regard, it is worth exploring how teacher leadership is conceptualized and enacted in the process of quality improvement and related contextual factors. In doing so, an agenda could be identified for future research, contributing to theories on the development of teacher leadership in the global discourse.     

Discipline and rules in four Hong Kong kindergarten classrooms: a qualitative case study

Classroom discipline is a topic of international interest and teachers are bombarded with advice regarding how to and why they should manage children’s behaviour in their classrooms. This paper draws on data related to classroom discipline gathered from a detailed classroom observation schedule, teacher interviews, and field notes with four purposively selected kindergarten teachers working in Hong Kong with children aged 5–6 years. The findings of this qualitative case study show that the teachers were concerned about disciplining children to ensure good behaviour. They expected all children to follow the rules and used characteristic discipline strategies such as stating expectations and ‘praising the opposite’ to maintain good behaviour. The paper discusses these findings in light of the Westernisation of kindergarten teaching practices in Hong Kong.     

The Impact of Multidimensionality on Extraction of Latent Classes in Mixture Rasch Models

This study investigates the effect of multidimensionality on extraction of latent classes in mixture Rasch models. In this study, two‐dimensional data were generated under varying conditions. The two‐dimensional data sets were analyzed with one‐ to five‐class mixture Rasch models. Results of the simulation study indicate the mixture Rasch model tended to extract more latent classes than the number of dimensions simulated, particularly when the multidimensional structure of the data was more complex. In addition, the number of extracted latent classes decreased as the dimensions were more highly correlated regardless of multidimensional structure. An analysis of the empirical multidimensional data also shows that the number of latent classes extracted by the mixture Rasch model is larger than the number of dimensions measured by the test.     

Reading-related behavioral characteristics of chinese children with dyslexia: The use of the teachers’ behavior checklist in Hong Kong

Primary school teachers rated the frequency of occurrence of 65 reading-related behavioral characteristics of Grade 1 to Grade 6 Chinese school children in Hong Kong. An item factor analysis based on ratings on 554 students yielded two major dimensions of behavioral characteristics on reading and writing problems, and sequencing and spatial difficulties. In predicting the literacy and cognitive skills of a separate sample of 184 school children, gender, age, and the two empirical scales developed on the basis of factor analysis were used as predictors in regression analyses. The findings indicated that reading and writing problems emerged as the most predominant predictor of various literacy and cognitive deficits. The two mean scores of behavioral characteristics for children with dyslexia were significantly elevated as compared with those for children without dyslexia. Implications of the findings for screening dyslexia and predicting specific cognitive deficits using classroom-based behavior checklists are discussed.     

Are health professional competency assessments transferable across cultures? A preliminary validity study

This study investigated if professional competency assessments are transferable across cultures using COMPASS®: Competency assessment in speech pathology, a tool developed and validated in Australia. Students in Hong Kong were assessed by clinical educators using COMPASS® and the usual clinical evaluation forms. Analyses compared Hong Kong data with the original Australian field trial data. Rasch analysis was used to evaluate how well the ratings and score generated represented students’ development of competency. Hong Kong clinical educators’ ratings represented the same seven distinct categories of judgement as Australian clinical educators. The order of item difficulty was very similar for the two samples. However, Hong Kong clinical educators were not rating students in a pattern that reflected increasing competency with experience and very few year 4 students were rated at entry level. It is concluded that an assessment tool validated and developed in one culture may well support valid judgements and yield measures that can be used to judge student competency in another culture. Further evaluation is required to investigate the differences in the judgement of student progress in another culture and strengthen the validity of using its measures to judge students' competency performance.     

Scientific epistemic beliefs, conceptions of learning science and self-efficacy of learning science among high school students

This study examined the relationships among Taiwanese high school students’ scientific epistemic beliefs, conceptions of learning science, and self-efficacy of learning science. The questionnaire responses gathered from 377 high school students in Taiwan were utilized to elicit such relationships. The analysis of the structural equation model revealed that students’ absolutist scientific epistemic beliefs led to lower-level conceptions of learning science (i.e. learning science as memorizing, preparing for tests, calculating, and practicing) while sophisticated scientific epistemic beliefs might trigger higher-level conceptions of learning science (i.e. learning science as increase of knowledge, applying, and attaining understanding). The students’ lower-level conceptions of learning science were also found to negatively associate with their self-efficacy of learning science, while the higher-level conceptions of learning science fostered students’ self-efficacy. However, this study found that students who viewed scientific knowledge as uncertain (advanced epistemic belief) tended to possess lower self-efficacy toward learning science.     

Predicting associated statutes for legal problems

Applying text mining techniques to legal issues has been an emerging research topic in recent years. Although a few previous studies focused on assisting professionals in the retrieval of related legal documents, to our knowledge, no previous studies could provide relevant statutes to the general public using problem statements. In this work, we design a text mining based method, the three-phase prediction (TPP) algorithm, which allows the general public to use everyday vocabulary to describe their problems and find pertinent statutes for their cases. The experimental results indicate that our approach can help the general public, who are not familiar with professional legal terms, to acquire relevant statutes more accurately and effectively.     

Development of a computer‐based visualised quantitative learning system for playing violin vibrato

Traditional methods of teaching music are largely subjective, with the lack of objectivity being particularly challenging for violin students learning vibrato because of the existence of conflicting theories. By using a computer‐based analysis method, this study found that maintaining temporal coincidence between the intensity peak and the target frequency is the crucial factor for achieving good intonation when performing vibrato. This finding prompted the development of a computer‐based visualised quantitative vibrato analysis system (VQVA‐Sys) that displays these two parameters in a user‐friendly manner for both musicians and scientists: (1) the type of frequency variation and (2) the corresponding frequencies with the highest intensities during all of the cycles constituting a vibrato note. A follow‐up preliminary experimental investigation compared a moderately expressive vibrato note played by eight experts and eight students, and demonstrated the feasibility and potential usefulness of the VQVA‐Sys as a learning tool.     

A technique for tracking the reading rate to identify the e‐book reading behaviors and comprehension outcomes of elementary school students

Tracking individual reading behaviors is a difficult task, as is carrying out real‐time recording and analysis throughout the reading process, but these aims are worth pursuing. In this study, the reading rate is adopted as an indicator to identify different reading behaviors and comprehension outcomes. A reading rate tracking technique is thus developed with an Interactive E‐book Learning System (IELS), and this study examines whether the reading rate detected by this system can properly reflect the actual reading behaviors and comprehension outcomes of users. A total of 500 quantitative records were collected from the reading profiles of 43 fifth‐grade students, separated into two groups for oral and silent reading behaviors, and then analyzed to reveal the reading rates accounting for specific reading behaviors and comprehension outcomes. Our findings indicate that the reading rate can accurately reflect students' reading behaviors. In addition, a somewhat positive correlation between reading rates and comprehension outcomes was only found in the silent reading group. By using the technique presented in this work, the reading behaviors related to e‐books can be easily interpreted based on the reading rate over time throughout the reading process, something that is much more difficult when using printed books. Based on the results of this work, it is anticipated that educators can get better insights into students' behaviors with regard to reading, so as to deliver more personalized and effective instruction.