纵向量表制作浅谈

等值(equating)和纵向量表化(vertical scaling)的功用是建立来自不同考试的分数之间的关系。等值是施用于相同年级,相同性质的试卷,而纵向量表化则用于不同年级而性质相似的试卷。纵向量表化是将不同年级的成绩放置于统一的成长分数量表之中。纵向量表(vertical scale)是一种延伸的分数,其度量跨越和串连不同年级之间,用以评估学生连继性的成就成长(Nitko,2004)。在教学中,学生的进度可以利用纵向量表来监察和评估。而在教育研究上,纵向量表可成为长期跟踪调查(longitudinal study)之有力工具。本文讨论纵向量表化的方法论,包括成长定义(definition of growth),数据收集(data collection)方法,试卷设计和使用项目反应理论(Item Response Theory)的方法以及对制作纵向量表提供一些实际的建议。     

The Impact of Vertical Scaling Decisions on Growth Interpretations

Most growth models implicitly assume that test scores have been vertically scaled. What may not be widely appreciated are the different choices that must be made when creating a vertical score scale. In this paper empirical patterns of growth in student achievement are compared as a function of different approaches to creating a vertical scale. Longitudinal item‐level data from a standardized reading test are analyzed for two cohorts of students between Grades 3 and 6 and Grades 4 and 7 for the entire state of Colorado from 2003 to 2006. Eight different vertical scales were established on the basis of choices made for three key variables: Item Response Theory modeling approach, linking approach, and ability estimation approach. It is shown that interpretations of empirical growth patterns appear to depend upon the extent to which a vertical scale has been effectively “stretched” or “compressed” by the psychometric decisions made to establish it. While all of the vertical scales considered show patterns of decelerating growth across grade levels, there is little evidence of scale shrinkage.     

A Comparison of Developmental Scales Based on Thurstone Methods and Item Response Theory

A developmental scale for the North Carolina End-of-Grade Mathematics Tests was created using a subset of identical test forms administered to adjacent grade levels. Thurstone scaling and item response theory (IRT) techniques were employed to analyze the changes in grade distributions across these linked forms.Three variations of Thurstone scaling were examined, one based on Thurstone's 1925 procedure and two based on Thurstone's 1938 procedure. The IRT scaling was implemented using both B i M ain and M ultilog .All methods indicated that average mathematics performance improved from Grade 3 to Grade 8, with similar results for the two IRT analyses and one version of Thurstone's 1938 method.The standard deviations of the IRT scales did not show a consistent pattern across grades, whereas those produced by Thurstone's 1925 procedure generally decreased; one version of the 1938 method exhibited slightly increasing variation with increasing grade level, while the other version displayed inconsistent trends.     

Scaling: An ITEMS Module

Scaling is the process of constructing a score scale that associates numbers or other ordered indicators with the performance of examinees. Scaling typically is conducted to aid users in interpreting test results. This module describes different types of raw scores and scale scores, illustrates how to incorporate various sources of information into a score scale, and introduces vertical scaling and its related designs and methodologies as a special type of scaling. After completion of this module, the reader should be able to understand the relationship between various types of raw scores, understand the relationship between raw scores and scale scores, construct a scale with desired properties, evaluate an existing score scale, understand how content and standards information are built into a scale, and understand how vertical scales are developed and used in practice.     

Student evaluation of teaching: the use of best–worst scaling

An important purpose of student evaluation of teaching is to inform an educator’s reflection about the strengths and weaknesses of their teaching approaches. Quantitative instruments are one way of obtaining student responses. They have traditionally taken the form of surveys in which students provide their responses to various statements using item-by-item agree/disagree ratings. Previous research has identified shortcomings of such rating scales, including response bias and the associated lack of discrimination amongst the items evaluated. In this paper, best–worst scaling is proposed as a novel method for quantitative teaching evaluation. The way in which best–worst scaling can be used in this context is illustrated in three different applications. Two applications demonstrate how it can be used for evaluations in a small-size classroom environment. The third application is a broader evaluation of university courses on a larger scale. In comparison with conventional rating scales, the best–worst scaling approach enables better highlighting of the differences between evaluation items. In doing so, it can provide enhanced guidance to educators in their reflection about their teaching. Moreover, implementation and analysis of a best–worst scaling evaluation is relatively straightforward, which establishes it a feasible method for teaching practitioners and researchers.     

A Developmental Approach to the Education of Young Children

A developmental approach to the curriculum for young children takes into account the principle that what children should learn, and how they can best learn, changes with their age and the experience that comes with age. Several principles of practice emerge from this basic developmental principle. For example, as children grow older, what they learn changes from horizontal to greater vertical relevance. Similarly, the younger the learner, the more is learned through interactive and active processes rather than through passive and receptive processes. In addition, the younger the learner, the greater the urgency of helping them acquire basic social competence, which is very difficult to acquire later on. These developmental principles of practice imply that a curriculum for young children should include the opportunity to work in small groups on extended investigations of real phenomena in the children's own environments.     

Sensitivity of School-Performance Ratings to Scaling Decisions

Policymakers usually leave decisions about scaling the scores used for accountability to their appointed technical advisory committees and the testing contractors. However, scaling decisions can have an appreciable impact on school ratings. Using middle-school data from New York State, we examined the consistency of school ratings based on two scaling approaches that differed in scaling decisions that are important in high-stakes testing contexts. We found that, depending on subject, grade, and year, a switch in scaling approach led to (1) average absolute shifts in ranks of between 50 and 132 positions (median = 69), which are appreciable shifts for a listing of 1,243 schools; and (2) between 7% and 45% (average = 20%) of schools experiencing shifts in assigned performance bands, depending on the classification scheme. Further, the effect of scaling approach was larger when the raw-score distribution has more severe ceiling effect, and in these cases, it was driven primarily by the difference in the location of the highest obtainable scale score from the two scaling approaches.     

Reciprocal influences among relational self-views, social disengagement, and peer stress during early adolescence

This study examined reciprocal-influence models of the association between relational self-views and peer stress during early adolescence. The first model posited that adolescents with negative self-views disengage from peers, creating stress in their relationships. The second model posited that exposure to peer stress fosters social disengagement, which elicits negative self-views. Participants were 605 early adolescents (M age = 11.7). As part of a 3-wave longitudinal study adolescents reported on self-views and stress, and teachers reported on social disengagement. As hypothesized, negative self-views predicted social disengagement, which contributed to peer stress. Stress predicted subsequent disengagement and negative self-views. These findings suggest that adolescents and their environments participate in reciprocal-influence processes that account for cross-temporal continuity in personal attributes of youth and their social experiences.     

Developmental dyslexia: A review of biological interactions

The discovery of biological substrates underlying medical conditions is an important step for their better understanding and for the design of appropriate medical therapies. In the case of developmental dyslexia pedagogic treatment may fail, thus creating a group of individuals in whom medical approaches may be entertained. The biological substrate(s) of developmental dyslexia has yet to be specified, although a few clues are beginning to emerge. In this review I consider the issue of cerebral dominance and brain asymmetry, the development of the cerebral cortex and examples of aberrancy, and diseases of the immune system, all of which relate to recent anatomical and epidemiological findings in developmental dyslexia. These discoveries have been able to lead to the creation of testable hypotheses which, after appropriate experimental work, are apt to enhance our current understanding of this and other developmental learning disorders.     

Simplicity and complexity in child language and its explanation

Abstract

Theories of early language development differ in the degree of abstraction granted to the early stages, and in the perspectives these adopt with regards to the interaction between lexicon and syntax. The paradigm associated with generative approaches and the continuity hypothesis attributes early complexity and abstraction to access to innate knowledge of structure. The paradigm generally identified with emergentist/general learning approaches assumes complexity is an emergent property that arises from experience. Comparing paradigms is difficult because they pursue different goals: one focuses on developmental stages and the other on the nature of representation at each stage. The core claim of generative approaches is that the product of lexical learning must interface explicitly with a system capable of formal productivity and of supporting compositionality. The present article reviews evidence for productivity in early negation, on the growth of syntactic recursion, and on ellipsis construction, and examines the notion of merge and compositionality and their explanatory role in language and language development.     

Beyond the Rhetoric of Empowerment: Speak the Language, Live the Experience of the Rural Poor

Growth in rural communities, along with attendant changes in social, economic and environmental conditions, challenges members of these communities to take even more responsibility for their lives than in the past. While there is a need to promote sustainable economic prosperity, it is important that developmental approaches should not compromise the potential of citizens to meet these challenges independently. The present contribution is based on a phenomenological study that explored approaches to community development in Botswana. One of the key findings was that these were dominated by a bureaucratized welfare scheme, as the government gave free food and farming implements to poor people in an approach referred to as atlhama-o-je (‘open-your-mouth-and-eat’). The present contribution reflects on the consequences of using this type of approach, arguing that instead of bringing real hope to the rural poor, it generated counterproductive attitudes. In conclusion, the authors suggest alternative strategies that take account of the life experiences of the rural poor and render them less dependent on government intervention for their well-being.     

Beyond the Rhetoric of Empowerment: Speak the Language, Live the Experience of the Rural Poor

Growth in rural communities, along with attendant changes in social, economic and environmental conditions, challenges members of these communities to take even more responsibility for their lives than in the past. While there is a need to promote sustainable economic prosperity, it is important that developmental approaches should not compromise the potential of citizens to meet these challenges independently. The present contribution is based on a phenomenological study that explored approaches to community development in Botswana. One of the key findings was that these were dominated by a bureaucratized welfare scheme, as the government gave free food and farming implements to poor people in an approach referred to as atlhama-o-je (‘open-your-mouth-and-eat’). The present contribution reflects on the consequences of using this type of approach, arguing that instead of bringing real hope to the rural poor, it generated counterproductive attitudes. In conclusion, the authors suggest alternative strategies that take account of the life experiences of the rural poor and render them less dependent on government intervention for their well-being.     

Checking the underlying structure of R-SPQ-2F using covariance structure analysis / Comprobación de la estructura subyacente del R-SPQ-2F mediante análisis de estructura de covarianza

The R-SPQ-2F is an instrument used in many studies to measure learning approaches. However, its internal structure is still a matter of debate. It is important to confirm its underlying structure in order to find out which variables are being measured with it. A survey method is used with 279 students of the Faculty of Education at the University of León, and alternative models found in the literature are compared using covariance structure analysis, specifically, Confirmatory Factor Analysis (CFA). We conclude that the structure that best fits the data is a two-factor structure in line with the results obtained in other studies. Future research should take these two primary factors into account when interpreting their findings. Solutions are also offered for improving the scale with the original 20 items.     

The Profile of Multiple Language Proficiencies: A Measure for Evaluating Language Samples of Deaf Children

This article reports the process of creating a developmental measure that assesses the multilingual capabilities of deaf children and the problems that were encountered. Because deaf children may be using more than one method of communication (e.g., sign language skills and spoken language skills), it is important to evaluate their skills as completely as possible. In a pilot study, we used a nominal scale that assessed language skills based on a single continuum, with good English and good American Sign Language (ASL) skills as its two extremes and approximately equal skills in both as the midpoint. In the main study, a more complete measure was created, the Profile of Multiple Language Proficiencies (PMLP). The PMLP uses a single scale that represents the different stages of language development that can be observed in both English and ASL. The PMLP showed reasonable initial reliability and has good promise as an easy-to-use measure of developing language skills in children who use multiple modalities of communication. Using the PMLP as a prototype, we discuss some of the issues that influence the reliability and validity in evaluating such a scale and how these can be overcome or avoided.     

Comparison of Item Response Theory and Thurstone Methods of Vertical Scaling

Vertical achievement scales, which range from the lower elementary grades to high school, are used pervasively in educational assessment. Using simulated data modeled after real tests, the present article examines two procedures available for vertical scaling: a Thurstone method and three-parameter item response theory. Neither procedure produced artifactual scale shrinkage; both procedures produced modest scale expansion for one simulated condition.     

Concurrent and Separate Grade-Groups Linking Procedures for Vertical Scaling

Reading and Mathematics tests of multiple-choice items for grades Kindergarten through 9 were vertically scaled using the three-parameter logistic model and two different scaling procedures: concurrent and separate by grade groups. Item parameters were estimated using Markov chain Monte Carlo methodology while fixing the grade 4 population abilities to have a standard normal distribution. For the separate grade-groups scaling, grade groupings were linked using the Stocking and Lord test characteristic curve procedure. Abilities were estimated using the maximum-likelihood method. In either content area, scatterplots of item difficulty, discrimination, and ability estimates from the two methods showed consistently strong linear relationships. However, as grade deviated from the base grade of four, the best-fit linear line through the pairs of item discriminations started to rotate away from the identity line. This indicated the discrimination estimates from the separate grade-groups procedure for extreme grades to be, on average, higher than those from the concurrent analysis. The study also observed some systematic change in score variability across grades. In general, the two vertical scaling approaches yielded similar results at more grades in Reading than in Mathematics.     

Scaling Up the Implementation of a Pre-Kindergarten Mathematics Curriculum: Teaching for Understanding With Trajectories and Technologies

Abstract

This study used a randomized field trial design to evaluate the efficacy of a research-based model for scaling up an intervention focused on preschool mathematics. Although the successes of research-based educational practices have been documented, equally well known is the paucity of successful efforts to bring these practices to scale. The same research corpus provides guidelines to scale up successful interventions. We designed an intervention model based on that research, including mathematics curricula with an emphasis on teaching for understanding following developmental guidelines, or learning trajectories, and using technology at multiple levels. We then implemented that model and evaluated the implementation with a limited scale up study. Within a design involving 25 classrooms serving children at risk for later school failure, we examined the impact of the model, using measures of fidelity of implementation, classroom observations of mathematics environment and teaching, and child outcomes. High levels of fidelity of implementation resulted in consistently higher scores in the intervention, compared to control, classes on the observation instrument and significantly and substantially greater gains in children's mathematics achievement in the intervention, compared to the control, children (effect size = .62).     

Interrelations between self‐efficacy and learning approaches: a developmental approach

Two major theoretical frameworks in educational psychology, namely student approaches to learning (SAL) and self‐efficacy have been used extensively to explain and predict students’ learning and academic achievement. There is a substantial body of research studies, for example, that documents the positive interrelations between individuals’ self‐efficacy beliefs and their approaches to learning. In particular, evidence ascertained from structural equation analyses suggests both a positive sense of academic self‐efficacy and deep learning approach combined to influence students’ academic achievement. More recently, albeit limited, research has focused on the study of developmental changes of these two constructs over time. As a contribution to this approach, we used latent growth curve modelling (LGM) to explore the initial states and trajectories of self‐efficacy and the two major learning approaches – surface and deep – over a two‐year period. Furthermore, we regressed both gender and academic experience as possible external correlates that could account for the change in the two theoretical frameworks. Two hundred and fifty‐two (116 females, 136 males) university students were administered Likert‐scale inventories on three occasions. SPSS AMOS showed a few major findings – notably, for example, the negative impact of academic experience on the change in self‐efficacy and the positive impact of academic experience on the initial states of self‐efficacy and surface learning approach.     

In Defense of Change Processes

Nativist and constructivist approaches to the study of development share a common emphasis on characterizing beginning and end states in development. This focus has highlighted the question of preservation and transformation—whether core aspects of the adult end state are present in the earliest manifestations during infancy. In contrast, a developmental systems approach emphasizes the process of developmental change. This perspective eschews the notions of objective starting and ending points in a developmental progression and rejects the idea that any particular factor should enjoy a privileged status in explaining developmental change. Using examples from motor development and animal behavior, we show how a developmental systems framework can avoid the pitfalls of the long and contentious debate about continuity versus qualitative change.