Young children’s photographs of measurement in the home

This article explores the use of children’s photography as a method for conducting mathematics education research with young children. Collected as part of a study focusing on the experiences with measurement children have at the start of schooling, the photographs presented here were taken by children aged five and six years, from two Australian primary schools. The children took a digital camera home and were asked to photograph things that they considered to be related to measurement. While the intended use of the photographs was to provide insight into the types of experiences children have with measurement in the home context, an additional outcome to emerge from the research was a deeper understanding relating to the strengths and weaknesses of using children’s photography and photo elicitation as a research method with young children. This article presents some of the insights gleaned from this mathematics education research, and examines the use of children’s photography and photo elicitation as a research strategy for working in early years research contexts.     

Building strong foundations for educational achievement: Language assessments in early childhood education for deaf and hard of hearing children

It is widely accepted that assessment plays a role in monitoring the development of young children with special needs in early intervention/early childhood settings. The process of assessing young children's language skills often looks for delays within a solid language foundation. However, many children who are deaf or hard of hearing (DHH) may not have a solid language foundation to assess, leading to inaccurate assessment. When we reframe how we assess language skills in children who are DHH, we ensure the assessment provides a comprehensive picture of the child's language development. It is important to modify language assessment tools where necessary while ensuring the assessment stays reliable and valid. It is critical to use multiple assessment tools to monitor the child's progress, including standardized assessments and assessment tools normed for DHH populations. Finally, it is crucial to monitor the child's skills in each language that they are using, regardless of which language is used most often. We explain why each of these factors needs to be considered in the assessment of young children who are DHH, will discuss the challenges of assessing this population, and will provide solutions to some of the challenges of assessing language skills in of young children who are DHH.     

Assessment practices of educational psychologists in Aotearoa/New Zealand: from diagnostic to dialogic ways of working

Psychologists working in education in Aotearoa/New Zealand work in diverse educational environments making day-to-day decisions informed by evidence-based practice. As a relatively small professional group with a complex work programme, they contribute to the assessments and decision-making processes of children and young people across multiple settings. This paper explores the results of a small-scale national survey of psychologists working in education through the Ministry of Education. Results showed that these psychologists use at least 25 assessment methods including assessments within behavioural, emotional, social, and cognitive domains. The assessment data are used for three primary reasons: to understand the child, inform decision-making, and contribute to discussions around appropriate interventions. The use of interviews, observation and collaboration were identified as key to their assessment practices, illustrating a preference towards more dialogic and ecological ways of working. While the majority used assessment practices that align with facilitating the learning of the child across contexts, the psychologists reported that ethical dilemmas arose when they were expected to be more diagnostic in their focus.     

Addressing the needs of Latino children: A national survey of state administrators of early childhood programs

This study consisted of a national survey of 117 state administrators of early childhood programs to examine specific challenges, strategies, and beliefs around serving Latino children and families. Four types of early childhood programs were represented: child care, Head Start, Part B-Section 619 preschool special education programs, and Part C infant-toddler programs for children with developmental disabilities. The survey consisted of 48 Likert scale items across six subscales to gather information about challenges and strategies for serving young Latino children and their families, as well as administrators’ beliefs about issues related to language development and early literacy learning, child assessment, approaches to support equity and diversity, and parental involvement. Administrators generally agreed on the importance of preserving a child's home language and the need to assess young children in either their home language or their home language and English. All four groups held similar views about strategies. The study found less agreement among groups on issues related to challenges, approaches to promoting diversity, and strategies for promoting parental involvement.     

The diagnosis of LD in English learners: is it nondiscriminatory?

This study examined the operationalization of one of the key reforms initiated by the Education for All Handicapped Children Act of 1975 (U.S. Congress, 1975) and continued through the 2004 reauthorization of the Individuals with Disabilities Education Act (U.S. Congress, 2004)--namely, nondiscriminatory assessment. The original and current specifications in federal law require that tests be selected and administered so as not to be racially, culturally, or sexually discriminatory. The specific dimensions studied here pertain to the nondiscriminatory diagnosis of learning disabilities (LD) in English learners. A checklist of legal and professional guidelines for making assessments of English learners was used to evaluate 19 psychological reports made on English learners as part of the assessment process for special education eligibility in a small, urban elementary school district in California. The results of this study present a fairly compelling profile of how the writers of psychological reports--school psychologists--do not use extant legal or professional guidelines for making nondiscriminatory assessments of bilingual children.     

Early mathematics assessment: validation of the short form of a prekindergarten and kindergarten mathematics measure

In recent years, there has been increased interest in improving early mathematics curricula and instruction. Subsequently, there has also been a rise in demand for better early mathematics assessments, as most current measures are limited in their content and/or their sensitivity to detect differences in early mathematics development among young children. In this article, using data from two large samples of diverse populations of prekindergarten and kindergarten children, we provide evidence regarding the psychometric validity of a new theory-based early mathematics assessment. The new measure is the short form of a longer, validated measure. Our results suggest the short form assessment is valid for assessing prekindergarten and kindergarten children’s numeracy and geometry skills and is sensitive to differences in early mathematics development among young children.     

Exploring the context of strengths – a new approach to strength-based assessment

Since the 1990s many strength-based assessments (for example, inventories, checklists, interview schedules) have been developed for use with children and young people, but these have offered a limited appraisal of the contexts in which strengths are present. In this study a new form of contextualised strength-based assessment was used within the routine practice of an educational psychologist. A multiple case study explored how this approach worked with eight children and young people referred to a local authority educational psychology team, ranging in age from 6.9 to 19.2 years. Qualitative data were analysed holistically using a story-board method. In all cases, participants identified situations or contexts which they associated with the presence of specific strengths. In some cases they highlighted aspects of a situation which might be hypothesised to have pedagogical value. There is discussion of the tensions that can arise in using this approach in schools when a more negative view of a pupil has already emerged. Nevertheless, the introduction of fresh information, about the type of contexts which suited specific children and young people, was helpful in providing ideas and recommendations which may have otherwise been missed.     

The use of the developmental test of visual-motor integration as a group screening instrument

This article investigates teacher use of the Developmental Test of Visual Motor Integration (VMI) as a screening instrument with groups of young school-age children. Individual vs. group administrations of the VMI yielded comparable scores for kindergarten children. In addition, the scoring agreement between instructional staff (first-grade teachers and resource teachers in the area of Learning Disabilities) and a school psychology extern was investigated. Correlational data yielded only a fair degree of agreement (0.68 to 0.73); this finding coupled with the concerns of teachers regarding the clarity of scoring criteria statements argues for some refinement of the scoring system in order to improve consistency in scoring.     

Using Teleconsultation to Develop Independent Skills of School-Based Behavior Teams in Functional Behavior Assessment

ABSTRACT

The Iowa Department of Education (DE) has a history of partnering with the Biobehavioral Service (BBS) at the Center for Disabilities and Development to consult with educational teams in Iowa schools regarding students exhibiting challenging behavior. In 2009, the DE requested that BBS consultants improve behavior assessment skills of school-based behavior teams across the state. One aim of the DE was to develop school-based behavior teams who could independently conduct the full range of behavior assessments (i.e., indirect assessment, direct assessment, and experimental analyses). The BBS consultants worked with challenging behavior teams from eight Iowa Area Education Agencies, teaching them to independently design, conduct, and interpret a variety of behavior assessments (e.g., preference assessments, functional analyses). A three-stage teleconsultation model was developed during consultation visits to support and evaluate the independent assessment practice of consultees. The stages included in-person consultation, onsite teleconsultation, and remote teleconsultation. Consultees expressed satisfaction with the use of teleconsultation during the third stage of the model. Additionally, the use of videoconferencing addressed some of the barriers to conducting team-based behavior assessments in the school setting by creating observation and assessment rooms for team members. Consultees continue to use this method as they independently assess the behavior of students.     

A Study of Home Emergent Literacy Experiences of Young Latino English Learners

This empirical study explored the home environment literacy practices of young Latino English learners and their families. The participants were 217 incoming Kindergarten Latino EL students and parents. The data collection included a completed HLEQ by the parents. In addition, children were administered the PPVT, the preLAS, the PALS-K screening, the Woodcock Reading Mastery assessment, and the Wide Range Achievement test. All of the literacy assessments given to the children provided the researchers with comprehensive look at their literacy knowledge base. The results of this study indicate that there were two significant paths for students’ achievement: availability of books and child initiated literacy factors that were directly related to the phonological processing efforts of students.     

The early assessment conundrum: Lessons from the past,implications for the future

The early childhood educational field has garnered attention with initiatives to foster skill acquisition in young children prior to kindergarten entry. These initiatives, in conjunction with the rigorous demands of curricular reform and a burgeoning accountability movement, invoke questions regarding the adequacy of the instruments used to assess young children and the inherent difficulties in conducting such assessments. Because the effectiveness of education relies critically on the sound diagnoses of children's readiness for learning and the measurement of their subsequent progression throughout the schooling process, critical issues in early assessment must be addressed. An examination of past practices was synthesized with recent research to focus awareness on the insufficient content domain, restrictive context, adverse timing and questionable psychometric properties, specifically the inappropriate norms and low predictive validity, of many instruments. Both the implications of and compensatory strategies for each issue are considered. © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 737–749, 2004.     

Achieving Form-to-Form Comparability: Fundamental issues and Proposed Strategies for Equating Performance Assessments of Teachers

The purpose of this article is to describe some of the measurement issues encountered in the equating of performance assessments designed for use in making teacher certification decisions. As some teacher certification programs move from sole reliance on multiple-choice items to inclusion of complex performance tasks, difficult measurement issues related to equating may arise. A variety of analytic and judgmental strategies are described in this article that may provide solutions for addressing these equating issues. Analytic strategies are based on examinee data and involve the modification of existing equating procedures, such as linear and equipercentile methods, that have been used successfully in the past with test forms composed of multiple-choice items. Judgmental strategies for equating involve the use of expert judgments to determine the equivalence of scores obtained from alternate forms of an assessment instrument.     

Assessing learning in the early years’ outdoor classroom: examining challenges in practice

The benefit the outdoor environment has for young children’s development is widely documented. However, there is less literature outlining practitioners’ experiences of assessing learning in the outdoors and factors which impact the level and quality of assessments undertaken. This study, based on a pragmatic mixed methods approach, undertaken in 9 early years’ settings in North Wales, reports the findings of 37 practitioners. The research suggests that assessing children in the outdoors is not used to its potential. Factors impeding the use of the outdoor classroom include: lack of appropriate resources; level of staff expertise; child-staff ratio; adverse weather; and changes to curriculum policy which place emphasis on the formal assessment of children. There appears to be assumptions about learners most likely to benefit from outdoor learning and assessment: boys; children in socio-economically deprived areas; and children with additional learning needs. The paper highlights the need for broader training opportunities for practitioners on planning for learning and assessment in the outdoors that go beyond a single course focus. With creative planning, there is no reason why summative assessments of all areas of learning within the early years’ curriculum cannot be done as effectively outdoors as they may be being done indoors.     

Designing Reading Comprehension Assessments for Reading Interventions: How a Theoretically Motivated Assessment Can Serve as an Outcome Measure

When designing a reading intervention, researchers and educators face a number of challenges related to the focus, intensity, and duration of the intervention. In this paper, we argue there is another fundamental challenge—the nature of the reading outcome measures used to evaluate the intervention. Many interventions fail to demonstrate significant improvements on standardized measures of reading comprehension. Although there are a number of reasons to explain this phenomenon, an important one to consider is misalignment between the nature of the outcome assessment and the targets of the intervention. In this study, we present data on three theoretically driven summative reading assessments that were developed in consultation with a research and evaluation team conducting an intervention study. The reading intervention, Reading Apprenticeship, involved instructing teachers to use disciplinary strategies in three domains: literature, history, and science. Factor analyses and other psychometric analyses on data from over 12,000 high school students revealed the assessments had adequate reliability, moderate correlations with state reading test scores and measures of background knowledge, a large general reading factor, and some preliminary evidence for separate, smaller factors specific to each form. In this paper, we describe the empirical work that motivated the assessments, the aims of the intervention, and the process used to develop the new assessments. Implications for intervention and assessment are discussed.     

Powerful Portfolios for Young Children

The use of portfolio assessment is a valuable tool for teachers to use with young children to better understand how young children develop and learn. An intentional data collection and documentation system becomes a very powerful assessment tool, one that is authentic and based on children’s capabilities and strengths. Children, educators, parents, and administrators are able to see the collection of items that celebrates the child. This article will describe several aspects of the portfolio system including: what a portfolio is; it’s purposes; how to create the portfolio; and, how to use the portfolio with families.     

Validity in Assessing Self-Regulated Learning: A Comment on Perry & Winne

Perry and Winne (2006) describe their computer program, ‘gStudy’, and argue that it facilitates valid measurement of self-regulated learning (SRL) over time. This commentary addresses the assumptions underlying this argument and raises additional validity questions regarding the use of this tool. These include issues related to the development of SRL in young children, the difficulty in embedding assessments in a learning tool, and the extent to which the log analyzer can separate SRL sequences from other behavior. Finally, the extent to which behavior ‘inside’ gStudy reflects SRL in other contexts is discussed.     

Identifying young gifted children and cultivating problem solving abilities and multiple intelligences

The “Enrichment Program for Cultivating Problem Solving Abilities and Multiple Intelligences for Gifted Preschoolers” (PSMIGP program) was the first enrichment program for young gifted children in Taiwan. It was an extra-curricular program that was implemented over a 3-year period. The assessment and curriculum were designed by adapting the main part of the DISCOVER curriculum.The purpose of this paper was to introduce the identification model and to analyze the participants' performance in problem solving activities and in demonstrating their special talents. To offer enrichment services for gifted young children, the researchers developed an identification model to discover more young gifted children and serve their needs in learning, regardless of the nature of their talents, disabilities, or cultural or socio-economical status. All participating young children were screened in a three-stage process that included both objective and subjective assessments, including checklists, interviews, portfolio assessment, group intelligence tests, observation in the play corner, individual intelligence tests, and structured observation activities. It was also necessary to adjust the standardized test procedure to fit the needs of twice exceptional young children.In total there were sixty-one preschoolers participated in this three-year program, including eleven twice exceptional children and one child from a new immigrant home. Among these sixty-one preschoolers, eight of them participated in two years of the program; the others only participated in one year of the program.The results of this enrichment program found significant correlations among the measurement scores; the scores of teacher assessment of problem solving abilities also showed that most students performed well on all five kinds of problem solving types. From children's archives, participating children presented scientific thinking characteristics, such as rich knowledge with fascinating imagination and the ability to seek many approaches to solving problems. They were delighted to challenge others and pleased to be challenged. The twice exceptional children also performed well in the program, especially those children with autism whose progress in social skills and group adaptability were remarkable. In sum, the researchers in this program had a belief that children, whether gifted or not, did not get the satisfaction of making progress until they had opportunities to find and develop their potentials.     

Karaoke Night at the Tower of Babel: The Cacophonous Discourse of School Reform

Written for the general public, this article unpacks the “dialogue gap” in education and raises concerns about what can happen when groups dependent on one another are not talking. Part of the problem involves a matter of scale; policymakers rarely talk about children as individuals as opposed to as aggregates. The larger policy context loses the child in the push to have standardized assessments drive instruction. We are challenged to include students in conversations about assessment and achievement so that they might embrace our ambitions and achieve the standards they hold for themselves.     

Detecting Measurement Disturbances in Rater‐Mediated Assessments

The term measurement disturbance has been used to describe systematic conditions that affect a measurement process, resulting in a compromised interpretation of person or item estimates. Measurement disturbances have been discussed in relation to systematic response patterns associated with items and persons, such as start‐up, plodding, boredom, or fatigue. An understanding of the different types of measurement disturbances can lead to a more complete understanding of persons or items in terms of the construct being measured. Although measurement disturbances have been explored in several contexts, they have not been explicitly considered in the context of performance assessments. The purpose of this study is to illustrate the use of graphical methods to explore measurement disturbances related to raters within the context of a writing assessment. Graphical displays that illustrate the alignment between expected and empirical rater response functions are considered as they relate to indicators of rating quality based on the Rasch model. Results suggest that graphical displays can be used to identify measurement disturbances for raters related to specific ranges of student achievement that suggest potential rater bias. Further, results highlight the added diagnostic value of graphical displays for detecting measurement disturbances that are not captured using Rasch model–data fit statistics.     

Assessing Differential Item Functioning in Direct Writing Assessments: Problems and an Example

The recent emphasis on various types of performance assessments raises questions concerning the differential effects of such assessments on population subgroups. Procedures for detecting differential item functioning (DIF) in data from performance assessments are available but may be hindered by problems that stem from this mode of assessment. Foremost among these are problems related to finding an appropriate matching variable. These problems are discussed and results are presented for three methods for DIF detection in polytomous items using data from a direct writing assessment. The purpose of the study is to examine the effects of using different combinations of internal and external matching variables. The procedures included a generalized Mantel-Haenszel statistic, a technique based on meta-analysis methodology, and logistic discriminant function analysis. In general, the results did not support the use of an external matching criterion and indicated that continued problems may be expected in attempts to assess DIF in performance assessments.