Summative Evaluation

Summative evaluation is defined as the process of determining the value, effectiveness, or efficiency of an object to form a decision–making basis about that object. In this article, we present an overview of one major aspect of summative evaluation–the planning process–and then present essays on five topics that we believe are difficult issues most often faced in the conduct of summative evaluation. These five topics are: (a) client commitment to evaluation; (b) evaluating the training organization; (c) evaluating management training; (d) institutionalizing the evaluation process; and (e) the conduct of cost benefit studies.     

Solutions to Literacy Deficiencies in the Workplace; A Survey of Current Practices

Much attention has focused on employee basic skill (literacy) problems in recent years. Most authorities on the topic have focused their attention on two solutions alone: (a) offering in-house training to employees short-term solution intended to rectify existing basic skill deficiencies in the workforce; and (b) supporting public education as a long-term solution intended to ensure that future job applicants/employees possess basic skills adequate for beginning work. Few writers or authorities have suggested alternative performance improvement strategies to address basic skill problems. This article identifies a range of performance improvement strategies for addressing basic skill deficiencies and summarizes results of a recent survey of training and development professionals about how often these strategies are used in their organizations. In general, many survey respondents indicated that their organizations are using many different performance improvement strategies to address basic skill problems.     

A strategy for the delivery of accountable school psychological services

A survey of representative teachers in a school district of 8,000 students was used as a basis for evaluating psychological services. Reactions suggested that teachers were dissatisfied with: (a) the wait in receiving service, (b) the nature of the services provided (not enough placement in special programs), and (c) limited follow-up of cases. A new procedure for providing psychological services is described which handles many of the teachers' concerns. The advantages, possible limitations and initial reactions to this “accountability” model are further presented.     

Developmental Disabilities and the Concept of School Readiness

This paper reviews the concept of school readiness as it applies to children with disabilities. It is argued that children with disabilities are of two primary types: normative and non-normative. The majority of children in special education are in the non-normative category, whose definition is based on failures in children's early encounters with the educational system. Classification of such children as "not-ready for school" is a function of bureaucratic definition, teacher variability, and the child's ethnicity and social class. The authors have taken the position that children in both disability categories should be considered appropriate for regular general education and that the readiness concept which appears to be most appropriate for children with labeled special needs is actually not appropriate for any child.     

On the Effectiveness of Pop-Up English Language Glossary Accommodations for EL Students in Large-Scale Assessments

This study examined the effectiveness and influence on validity of a computer-based pop-up English glossary accommodation for English learners (ELs) in grades 3 and 7. In a randomized controlled trial, we administered pop-up English glossaries with audio to students taking a statewide accountability English language arts (ELA) and mathematics assessments. As is typically found, EL students exhibited lower achievement scores than non-EL students in all portions of the test. The pop-up glossaries provided inconsistent benefit for EL students. There was some evidence that the pop-up English glossaries had a minimal inhibitory effect for 3rd-grade students on both the ELA and mathematics assessment. Furthermore, 7th-grade ELs also showed slightly inhibited performance when using the pop-up glossary on the mathematics assessment. However, 7th-grade EL students had a performance benefit when using the pop-up glossary on the ELA assessment. We discuss how increased cognitive load placed on younger students may play a role in diminishing performance when using pop-up glossaries. We explore potential explanations for the difference outcomes between mathematics and ELA in grade 7.     

Globalisation,knowledge economy and comparative education

This paper seeks to introduce this special issue by setting out what seem to be some of the major theoretical and methodological issues raised for comparative education by the increasing prominence of the discourses of the knowledge economy, which, it is argued, represent a particularly strong version of globalisation and its possible relationships to education systems, and hence an especially acute challenge to comparative education. It focuses on the possible implications of these changes for each of the three elements of ‘national education system’. In terms of the ‘national’ it discusses the nature and consequences of methodological nationalism, and emphasises the emerging pluri‐scalar nature of the governance of education. In terms of ‘education’, it argues that education is now being asked to do different things in different ways, rather than the same things in different ways. In terms of ‘system’, it is suggested that the constitution of education sectors may be in the process of changing, with a development of parallel sectors at different scales with different responsibilities. Overall, the article suggests that we may be witnessing the development of a new functional, scalar and sectoral (non zero sum) division of the labour of educational governance. Finally, it addresses the question ‘what is now to be compared’ and considers the consequences for both ‘explaining’ and ‘learning’ through comparative education.