Exact Small-Sample Differential Item Functioning Methods for Polytomous Items With Illustration Based on an Attitude Survey

Exact nonparametric procedures have been used to identify the level of differential item functioning (DIF) in binary items. This study explored the use of exact DIF procedures with items scored on a Likert scale. The results from an attitude survey suggest that the large-sample Cochran-Mantel-Haenszel (CMH) procedure identifies more items as statistically significant than two comparable exact nonparametric methods. This finding is consistent with previous findings; however, when items are classified in National Assessment of Educational Progress DIF categories, the results show that the CMH and its exact nonparametric counterparts produce almost identical classifications. Since DIF is often evaluated in terms of statistical and practical significance, this study provides evidence that the large-sample CMH procedure may be safely used even when the focal group has as few as 76 cases.     

Generating Dichotomous Item Scores with the Four-Parameter Beta Compound Binomial Model

A Monte Carlo simulation technique for generating dichotomous item scores is presented that implements (a) a psychometric model with different explicit assumptions than traditional parametric item response theory (IRT) models, and (b) item characteristic curves without restrictive assumptions concerning mathematical form. The four-parameter beta compound-binomial (4PBCB) strong true score model (with two-term approximation to the compound binomial) is used to estimate and generate the true score distribution. The nonparametric item-true score step functions are estimated by classical item difficulties conditional on proportion-correct total score. The technique performed very well in replicating inter-item correlations, item statistics (point-biserial correlation coefficients and item proportion-correct difficulties), first four moments of total score distribution, and coefficient alpha of three real data sets consisting of educational achievement test scores. The technique replicated real data (including subsamples of differing proficiency) as well as the three-parameter logistic (3PL) IRT model (and much better than the 1PL model) and is therefore a promising alternative simulation technique. This 4PBCB technique may be particularly useful as a more neutral simulation procedure for comparing methods that use different IRT models.     

Development of the California school climate and safety survey‐short form

Planning is essential to creating safe schools and it is required by the Federal No Child Left Behind legislation (U.S. Department of Education, 2004) and implemented via district local education action plans. The implementation of these plans involves continuous monitoring and reevaluation of information pertinent to each campus. As such, this process is facilitated by the availability of measures that are simple to administer, inexpensive, and whose psychometric properties have been evaluated. The California School Climate and Safety Survey (CSCSS), originally developed by M.J. Furlong, R. Morrison, and S. Boles (1991), was specifically developed for these purposes. The CSCSS is a student self‐report questionnaire created to measure general school climate and personal safety‐related experiences. In this article, we present the results of an evaluation of the CSCSS including exploratory and confirmatory factor analyses. These analyses reduced the original CSCSS research version from 102 items to 54 items. The psychometric properties of this CSCSS‐SF (Short Form) are presented. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 137–149, 2005.     

Analogical reasoning and the development of algebraic abstraction

This paper presents a theory of the development of algebraic abstraction which extends Sfard's (1991, 1994a,b) and Mason's (1982, 1989) ideas on the learner's progress from operational or process-oriented thinking to the abstract or structural perspective. The theory incorporates a process of analogical reasoning to account for the means by which the learner might construct expressions of generality and subsequently manipulate them as mathematical objects. Such reasoning entails similarity comparisons in which a mapping is made between the corresponding relational properties of algebraic examples. These comparisons may firstly entail unpacking the relations in the examples in order to highlight the structural commonalities. The common relational structure is subsequently extracted to form a knowledge basis, namely, the construction of a mental model or representation that expresses the observed generalisation. The theory is applied to an analysis of secondary school students' approaches to classifying a set of complex equations. A student who appeared capable of algebraic abstraction within the domain of the task is contrasted with two students who were at a pseudostructural stage, where their focus on syntactic surface structures prevented them from forming the relational mappings needed for the construction of generalised models of the equation types.     

On the nature of institutional research and the knowledge and skills it requires

This paper offers a conception of institutional research as comprising three tiers of organizational intelligence. The first tier, technical and analytical intelligence, requires familiarity with the basic analytical processes of institutional research. The second tier, issues intelligence, requires knowledge of substantive institutional management issues in four areas: students, faculty, finances, and facilities. The third tier, contextual intelligence, requires understanding of the history and culture of higher education in general and of the particular campus on which one works. The kinds of knowledge and skills required at each level are also discussed, as are the ways in which each form of intelligence is acquired.Presented at the Annul Forum of the Association for Institutional Research, San Francisco, May 1991.     

A Critical Analysis of the Sources of Reading Recovery: An Empiricist Perspective

This discussion of the sources of Reading Recovery presents the results of an investigation into whether or not this relatively costly, tutoring remedial reading program, designed for primary-grade students, is based on relevant experimental evidence as to how these students best learn to read. The general finding of the study was that Reading Recovery principles and practices are not based firmly on the experimental evidence that supports the so-called bottom-up model of children's reading development. To the contrary of Reading Recovery, Marie Clay, favors so-called top-down principles and models of reading instruction. Reading Recovery uses several empirically unverified procedures to decide which students are admitted to its tutoring sessions, to determine the progress in reading rehabilitation these tutees make, and to judge when students should be discontinued from Reading Recovery tutelage. The details on the shortcomings of Reading Recovery are judged to be prima facie evidence that it may not be a cost-effective educational innovation. Further authentication in that regard, it is pointed out, are recent studies by disinterested researchers who report that: (a) the initial successes of Reading Recovery in helping disabled readers overcome their handicap are only temporary in nature, and (b) the majority of the precepts and procedures prescribed for Reading Recovery by Marie Clay reflect a top-down orientation to reading development, as does the Whole Language (WL) philosophy of reading attainment. Educators and school boards should take this orientation of Reading Recovery under advisement when considering its purchase, it is urged.     

Multiculturalism Incorporated: Student Perceptions

Multicultural education has transformed higher education both in terms of research and in terms of student experiences. Given the complexity of our institutions, the overall effects of these transformations are mixed. Building on the successes and strengths of multicultural education as it is currently incorporated in institutions and programs will involve better understanding how it is perceived, positively and negatively, by those who are experiencing it first hand. In this article we seek to contribute to this reflection through a discussion of a survey of students’ perceptions of multiculturalism in a large first-year program in a research university. Patrick Bruch is Associate Professor of Writing Studies in the College of Education and Human Development at the University of Minnesota, Twin Cities. He received a B.A. in English from Western Michigan University and a Ph.D. in English from Wayne State University. His teaching and research focus on struggles for equality within and through higher education. Jeanne L. Higbee received her B.S. in Sociology from Iowa State University and earned both her M.S. in Counseling and Guidance and Ph.D. in Educational Administration from the University of Wisconsin-Madison. She currently serves as Professor and Senior Advisor to the Center for Research on Developmental Education and Urban Literacy, College of Education and Human Development, University of Minnesota. Her research interests are related to student development and the access and retention of student populations that traditionally have been underserved in postsecondary educational institutions. Kwabena Siaka is a doctoral candidate in the Department of Educational Policy and Administration at the University of Minnesota.     

Applying the Kanban method in problem-based project work: a case study in a manufacturing engineering bachelor’s programme at Aalborg University Copenhagen

Problem-based learning (PBL) has proven to be highly effective for educating students in an active and self-motivated manner in various disciplines. Student projects carried out following PBL principles are very dynamic and carry a high level of uncertainty, both conditions under which agile project management approaches are assumed to be highly supportive. The paper describes an empirical case study carried out at Aalborg University Copenhagen involving students from two different semesters of a Bachelor of Science programme. While executing the study, compelling examples of how PBL and the agile project management method Kanban blend could be identified. A final survey reveals that applying Kanban produces noticeable improvements with respect to creating, assigning and coordinating project tasks. Other improvements were found in group communication, knowledge about the work progress with regards to both the individual and the collective and the students’ way of continuously improving their own teamwork.     

Pedagogical intersectionality: exploring content,technology, and student-centered learning through a problem based/project based approach

ABSTRACT

A narrative case study exploring the course design and implementation of a capstone undergraduate course for future teachers taught with a lens of pedagogical intersectionality, an integration of K-12 history-social science content, advocating for students, and technology. Four undergraduate students’ perspectives on the taught concepts of culturally sustaining pedagogies, universal design for learning and social justice through multimodal approaches resulting in the creation and facilitation of a digital one-day lesson (DODL) that incorporates course tenets and use of technology. Data was collected from course surveys, reflections, DODL lesson plan, and DODL Post microteaching reflections. Themes generated from the data sources were personal learning experiences, cultural respect and acknowledgement, pedagogical growing pains, fatigue, and synthesis occurring in DODL. Collaborators responded to student comments and reflected on course design and goals to foster independent learning of course tenets. Future research will involve additional analysis of subsequent sections of the course based on feedback and reflective modifications learned through this project.     

Motivational Preconditions for Girls Gifted and Highly Gifted in Physics

During their socialisation process, many girls gifted in physics acquire a reality construction inconsistent with their objectively measurable competencies. In comparison to boys they rate their action and problem solving competencies unrealistically low, which results, for example, in extremely low participation rates in scientific and technical studies and professions. For this reason differences in motivation and self‐related cognitions become the focus of interest in explaining achievement differences. The present study was carried out prior to initial physics instruction. Students in the 7th grade of the German Gymnasium (243 girls and 282 boys) were divided according to their KFT 4‐13+ results into “average”, “gifted” or “highly gifted groups”. Prior to commencement of physics instruction, boys in general, as well as gifted male and female students, already possessed more knowledge of physics and more favourable motivation for the subject than girls or male and female students of average ability. In addition, domain specific measures and self‐related cognitions were evaluated in accordance with Dweck's model of achievement motivation.