Studies in Historical Replication in Psychology I: Introduction

This special issue reports a project in which the replication of historically meaningful studies was carried out by graduate students in a history of psychology course. In this introduction, I outline the nature of the project and its rationale, and briefly sketch the results. The subsequent five papers represent scholarly presentations of five selected replications written by students in the course. These are followed by a commentary on the project by an educational psychologist.

---

Replication and Pedagogy in the History of Psychology IV: Patrick and Gilbert (1896) on Sleep Deprivation

We report an attempted replication of G. T. W. Patrick and J. A. Gilbert’s pioneering sleep deprivation experiment ‘Studies from the psychological laboratory of the University of Iowa. On the effects of loss of sleep’, conducted in 1895/96. Patrick and Gilbert’s study was the first sleep deprivation experiment of its kind, performed by some of the first formally trained psychologists. We attempted to recreate the original experience in two subjects, using similar apparatus and methodology, and drawing direct comparisons to the original study whenever possible. We argue for a strong influence of an ‘Americanized’ Wundtian psychology on Patrick and Gilbert, a claim supported biographically by their education and by their experimental methods. The replication thus opens interesting new perspectives, which are unlikely to be generated by any other historical approach.

Replication and Pedagogy in the History of Psychology II: Fowler & Wells’s Phrenology

Phrenologists believed that specific brain regions corresponded to certain character traits. In addition, the size of each brain region was believed to determine the strength of the respective trait. Phrenology originated in Austria with Franz Josef Gall and was popularized and commercialized in America at the end of the 19th century by Orson Squire Fowler. In this project, we conducted a replication of Fowler’s phrenology in order to better understand the specificity of the manualized methodology, the extent to which the methodology allowed for positive versus negative analyses, and the implications for the scientific rejection and public acceptance of phrenology. The results of our replication revealed that the subjective judgments and biases of the examiner strongly influence the results of phrenological analyses. This project originated as a class assignment in the Spring of 2003 (Tweney, this issue). See Tweney (2004) for general information on historical replication.

---

A research framework for creative and imitative reasoning

This conceptual research framework addresses the problem of rote learning by characterising key aspects of the dominating imitative reasoning and the lack of creative mathematical reasoning found in empirical data. By relating reasoning to thinking processes, student competencies, and the learning milieu it explains origins and consequences of different reasoning types.

“Coming Out” in a Feminist Classroom

Ideological differences in a writing class evoke the passion of political sensitivities. A graduate student tells of “coming out” as a pro-life advocate in an essay before his feminist classmates and professor. The exchange created instant and irreconcilable enemies, but he also found some unexpected support from a hesitant voice within that classroom.

Remarks Made During “Dialogue on Intellectual Diversity,” a Forum Held 11 October 2007 at the University of Missouri–St. Louis

In 2006, a bill was submitted in the Missouri Legislature designed to address issues raised during a lawsuit by a Missouri State University social work student contesting requirements that Missouri public colleges and universities take steps to insure tolerance of diverse perspectives in the classroom and on campus. Although the legislation did not pass, it motivated university administrators among other measures to sponsor a forum on “intellectual diversity,” held on 11 October 2007 on the University of Missouri–St. Louis campus. In his remarks as a faculty panelist, J. Martin Rochester makes five distinct points about the realities and pitfalls of regulating tolerance and the true meaning of diversity on a college campus.

Peer Coaching: Professional Development for Experienced Faculty

The professoriate, as a whole, is growing older and more experienced; yet institutions often overlook the professional development needs of mid-career and senior faculty. This article, based on a review of the literature and the development of a peer coaching project, examines peer coaching as a professional development opportunity for experienced faculty that meets many of their immediate needs and offers a variety of longer-term benefits to their institution. Six recommendations for creating a peer coaching program emerge from the literature and the authors’ experience.

Challenges in deepening prospective teachers’ understanding of multiplication through justification

This article reports challenges faced by prospective elementary teachers as they revisited whole number multiplication through a sequence of tasks that required them to develop and justify reasoning strategies for multiplication. Classroom episodes and student work are used both to illustrate these challenges, as well as to demonstrate growth over time. Implications for the design of mathematics courses for prospective teachers’ are discussed. Although the study is situated in the context of multiplication, it has implications for teachers reasoning and justification in other areas of mathematics.

Using Propensity Scores for Estimating Causal Effects: A Study in the Development of Moral Reasoning

The purpose of this study was to illustrate the use of propensity scores for creating comparison groups, partially controlling for pretreatment course selection bias, and estimating the treatment effects of selected courses on the development of moral reasoning in undergraduate students. Specifically, we used a sample of convenience for comparing differences in moral reasoning development scores among students enrolled in intergroup dialogue, service learning, psychology and philosophy courses with those of an introductory sociology course. Adopting a propensity score approach included reviewing the empirical literature for its guidance in substantiating the reasons for including pretreatment variables (i.e., pretreatment course-taking behaviors, race, sex, political identification, need for cognition, major, age, pretreatment moral reasoning scores) in our analysis, measuring these variables, and reducing them into a single composite propensity score for each student in our analytic sample. This score then served as the basis for creating a new comparison group and for allowing us to estimate unbiased (or less biased) course-related treatment effects on moral reasoning development. Implications for higher education researchers are discussed.

Emerging from the Pipeline: African American Students,Socioeconomic Status,and College Experiences and Outcomes

This study focuses on how social class affects the college experiences and outcomes for African American students in 4-year colleges and universities. Using a national, longitudinal data base, the findings indicate that low SES African American students have less contact with faculty, study less, are less involved with student organizations, work more, and have lower grades than do their high SES peers or all African American students. Furthermore, 9 years after entering college, low SES students report lower incomes, lower rates of degree attainment and lower aspirations than their high SES peers, and were less likely to have attended graduate school. Logistic regression results indicate that sex, college GPA, and plans following college significantly affect the likelihood that a student will attend graduate school.

Validating NSSE Against Student Outcomes: Are They Related?

While there exist many examples of institutional use of the results of the National Survey of Student Engagement (NSSE), there is a relative paucity of research explicitly linking student outcomes to responses on the survey. A major Doctoral-Extensive institution in the Southeast recently conducted a large-scale implementation of the National Survey of Student Engagement (NSSE). We have linked multiple years of NSSE responses to several student outcomes: freshman retention, GPA, pursuit of graduate education, and employment outcome upon commencement/degree conferral. Our research finds minimal explanatory power in the NSSE benchmarks for these outcomes. A statistically derived model from the individual NSSE items shows greater promise, although there are difficulties in replicating the model for previous student cohorts.

Exam Scams and Classroom Flimflams: Urban Legends as an Alternative Lens for Viewing the College Classroom Experience

Campus-based urban legends have the potential to convey and construct student culture in higher education. Basic qualitative and humanistic research methods were used to collect, analyze, and interpret legends related to the academic experience of collegiate life.

Departmental Climate and Student Experiences in Graduate Geography Programs

This study explores how graduate students enrolled in M.A./M.S. and Ph.D. geography programs perceive the social and academic climate of their departments. A second objective is to understand how these students self-assess their own professional abilities, values, and goals, and whether these self-assessments differ across demographic and institutional contexts. The survey instrument for this research is based on data collected from graduate student focus groups and on validated constructs of academic culture and climate from previous research. T-tests, ANOVA, and regression analyses identified significant differences among graduate students and their perceptions of departmental climate when compared on the basis of gender, citizenship, race/ethnicity, disciplinary subfield, and institutional type. Interview data provide additional context for analysis of the survey data. The primary areas in which we detected differences in graduate students’ experiences were 1) diversity issues, 2) disciplinary and institutional cultures, 3) career planning and development, 4) financial matters, and 5) quality of the learning environment. These differences result from the varying social and academic dynamics of graduate programs, illustrating the importance of the local environment in shaping student experiences.

Merit-Based Student Aid and Freshman Interstate College Migration: Testing a Dynamic Model of Policy Change

This study examines how state merit-based scholarships individually and simultaneously with prepaid tuition plans influence the interstate migration of college-bound freshmen. State freshman migration percentages were examined over a 10-year period. Results of an interrupted time-series model suggested that students generally respond to merit-based tuition aid in accordance with our initial prediction based on factors influencing student choice in attending postsecondary institutions. More specifically, many students choose to attend an in-state college in order to be eligible for state merit-based scholarships. Moreover, for home states that adopted both merit-based scholarships and prepaid tuition contracts, student out-migration was further reduced over time.

Global and national prominent universities: internationalization,competitiveness and the role of the State

This article provides a characterization of the internationalization of “global” European universities and discusses the role of the State in promoting greater internationalization and competitiveness levels of prominent national universities. The analysis supports previous arguments stating that global ranking of universities is strongly based on research, but reveals that the internationalization of research universities’ student population is also arranged to enhance research capacity. This finding is further reinforced by a positive association between the internationalization of the academic staff and the internationalization of the student population in one of those universities, being this association particularly strong with the doctoral student population. Finally, based on the analysis of two prominent national universities with different global competitiveness levels, we discuss the role of the State as a central supporter of these universities internationalization and global competitiveness arguing that public funding and support is critical if countries want to have national prominent universities competing at global level.

A Network Approach to Preparing Underrepresented Students: The LEAD Model

Results are reported from an empirical study of an interorganizational collaboration to prepare underrepresented students for elite postsecondary education and beyond. The LEAD (Leadership Education and Development) Program in Business is an initiative involving twelve U.S. universities, nearly forty multinational corporations, a federal government agency, and a nonprofit organization working together to introduce students to business education and careers in business. This article analyzes the conditions that give rise to the collaboration, its essential structural characteristics, and the consequences that flow from it.

Roger Osborne (1940–1985), University of Waikato, New Zealand

This short paper outlines the emergence and achievements of the Science Education Research Unit at the University of Waikato over the period 1979–1985 under the leadership of the late Dr. Roger Osborne. Following his attendance at the ASERA meeting in Wagga Wagga in 1977, Roger Osborne rapidly built up a very productive team, which he led until his death in 1985. His legacy is tentatively evaluated. In conclusion, the cultural context in which this work took place is sketched.

Reliability and agreement of student ratings of the classroom environment: A reanalysis of TIMSS data

In educational research, characteristics of the learning environment are generally assessed by asking students to evaluate features of their lessons. The student ratings produced by this simple and efficient research strategy can be analysed from two different perspectives. At the individual level, they represent the individual student’s perception of the learning environment. Scores aggregated to the classroom level reflect perceptions of the shared learning environment, corrected for individual idiosyncrasies. This second approach is often pursued in studies on teaching quality and effectiveness, where student-level ratings are aggregated to the class level to obtain general information about the learning environment. Although this strategy is widely applied in educational research, neither the reliability of aggregated student ratings nor the within-group agreement between the students in a class has been subject to much investigation. The present study introduces and discusses different procedures that have been proposed in the field of organisational psychology to assess the reliability and agreement of students’ ratings of their instruction. The application of the proposed indexes is demonstrated by a reanalysis of student ratings of mathematics instruction obtained in the Third International Mathematics and Science Study (N = 2,064 students in 100 classes).

The Long Decay Model of One-Dimensional Projectile Motion

This article introduces a research study on student model formation and development in introductory mechanics. As a point of entry, I present a detailed analysis of the Long Decay Model of one-dimensional projectile motion. This model has been articulated by Galileo (in De Motu) and by contemporary students. Implications for instruction are discussed.

---

Integrating Undergraduate Peer Mentors into Liberal Arts Courses: A Pilot Study

This article presents research and narratives on the integration of course-based peer learning assistants into seven courses. A new curricular peer mentoring program was piloted in the 2005–2006 academic year in an interdisciplinary liberal arts college at a large Canadian research university. Undergraduate students enrolled in a practicum course which supported their learning while they collaborated with the “host instructor” of the course in which they served as peer mentor. Assistants’ roles varied and included individual tutoring, help via email, online discussion facilitation, small group facilitation, in-class presentation and discussion facilitation, and extracurricular study groups. Their integration into scheduled class activities resulted in participating students’ perception of enhanced learning. Data included peer mentors’ assignments, host instructor feedback, and student surveys.