Grading ePortfolios: Tracing Two Approaches,Their Advantages,and Their Disadvantages

How does one grade an electronic portfolio? This question is one I have thought about, have enacted, and have written about, primarily in reference to ePortfolios used in writing classrooms (Yancey, McElroy, & Powers, 2013 Yancey, K. B., McElroy, S., & Powers, E. (2013). Composing, networks, and electronic portfolios: Notes toward a theory of assessing ePortfolios. In D. DeVoss & H. McKee (Eds.), Digital writing assessment and evaluation. Computers and composition. Logan, UT: Digital Press/Utah State University Press. [Google Scholar]). But what happens when the content and developmental levels are changed, in this case from an undergraduate first-year writing class to another required class, this one offered at the graduate level, Digital Revolution and Convergence Culture? Is using a scoring guide, the preferred approach in writing classes, the best approach in this new context? Or, following Moss, Girard, and Haniford (2006 Moss, P., Girard, B., & Haniford, L. (2006). Validity in educational assessment. Review of research in education 30, 109–162.[Crossref], [Web of Science ®] , [Google Scholar]), could one use outcomes to “stage a conversation” around a student's ePortfolio; if so, what might a staged conversation look like? Or what might happen if instead of using outcomes as a framework, students themselves set the terms for that conversation? Here, I consider these options, attending especially to the importance of making good judgments and of fostering learning.     

Toward Understanding the Potential of Games for Learning: Learning Theory,Game Design Characteristics,and Situating Video Games in Classrooms

Researchers have argued that an effort should be made to raise teachers’ and parents’ awareness of the potentially positive educational benefits of playing video games (e.g., see Baek, 2008 Baek, Y.K. (2008). What hinders teachers in using computer and video games in the classroom? Exploring factors inhibiting the uptake of computer and video games. CyberPsychology & Behavior, 11, 665–671.[Crossref], [PubMed] , [Google Scholar]). One part of this effort should be to increase understanding of how video games can be situated within teachers’ existing goals and knowledge of learning and instruction. However, relatively little research on game-based learning addresses teachers (Ketelhut & Schifter, 2011), and for many a gap remains between the apparent enthusiasm of researchers and policy makers relative to the potential of educational games and the attendant practicalities of selecting and implementing video games in classroom settings. This article begins to bridge this gap by providing research-based areas of awareness and a discussion of factors that can facilitate understanding related to choosing and using video games. To this end, we show how educational games can be conceptualized from different theoretical perspectives on learning and discuss a number of essential design issues that educators should take into account when considering a video game for educational use.     

Moving to a Global Stage: A Media View

The Times Higher Education Supplement was the first newspaper to publish an international ranking of universities in November 2004 Jobbins, D. 2002. “The Times/The Times Higher Education Supplement – League Tables in Britain: An Insider's View”. Higher Education in Europe, 27(4): 383–389. [Taylor & Francis Online] [Google Scholar]. This article describes the evolution of the international rankings from their origin in a limited peer review exercise through the gradual refinement of a national ranking based on, as far as possible, publicly available, verifiable, and accepted data. The author describes the methodology of the international ranking and presents the case for the integrity of commercially produced rankings, national and international, which can be as objective, robust, and transparent as initiatives from within the university community itself.     

Reporting Monte Carlo Studies in Structural Equation Modeling

In structural equation modeling, Monte Carlo simulations have been used increasingly over the last two decades, as an inventory from the journal Structural Equation Modeling illustrates. Reaching out to a broad audience, this article provides guidelines for reporting Monte Carlo studies in that field. The framework of discourse is set by a number of steps to be taken in such research, matching outlines of experimental design by Paxton, Curran, Bollen, Kirby, and Chen (2001) Chen, F., Bollen, K. A., Paxton, P., Curran, P. J. and Kirby, J. 2001. Improper solutions in structural equation modeling: Causes, consequences, and strategies. Sociological Methods & Research, 29: 468–508. [Crossref], [Web of Science ®] , [Google Scholar] and Skrondal (2000) Skrondal, A. 2000. Design and analysis of Monte Carlo experiments: Attacking the conventional wisdom. Multivariate Behavioral Research, 35: 137–167. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]. Throughout the article, reference is made to exemplary publications and, occasionally, to imperfect reporting.     

Disappearing acts: resuscitative reflections on the academy

To resuscitate means to revive or make go on. This paper is an exploration of my first six months at a Canadian university as a doctoral student. Through a chronological narrative, I explore my experiences through the governing relations of the academy as a way to provoke dialogue about the role of feminist researcher in the institution. By comparing feminine subjectivity of the ‘woman returner’ (Hughes, 2002 Hughes, C. 2002. Beyond the poststructuralist‐modern impasse: the woman returner as ‘exile’ and ‘nomad’. Gender and Education, 14: 411–424. [Taylor & Francis Online], [Web of Science ®] [Google Scholar]) through the character in a feminist science fiction novel the challenges of the academy find resonance and meaning in a reinvention of self.     

Learning through boundary‐crossing: further education lecturers learning in both the university and workplace

This paper reports on a research project that sought to gain a deeper understanding of the contribution that universities make to the professional learning of teachers. The particular case studied was a group of learners who were engaged in an in‐service teacher education course for further education (FE) whilst also working as lecturers in FE colleges in Scotland. The paper develops the narrative of learning across boundaries (Saunders 2006 Saunders, M. 2006. From ‘organisms’ to ‘boundaries’: The uneven development of theory narratives in education, learning and work connections.. Journal of Education and Work, 19: 1–27. [Taylor & Francis Online] [Google Scholar]) drawing on the work of Engeström (1987 Engeström, Y. 1987. Learning by expanding: An activity‐theoretical approach to developmental research, Helsinki: Orienta‐Konsultit. [Crossref] [Google Scholar], 2001 Engeström, Y. 2001. Expansive learning at work: Toward an activity theoretical reconceptualisation.. Journal of Education and Work, 14: 133–56. [Taylor & Francis Online] [Google Scholar]). The claim made is that the learning that takes place across the boundary of the workplace and university has the possibility of helping learners to resolve issues that the workplace alone does not provide them with the resources to resolve.

Cet article fait un compte‐rendu sur un projet de recherche dont le but était d'approfondir les connaissances sur la contribution des universités à la formation professionelle des professeurs. Le cas particulier qu'on a étudié était un groupe d'apprenants qui ont suivi un cours de formation d'enseignement professionnelle en travaillent commme professeurs dans des centres d'enseignement professionnel. L'article se déroule la narration d'apprentissage à travers les frontières (Saunders 2006 Saunders, M. 2006. From ‘organisms’ to ‘boundaries’: The uneven development of theory narratives in education, learning and work connections.. Journal of Education and Work, 19: 1–27. [Taylor & Francis Online] [Google Scholar]) et d'après les recherches d'Engstrom (1987 Engeström, Y. 1987. Learning by expanding: An activity‐theoretical approach to developmental research, Helsinki: Orienta‐Konsultit. [Crossref] [Google Scholar], 2001 Engeström, Y. 2001. Expansive learning at work: Toward an activity theoretical reconceptualisation.. Journal of Education and Work, 14: 133–56. [Taylor & Francis Online] [Google Scholar]). On prétend que la connaissance qu'on a produit à travers des frontières du lieu de travail et de l'université pourrait aider les étudiants à résoudre des problèmes qu'ils ne pourraient pas résoudre en travaillant seulement.

Este trabajo presenta un proyecto de investigación que ha buscado una comprensión más detallada sobre la contribución aportada por la universidad al aprendizaje profesional del profesorado. El trabajo ha estudiado un grupo de alumnos que participaron en un curso avanzado de educación mientras trabajaban como profesores en institutos de enseñanza en Escocia. El estudio desarrolla la temática del aprendizaje a través de límites (Saunders 2006 Saunders, M. 2006. From ‘organisms’ to ‘boundaries’: The uneven development of theory narratives in education, learning and work connections.. Journal of Education and Work, 19: 1–27. [Taylor & Francis Online] [Google Scholar]) inspirándose en el trabajo de Engeström (1987 Engeström, Y. 1987. Learning by expanding: An activity‐theoretical approach to developmental research, Helsinki: Orienta‐Konsultit. [Crossref] [Google Scholar], 2001 Engeström, Y. 2001. Expansive learning at work: Toward an activity theoretical reconceptualisation.. Journal of Education and Work, 14: 133–56. [Taylor & Francis Online] [Google Scholar]). La reivindicación hecha es que el aprendizaje que tiene lugar a través del límite del lugar de trabajo y la universidad tiene la posibilidad de ayudar a los alumnos en resolver asuntos en que el lugar de trabajo por si solo no puede proveerles con los recursos para su resolución.

Dieser Artikel berichtet die Resultate eines Forschungsprojektes, dass zu verstehen versuchte, was Universitäten zum professionellen Lernen von Lehrern beitragen. Ein Gruppe von Studenten wurder untersucht, die in Schottland an Berufsschulen unterrichteten und gleichzeitig an einem Weiterbildungskurs fuer Lehrkräfte an der Universität teilnahmen. Der Artikel ist auf der Arbeit von Engström basiert und konzentriert sich auf Lernen, das über Grenzen hinweg stattfindet (Saunders) (in unserem Fall Arbeitsplatz und Universität). Wir behaupten, dass das solches Lernen grössere Moeglichkeiten bietet, Probleme zu lösen, als Lernen, welches nur am Arbeitsplatz stattfindet.     

LAW STUDENTS' ATTITUDES TOWARDS ASSESSMENT

This paper outlines the research method used in Phase II of the Law Student Assessment Project; it indicates the trend of the results and shows how they relate to the findings of Phase I of the project.(1 TRIBE, D. and TRIBE, A. J. 1988. “Assessing Law Students: Lecturers Attitudes and Practices”. Assessment and Evaluation in Higher Education, 13(3): 195[Taylor & Francis Online] [Google Scholar])     

Conducting the “Business of Teaching”: Expectations of Non-instructional Tasks of Beginning STEM Teachers

Abstract

Much debate centers on the most necessary elements of teacher preparation programs, with many focusing on practice of core instructional tasks (Forzani 2014 Forzani, F. M. 2014. Understanding “Core Practices” and “Practice-Based” teacher education learning from the past. Journal of Teacher Education 65 (4):357–68. doi: 10.1177/0022487114533800.[Crossref], [Web of Science ®] , [Google Scholar]; Kennedy 2016 Kennedy, M. 2016. Parsing the practice of teaching. Journal of Teacher Education 67 (1):6–17. doi: 10.1177/0022487115614617.[Crossref], [Web of Science ®] , [Google Scholar]), which may be diluted in alternative preparation programs (Forzani 2014 Forzani, F. M. 2014. Understanding “Core Practices” and “Practice-Based” teacher education learning from the past. Journal of Teacher Education 65 (4):357–68. doi: 10.1177/0022487114533800.[Crossref], [Web of Science ®] , [Google Scholar]). Teachers prepared in alternative programs tend to have greater difficulties with classroom management, instructional planning, and differentiated instruction (Darling-Hammond 2009 Darling-Hammond, L. 2009. Educational opportunity and alternative certification: New evidence and new questions. Policy Brief (1). Stanford, CA: Stanford Center for Opportunity Policy in Education. [Google Scholar]; Wilson 2011 Wilson, S. 2011. Effective STEM teacher preparation, induction, and professional development. In National Research Council’s Workshop on Successful STEM Education in K–12 Schools. Washington, DC. http://sites.nationalacademies.org/dbasse/bose/dbasse_080128#.UgEMEFPkDDn. [Google Scholar]); however, few studies have examined alternatively prepared STEM teachers’ beliefs and expectations about teaching and learning (Tigchelaar et al. 2010 Tigchelaar, A., N. Brouwer, and J. Vermunt. 2010. Tailor-made: Towards a pedagogy for educating second-career teachers. Educational Research Review 5 (2):164–83.[Crossref], [Web of Science ®] , [Google Scholar]; Good et al. 2006 Good, T., M. McCaslin, H. Tsang, J. Zhang, C. Wiley, A. Rabidue Bozack, and W. Hester. 2006. How well do 1st-year teachers teach: Does type of preparation make a difference? Journal of Teacher Education 57 (4):410–30.[Crossref], [Web of Science ®] , [Google Scholar]), and fewer still have examined their beliefs about non-instructional responsibilities associated with the profession (LeTendre et al. 2001 LeTendre, G.K., D.P. Baker, M. Akiba, B. Goesling, and A. Wiseman. 2001. Teachers' work: Institutional isomorphism and cultural variation in the U.S., Germany, and Japan. Educational Researcher 30 (6):3–15. doi: 10.3102/0013189X030006003.[Crossref] , [Google Scholar]; Ovando 2001 Ovando, M. N. 2001. Teachers' perceptions of a learner-centered teacher evaluation system. Journal of Personnel Evaluation in Education 15 (3):213–231. [Google Scholar]; Scriven 1994 Scriven, M. 1994. Duties of the teacher. Journal of Personnel Evaluation in Education 8 (2):151–84. doi: 10.1007/BF00972261.[Crossref] , [Google Scholar]). This inquiry examines the expectations of a cohort of STEM practitioners transitioning into STEM teaching positions from an abbreviated alternative certification program; during their first year of teaching and concurrent final internship, the paid interns exhibited heightened emotional responses (i.e. crying, not eating, not sleeping) documented by university supervisors. Researchers utilized Self-Discrepancy Theory (Higgins 1987 Higgins, E. T. 1987. Self-discrepancy: A theory relating self and affect. Psychological Review 94 (3):319–40.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to provide an understanding of how expectations can produce negative affect, such as anxiety or depression. Findings suggest this cohort of paid interns had expectations about both personal and non-instructional time, planning, school resources, and legal responsibilities incongruent with the realities of the job. Researchers call for further research on STEM practitioners’ beliefs and expectations of non-instructional tasks as they transition from accelerated M.A.T. programs into teaching.     

Making a difference: moving beyond the superficial treatment of diversity

As populations in contemporary Western societies grow more diverse, the need for teachers to better understand and work with difference productively becomes increasingly critical (Allard & Santoro, 2006 Allard, A. C. and Santoro, N. 2006. Troubling identities: Teacher education students' constructions of class and ethnicity.. Cambridge Journal of Education, 36(1): 115–129. [Taylor & Francis Online] [Google Scholar]; D'Cruz, 2007 D'Cruz, H. 2007. Working with ‘Diverse Bodies, Diverse Identities’: An approach to professional education about ‘diversity’.. International Journal of Inclusive Education, 11(1): 35–57.  [Google Scholar]). However, the literature on teacher education shows that historically, teacher education programs have aimed to address diversity with add‐on or piecemeal approaches, with little success (McDonald, 2005 McDonald, M. A. 2005. The integration of social justice in teacher education: Dimensions of prospective teachers' opportunities to learn.. Journal of Teacher Education, 56(5): 418–435.  [Google Scholar]). Moreover, some authors (e.g. Lortie, 1975 Lortie, D. 1975. Schoolteacher: A sociological study, Chicago: University of Chicago Press.  [Google Scholar]) have argued that “the predispositions teacher education students bring to teaching are a much more powerful socializing influence than either pre‐service education or later socialization in the workplace” (Johnson, 2002 Johnson, L. 2002. “My eyes have been opened”: White teachers and racial awareness.. Journal of Teacher Education, 53(2): 153–167. [Crossref], [Web of Science ®] [Google Scholar], p. 154). This article explores research and scholarship in this area and argues that we must move beyond the fragmented and superficial treatment of diversity if we are to encourage dispositions in all pre‐service teachers that are more closely aligned with a recognitive view of social justice.     

AN EXAMPLE OF THE APPLICATION OF A BALANCED INCOMPLETE BLOCK DESIGN

A study was conducted to estimate the reliability of oral examinations at the College of Medicine, The University of Iowa. In this paper, a part of the study is presented to provide the reader with an example of the applicability of a Balanced Incomplete Block Design (BIBD). This type of design is used when only fewer than all participating examiners can rate each examinee. Such a design was proposed originally by Yates in 1936.(1 Yates, F. 1936. “Incomplete randomised blocks”. Annals of Eugenics, 7: 121–140. [Crossref] , [Google Scholar]) The methods for analysing data obtained by BIBD were presented by Fleiss.(2 Fleiss, J. L. 1981. “Balanced incomplete block designs for inter‐rater reliability studies”. Applied Psychological Measurement, 5(1): 105–112. [Crossref], [Web of Science ®] , [Google Scholar]) The reliability coefficient of the oral examination was .71, higher than some experts would anticipate in a similar situation. When some of the sources of error were eliminated by evaluating students' performances on audio‐tape, the reliability coefficient increased to .88.     

The challenges of intersectionality: researching difference in physical education 1

Researching the intersection of class, race, gender, sexuality and disability raises many issues for educational research. Indeed, Maynard (2002 Maynard, M. 2002. Studying age, ‘race’ and gender: Translating a research proposal into a project. International Journal of Social Research Methodology, 5: 31–40. [Taylor & Francis Online] , [Google Scholar], 33) has recently argued that ‘difference is one of the most significant, yet unresolved, issues for feminist and social thinking at the beginning of the twentieth century’. This paper reviews some of the key imperatives of working with ‘intersectional theory’ and explores the extent to these debates are informing research around difference in education and Physical Education (PE). The first part of the paper highlights some key issues in theorising and researching intersectionality before moving on to consider how difference has been addressed within PE. The paper then considers three ongoing challenges of intersectionality – bodies and embodiment, politics and practice and empirical research. The paper argues for a continued focus on the specific context of PE within education for its contribution to these questions.     

“I Do This for All of the Reasons America Doesn't Want Me To”: The Organic Pedagogies of Black Male Instructors

ABSTRACT

This article examines the teaching philosophies of Black male teachers of Black male students in manhood development classes in a district-wide program in Oakland, California. Drawing on observations and instructor interview data, we explore the teachers’ histories, teaching philosophies, and the trajectory of their racial-educational understandings. We utilize Gramsci's (1971 Gramsci, A. (1971). Selections from the Prison Notebooks of Antonio Gramsci: Hoare, Q. & Smith, G. N. (Eds.). (Hoare, Q. & Smith, G. N., trans.) New York, NY: International.  [Google Scholar]) theory of the organic intellectual, Mills’ (1997 Mills, C. W. (1997). The racial contract. Cornell, NY: Cornell University Press. [Google Scholar]) and Leonardo's (2013 Leonardo, Z. (2013). The story of schooling: Critical race theory and the educational racial contract. Discourse: Studies in the cultural politics of education, 34, 599–610. doi: 10.1080/01596306.2013.822624[Taylor & Francis Online] , [Google Scholar]) theories of the subperson and substudent, and Dumas’ (2014 Dumas, M. J. (2014). “Losing an arm”: Schooling as a site of Black suffering. Race, Ethnicity, and Education, 17(1), 1–29. doi: 10.1080/13613324.2013.850412 [Taylor & Francis Online] , [Google Scholar]) notion of Black suffering to theorize the ways that race comes into play in the teaching of African American male students. We find that racialization and re-humanization are key to instructors’ teaching, and we identify two key aspects of their teaching philosophies: (1) Humanization/Love and (2) Reciprocity.     

Preparing doctoral candidates for the viva: issues for students and supervisors

The PhD viva has been described as mysterious (Burnham 1994 Burnham, P. 1994. Surviving the doctoral viva: Unravelling the mystery of the Ph.D. oral. Journal of Graduate Education, 1: 30–34.  [Google Scholar]; Morley et al. 2002 Morley, L., Leonard, D. and David, M. 2002. Variations in vivas: Quality and equality in British PhD assessments. Studies in Higher Education, 27(3): 263–273. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), unpredictable (Rugg & Petre 2004 Rugg, G. and Petre, M. 2004. The unwritten rules of PhD research, Maidenhead: Open University Press.  [Google Scholar]) and potentially frightening for students (Delamont et al. 2004 Delamont, S., Atkinson, P. and Parry, O. 2004. Supervising the doctorate: A guide to success, Maidenhead: Open University Press.  [Google Scholar]), with its form and duration a function of the predilections of individual examiners as well as a function of differences across disciplines. Despite its myriad manifestations, the PhD viva voce (live voice), as oral examination of the doctoral thesis, constitutes the final ‘test’ of the PhD endeavour. In the UK, this is a private event, though in some countries such as Belgium and the Netherlands, for example, the viva is conducted in a public arena (Delamont et al. 2004 Delamont, S., Atkinson, P. and Parry, O. 2004. Supervising the doctorate: A guide to success, Maidenhead: Open University Press.  [Google Scholar]). Although there is no standard or prescribed format, students across all disciplines can expect to defend their thesis through a process involving questioning, clarification and discussion of key elements. This critical commentary discusses a number of issues that inform the preparation of students, focusing on the role of the internal and external examiner, the viva voce process, guidance for students and some practical suggestions for supervisors and students, particularly the value of full role-play in building students’ confidence. The extent to which the doctoral viva, in its current ‘secret’ form, can be seen as a fully accountable and independently rigorous process is taken up in the conclusion that highlights the phenomenon of ‘cosy’ reciprocal examining arrangements, the spectre of litigation when things go wrong and the need to consider a fundamental review of both the purpose and conduct of the viva.     

The premise and promise of inquiry based mathematics in pre‐service teacher education: a poststructuralist analysis

Many teacher educators have recently implemented inquiry based instructional practices into their programs (Crawford & Deer, 1993 Crawford, K and Deer, C. (1993). Do we practise what we preach? Putting policy into practice in teacher education. South Pacific Journal of Teacher Education, 21: 111–121. [Taylor & Francis Online] [Google Scholar]; Foss & Kleinsasser, 1996 Foss, D and Kleinsasser, R. (1996). Pre‐service elementary teachers’ views of pedagogical and ­mathematical content knowledge. Teaching and Teacher Education, 12(4): 429–442. [Crossref], [Web of Science ®] [Google Scholar]; Klein, 1996 Klein M (1996) The possibilities and limitations of constructivist practice in pre‐service teacher education in mathematics Unpublished doctoral dissertation, Central Queensland University, Rockhampton, Australia  [Google Scholar], 1997 Klein, M. (1997). Looking again at the ‘supportive’ environment of constructivist pedagogy. ­Journal of Education for Teaching, 23(3): 277–292. [Taylor & Francis Online] [Google Scholar], 1998 Klein M (1998) New knowledge, new teachers, new times in: C. Kanes, M. Goos & E. Warren (Eds) Teaching mathematics in new times (Brisbane, Mathematics Education Research Group of Australasia) 295 302  [Google Scholar], 2001 Klein M (2001) Correcting mathematical and attitudinal deficiencies in pre‐service teacher education in: J. Bobis, B. Perry & M. Mitchelmore (Eds) Numeracy and beyond (Sydney, Australia, MERGA) 338 345  [Google Scholar]; Schuck, 1996 Schuck, S. (1996). Reflections on the dilemmas and tensions in mathematics education courses for student teachers. Asia‐Pacific Journal of Teacher Education, 24(1): 75–82. [Taylor & Francis Online] [Google Scholar]; Tillema & Knol, 1997 Tillema, M and Knol, W. (1997). Collaborative planning by teacher educators to promote belief changes in their students. Teachers and Teaching: Theory and Practice, 3(1): 29–46. [Taylor & Francis Online] [Google Scholar]). In mathematics education the promise has been that pre‐service teachers’ socialization into new interactive ways of learning will not only lead to the (re)construction of powerful mathematical ideas and relationships, but that it will facilitate the implementation of these inquiry based practices in the classroom. This promise, however, is not often realized (Foss & Kleinsasser, 1996 Foss, D and Kleinsasser, R. (1996). Pre‐service elementary teachers’ views of pedagogical and ­mathematical content knowledge. Teaching and Teacher Education, 12(4): 429–442. [Crossref], [Web of Science ®] [Google Scholar]; Tillema & Knol, 1997 Tillema, M and Knol, W. (1997). Collaborative planning by teacher educators to promote belief changes in their students. Teachers and Teaching: Theory and Practice, 3(1): 29–46. [Taylor & Francis Online] [Google Scholar]). One reading of why this may be so, relying on and made visible through a poststructuralist analytic lens, is (a) that perhaps the pre‐service teachers’ ability to act in inquiry‐based, generative ways in the classroom does not necessarily follow from, but is produced or constituted in, teaching/learning interactions in school and teacher education, and (b) it may be that pedagogic practices in teacher education unintentionally and invisibly reproduce old epistemologies and ontologies that support knowledge transmission and teacher authority over student authored engagement and construction of ideas. In this paper the premise of a rational, autonomous agent of change on which so much of current practice is based is challenged, and the possible implications for teacher education discussed.     

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Abstract

As an example of how the effectiveness of well-designed laboratory interventions is often diffused in the field, we examined the effects of a motivation intervention on students' perceptions and learning. The intervention proved to be more effective in the laboratory (g = 0.45) than the field (g = 0.05) in enhancing subsequent motivation. We explored this reduction in treatment effectiveness through a fidelity analysis that examined the extent to which participants responded to the treatment. We calculated fidelity as three indices of achieved relative treatment strength (Cordray & Pion, 2006 Cordray, D. S. . The cause … or the ‘what’ of what works?. Paper presented at the Institute for Education Sciences 2006 Research Conference. Washington, DC. June,  [Google Scholar]), and found that, regardless of how fidelity was calculated, achieved relative strength was about 1 standard deviation less in the classroom than the laboratory. In addition, greater levels of achieved relative strength were associated with greater differences in the motivational outcome—indicating that intervention was more effective for participants who actually received the treatment than those who did not. Multilevel analyses indicated that the drop in classroom treatment fidelity was partially because of teacher, rather than student, factors. Implications for theoretical models of change and research are discussed.     

Multistage Computerized Adaptive Testing With Uniform Item Exposure

This article describes a computerized adaptive test (CAT) based on the uniform item exposure multi-form structure (uMFS). The uMFS is a specialization of the multi-form structure (MFS) idea described by Armstrong, Jones, Berliner, and Pashley (1998 Armstrong, R. D., Jones, D. H., Berliner, N. and Pashley, P. June 1998. Computerized adaptive tests with multiple form structures, June, Champaign-Urbana, IL: Paper presented at the annual meeting of the Psychometric Society.  [Google Scholar]). In an MFS CAT, the examinee first responds to a small fixed block of items. The items comprising that block may be unrelated to each other, or they may comprise a testlet (Wainer and Kiely, 1987 Wainer, H. and Kiely, G. L. 1987. Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24: 185–201. [Crossref], [Web of Science ®] , [Google Scholar]) After the first block of items has been administered, adaptation takes place in the choice of the next block to be administered and subsequent blocks. The uMFS design integrates item exposure control, as well as content balancing and other test development needs, into the design of the CAT, instead of placing those activities in the online implementation. We show that it is possible to implement item exposure control, in a very thorough way, in the psychometric specifications of the item blocks.     

Graduate attribute development and employment outcomes: tracking PhD graduates

The provision of diversified research training is regarded as one of the most significant contributions made by the Australian Cooperative Research Centres (CRC) programme [Howard Partners 2003 Howard Partners. 2003. Evaluation of the cooperative research centres programme, Canberra, ACT: Department of Education, Science and Training.  [Google Scholar], Evaluation of the cooperative research centres programme, Department of Education, Science and Training, Canberra, ACT]. Yet, a systematic evaluation of Australia’s CRC research training programmes and outcomes has not yet been undertaken. This article reports on a pilot questionnaire designed to provide the beginnings of such an evaluation. Participants were science‐based research graduates who were awarded with a PhD within the four‐year period 2000–2003 and had completed the majority of their PhD project either in a university school or in a CRC environment. The questionnaire results provide insights into participants’ perceptions of the graduate attributes they developed prior to and during their PhD studies. It also investigates their perceptions about the relative importance of particular skills in university and industry settings. This article argues that understanding the perceptions and employment experiences of recent research graduates is a vital way of ensuring that PhD programmes are more effectively designed to prepare research graduates for a range of careers. In particular, these results confirm the importance of constant re‐evaluation and improvement of all PhD training programmes.     

The Creation and Evolution of a Co-Teaching Community: How Teachers Learned to Address Adolescent English Language Learners' Needs as Writers

This article reports findings from a four-year formative experiment (Reinking &; Bradley, 2008 Reinking, D., &; Bradley, B. (2008). On formative and design experiments. New York, NY: Teachers College Press. [Google Scholar]) investigating a summer writing institute for ninth graders entering an urban high school. Intended as enrichment, not remediation, for a heterogeneous group of students, and as a learning experience, not just a teaching opportunity, for practitioners, the institute was grounded in multiliteracies (New London Group, 1996 New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66, 60–92. [Google Scholar]) and scholarship on inclusive schooling (Udvari-Solner, 1997 Udvari-Solner, A. (1997). Inclusive education. In C. A. Grant &; G. Ladson-Billings (Eds.), Dictionary of multicultural education (pp. 141–144). Phoenix, AZ: Oryx Press. [Google Scholar]). Its essential elements included (1) composing by students in both print and digital genres, (2) a small set of instructional approaches effective for heterogeneous populations, and (3) co-teaching and co-planning by institute staff. This article focuses on teachers' efforts to support the writing development of English Language Learners (ELLs), who represented 20–30% of institute participants each year. Findings revealed that as teachers made adjustments to the institute model over time, their efforts to support ELLs' participation became more grounded in collective examination of varied student data. As teachers worked in community with each other (Swanson, 2007 Swanson, D. (2007). Ubuntu: An African contribution to (re)search for/with a “humble togetherness.” Journal of Contemporary Issues in Education, 2(2), 53–67. [Google Scholar]; Venter, 2004 Venter, E. (2004). The notion of Ubuntu and communalism in African educational discourse. Studies in Philosophy and Education, 23, 149–160. [Google Scholar]), they increased their ability to address student writers' diverse needs.     

Interactive or inactive? a consideration of the nature of interaction in whole class teaching

Recent learning theories and the suggested importance of ‘interactive’ approaches in national initiatives, (NLS, NNS) led to an ESRC‐funded action research project involving the University of Exeter and teachers in three schools—‘Using Talk to Activate Learners’ Knowledge' (TALK). This investigated how ‘interactive’ whole class teaching was and whether teacher‐pupil interactions permitted recoding of information and understanding. The findings corroborate those from Galton (1999 Galton M Hargreaves L Comber C Wall D Pell T (1999a) Inside the primary classroom—20 years on (London, Routledge) [Crossref] [Google Scholar]a, 1999 Galton, M, Hargreaves, L, Comber, C, Wall, D and Pell, T. (1999b). Changes in patterns of teacher interaction in primary classrooms: 1976–1996. British Educational Research Journal, 25(1): 23–37. [Taylor & Francis Online] [Google Scholar]b), Mroz (2000 Mroz, M, Smith, F and Hardman, F. (2000). The discourse of the Literacy Hour. Cambridge Journal of Education, 30(3): 379–390. [Taylor & Francis Online] [Google Scholar]) and English (2002 English, E, Hargreaves, L and Hislam, J. (2002). Pedagogical dilemmas in the National Literacy Strategy: primary teachers' perceptions, reflections and classroom behaviour. Cambridge Journal of Education, 32(1): 9–26. [Taylor & Francis Online] [Google Scholar]): that teacher‐led questioning and explanation still dominate, as do teachers' objectives. Interaction as participation was differentially experienced by higher and lower abilities, boys and girls, with few opportunities for pupil initiation or extended response. The study, however, provides a model for more fully analysing the varying forms and functions of teachers' questions and statements which may lead to a greater clarity in recognising ways to provide more effective discourse for learning.