Using Small-Scale Randomized Controlled Trials to Evaluate the Efficacy of New Curricular Materials

How can researchers in K–12 contexts stay true to the principles of rigorous evaluation designs within the constraints of classroom settings and limited funding? This paper explores this question by presenting a small-scale randomized controlled trial (RCT) designed to test the efficacy of curricular supplemental materials on epigenetics. The researchers asked whether the curricular materials improved students’ understanding of the content more than an alternative set of activities. The field test was conducted in a diverse public high school setting with 145 students who were randomly assigned to a treatment or comparison condition. Findings indicate that students in the treatment condition scored significantly higher on the posttest than did students in the comparison group (effect size: Cohen''s d = 0.40). The paper discusses the strengths and limitations of the RCT, the contextual factors that influenced its enactment, and recommendations for others wishing to conduct small-scale rigorous evaluations in educational settings. Our intention is for this paper to serve as a case study for university science faculty members who wish to employ scientifically rigorous evaluations in K–12 settings while limiting the scope and budget of their work.     

First names and popularity in grade school children

The relationship between first name desirability and popularity was studied using 780 boys and 768 girls from six elementary schools. Girls' popularity, as demonstrated by positive sociometric choices, was significantly related to the desirability of their first names. There is also a slight indication that boys' popularity with girls was influenced by the boys' first names. Sociometric rejections were not related to first name desirability for either boys or girls. The findings for girls remained significant when the effects of parental education and ethnicity were partialled out; the single finding for boys did not.     

Who Pays for Online Content? A Media Dependency Perspective Comparing Young and Older People

This study examines predictors of online content purchases through media dependency theory and comparing young and older people. It focuses on actual online content purchases instead of willingness-to-pay used in previous studies. The effects of two dimensions of media dependencies are compared: intensity and referent scopes. Social media dependency and mobile media dependency are examined specifically, in addition to general Internet dependency as new media dependency. Our results show young people make more actual purchases of online content than older people. Predictors of online content purchases include age group, online shopping habits, ownership of mobile applications and mobile devices, Internet referent dependency, and social media intensity dependency. New media referent dependency is more important than intensity dependency for predicting online content purchases.     

Measuring teachers’ content knowledge of language and reading

In the context of a longitudinal, four-year study of reading instruction in low-performing, high-poverty urban schools, we surveyed teacher knowledge of reading-related concepts, and established a modest predictive relationship between teachers’ knowledge, classroom reading achievement levels, and teachers’ observed teaching competence. There were significant associations among these variables at the third and fourth grade levels. To obtain this result, measures of teacher content knowledge in language and reading were refined in a three-stage process. Our purpose was to explore the type and level of questions that would begin to discriminate more capable from less capable teachers, and that would have a predictive relationship with student reading achievement outcomes. After experimenting with measurement of K-2 teachers’ content knowledge (Form #1), we piloted a Teacher Knowledge Survey with 41 second and third grade teachers in one study site (Form #2). We then refined and expanded the Survey (Form #3) and administered it to 103 third and fourth grade teachers in both project sites. Teachers’ misconceptions about sounds, words, sentences, and principles of instruction were pinpointed so that professional development could address teachers’ needs for insight and information about language structure and student learning.     

‘Just open your eyes a bit more’: the methodological challenges of researching black and minority ethnic students' experiences of physical education teacher education

In this paper we discuss some of the challenges of centralising ‘race’ and ethnicity in Physical Education (PE) research, through reflecting on the design and implementation of a study exploring Black and minority ethnic students' experiences of their teacher education. Our aim in the paper is to contribute to ongoing theoretical and methodological debates about intersectionality, and specifically about difference and power in the research process. As McCorkel and Myers notes, the ‘researchers’ backstage'—the assumptions, motivations, narratives and relations—that underpin any research are not always made visible and yet are highly significant in judging the quality and substance of the resulting project. As feminists, we argue that the invisibility of ‘race’ and ethnicity within Physical Education Teacher Education (PETE), and PE research more widely, is untenable; however, we also show how centralising ‘race’ and ethnicity raised significant methodological and epistemological questions, particularly given our position as White researchers and lecturers. In this paper, we reflect on a number of aspects of our research ‘journey’: the theoretical and methodological challenges of operationalising concepts of ‘race’ and ethnicity, the practical issues and dilemmas involved in recruiting participants for the study, the difficulties of ‘talking race’ personally and professionally and challenges of representing the experiences of ‘others’.     

Short-term memory for order but not for item information is impaired in developmental dyslexia

Recent findings suggest that people with dyslexia experience difficulties with the learning of serial order information during the transition from short- to long-term memory (Szmalec et al. Journal of Experimental Psychology: Learning, Memory, & Cognition 37(5): 1270-1279, 2011). At the same time, models of short-term memory increasingly incorporate a distinction of order and item processing (Majerus et al. Cognition 107: 395-419, 2008). The current study is aimed to investigate whether serial order processing deficiencies in dyslexia can be traced back to a selective impairment of short-term memory for serial order and whether this impairment also affects processing beyond the verbal domain. A sample of 26 adults with dyslexia and a group of age and IQ-matched controls participated in a 2?×?2?×?2 experiment in which we assessed short-term recognition performance for order and item information, using both verbal and nonverbal material. Our findings indicate that, irrespective of the type of material, participants with dyslexia recalled the individual items with the same accuracy as the matched control group, whereas the ability to recognize the serial order in which those items were presented appeared to be affected in the dyslexia group. We conclude that dyslexia is characterized by a selective impairment of short-term memory for serial order, but not for item information, and discuss the integration of these findings into current theoretical views on dyslexia and its associated dysfunctions.     

Phonological spelling errors in the writing of dyslexic adolescents

Spelling researchers in the past have disagreed about the meaning of spelling errors for the diagnosis of dyslexia. Many studies have reported that spelling errors of individuals with dyslexia are similar to those of younger children but that they are not deviant or unusual. In this study, spelling errors from the spontaneous writing of 19 adolescents with a history of reading problems and persistent spelling difficulties were analyzed. The poorer spellers in this group made more errors than the better spellers on certain phonological and morphophonological constructions. Specifically, the poorer spellers made a disproportionately large number of errors in their representation of liquid and nasal consonants, especially after vowels, and their spellings of inflections -ed and -s. Even though poor spellers might eventually learn to spell with reasonable phonetic accuracy, their spelling appears to be marked by persistent, intractable difficulties representing specific phonological and morphophonological features of words.     

Engager and avoider behaviour in types of activities performed by out-of-class learning groups

This study examines the out-of-class learningactivities undertaken, at the students'volition, by groups of students. Data weregathered through 57 individual and 15 focusgroup interviews with university students inHong Kong. Group activities reported included:copying, sharing material, consulting peers,consulting teachers, studying and workingtogether, revising together beforeexaminations, discussing, collaborating acrossyears, forming study groups and participatingin extracurricular activities. Activities couldbe placed on a spectrum from low to high task-involvement. Some activities, such as copying,occurred at only one end of the spectrum. Mostoccurred in somewhat different forms across thespectrum. It was possible to categorise theseactivities into two categories labelled avoiderand engager behaviour. Avoider behaviour wasdisplayed by those who collaborated to minimisethe time individual members spent on assignedtasks. Engager behaviour was characterised byseeking to reach a communal understanding ofcourse content. Adoption of either behaviourwas influenced by the teaching and learningenvironment.     

Concrete and classrooms: how schools shape educational research

The notion of ‘the school’ as a set of institutional processes and practices that shape the possibilities of educational research forms the focus of this article. It is argued that the discursive and material practices that render schools agencies of cultural reproduction also have effects for what research can be undertaken in them and how. With reference to a series of ‘episodes’ that occurred during research about young people and sexuality in New Zealand, evidence for how schools shape research endeavours is provided. These examples present a complex picture of the way in which schools simultaneously police and are regulated by symbolic boundaries of gender and sexuality. How school disciplinary power works to effect what it is possible to claim about the voluntary nature of student research participation is also explored. It is argued that through the powerful discursive and material practices that occur in schools, these institutions can impede research that attempts to transgress dominant meanings about gender and sexuality.