Using Multisite Experiments to Study Cross-Site Variation in Treatment Effects: A Hybrid Approach With Fixed Intercepts and a Random Treatment Coefficient

The present article considers a fundamental question in evaluation research: “By how much do program effects vary across sites?” The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates several biases that can arise from unbalanced sample designs for multisite randomized trials. The article then describes how the approach operates, explores its assumptions, and applies the approach to data from three large welfare-to-work trials. The article also illustrates how to report cross-site impact findings and presents diagnostics for assessing these findings. To keep the article manageable, it focuses on experimental estimates of effects of program assignment (effects of intent to treat), although the ideas presented can be extended to analyses of multisite quasi-experiments and experimental estimates of effects of program participation (complier average causal effects).     

Supporting linguistically diverse students' science learning with dynamic visualizations through discourse-rich practices

Carefully scaffolded dynamic visualizations have potential to promote science learning for all students, including English language learners (ELLs) who are often underserved in mainstream science classrooms, but little is known about how to design effective scaffolding to support such diverse students' learning with dynamic visualizations. This study investigated how two forms of scaffolding embedded in dynamic visualizations, expert guidance and generating guidance, can foster ELLs' and non-ELLs' understanding of unobservable scientific phenomena. While interacting with dynamic visualizations, students in the expert guidance condition were provided with scientifically accurate explanations to interpret visual representations, whereas students in the generating guidance condition were prompted to generate their own explanations using visual representations. The results show the significant advantage of generating guidance over expert guidance for both ELLs and non-ELLs, although students in the generating guidance condition did not receive feedback on their generated artifacts. Analyses of video data and log data from 40 pairs revealed that each form of scaffolding affected the quantity and quality of linguistically diverse students' conversations. The results show that generating guidance enabled students, particularly ELLs, to engage in discourse-rich practices to evaluate various sources of evidence from the visualization and compare the evidence to their alternative ideas to develop a coherent understanding of the target concepts. This study shows the unique benefits of generating guidance as an effective strategy to support linguistically diverse students' science learning with dynamic visualizations.     

Comparing the Information Needs and Experiences of Undergraduate Students and Practicing Engineers

Practicing engineers and undergraduate engineering and technology students seek and use information differently within the research and design process. This paper presents the results of a survey conducted by librarians at Purdue University and information specialists at Caterpillar Inc. to analyze self-reported information habits and challenges of both user populations. The authors created surveys containing similar questions for each user group, using a framework that asked participants to think about their information needs and use during a recent engineering project. The survey questions discerned users' confidence in their information abilities, and their preferences and barriers for finding and using information.The results of this study reveal differences between students and engineers and are informative for both academic and corporate librarians. Key findings affirm previous research that novices are more confident in their abilities than experts. Additionally, the findings suggest undergraduates prefer quick, easy to digest content like online videos and news, while engineers are more likely to learn by consulting a colleague or other subject expert, and through reading journals and trade literature. While students rated themselves as more confident information users, engineers reported working in a more complex information landscape, which includes internal document management systems and numerous places to look for technical information. Findings within this paper can inform the development of information literacy curricula that better parallels the corporate environment, and can give corporate librarians insight into how recent graduates may expect to interact with information in a new work environment.     

The Integration of English Language Development and Science Instruction in Elementary Classrooms

This paper explores one district’s attempt to implement a blended science and English Language Development (ELD) elementary program, designed to provide English language learners opportunities to develop proficiency in English through participation in inquiry-based science. This process resulted in blended program that utilized a combined science/ELD lesson plan format to structure and guide teachers’ efforts to use science as the context for language development. Data, collected throughout the first 2 years of the program, include teacher-generated lesson plans, observation notes, and interviews with teachers and principals. The process by which the blended program was developed, the initial implementation of the program, the resulting science/ELD lesson plan format, and teachers’ perceptions about the program and its impact on their students are described.     

Validity and Reliability of the Global Physical Activity Questionnaire (GPAQ)

There is limited published validity and reliability evidence to support using the Global Physical Activity Questionnaire. Two studies were conducted to evaluate validity and reliability evidence for the Global Physical Activity Questionnaire. In Study 1: 69 adults completed the Global Physical Activity Questionnaire (three months apart; n?=?54), International Physical Activity Questionnaire, fitness and anthropometric measures. All participants wore a pedometer and 53 participants wore an accelerometer for seven days at baseline. In Study 2, 16 adults completed the Global Physical Activity Questionnaire 10 days apart. Global Physical Activity Questionnaire moderate and vigorous minutes were correlated with the accelerometer moderate (r?=?0.28) and vigorous (r?=?0.48) physical activity. The Global Physical Activity Questionnaire and International Physical Activity Questionnaire were related for sedentary behaviors (r?=?0.51), moderate-to-vigorous (r?=?0.48) and vigorous (r?=?0.63) PA. Global Physical Activity Questionnaire moderate-to-vigorous physical activity was associated with percent fat (r =??0.32), estimated VO₂ max (r?=?0.26), and step count (r?=?0.39). The Global Physical Activity Questionnaire demonstrated graded differences across categories for step count, body mass index, waist circumference, percent fat, fitness, and accelerometer measured activity. Short-term test–retest reliability (10 days) ranged from 0.83 to 0.96 while long-term reliability (three months) was 0.53 to 0.83. These data provide low-to-moderate validity and generally acceptable reliability evidence for the Global Physical Activity Questionnaire.     

A Realistic Evaluation of Two Training Programs on Implementing Skin-to-Skin as a Standard of Care

The authors used realistic evaluation to examine the real-world effectiveness of two 5-day training techniques on sustained optimal skin-to-skin practices that support Step 4 of the revised Baby-Friendly Hospital Initiative (BFHI). The authors found that education alone was insufficient to effect sustainable practice change. Exposure to the 5-day immersion model (Practice, Reflection, Education and training, Combined with Ethnography for Sustainable Success, or PRECESS) alone or combined with education was an effective strategy to change and sustain the standard of care for skin-to-skin practice (p < 0.00001). The intended outcome of sustained practice change toward implementation of skin-to-skin care through immersion or a combined approach shows promise and should be repeated in other localities.     

War-related trauma linked to increased sustained attention to threat in children

Experiences of war and displacement can have profound effects on children's affective development and mental health, although the mechanism(s) underlying these effects remain unknown. This study investigated the link between early adversity and attention to affective stimuli using a free-viewing eye-tracking paradigm with Syrian refugee (n = 31, M_age = 9.55, 12 female) and Jordanian non-refugee (n = 55, M_age = 9.98, 30 female) children living in Jordan (March 2020). Questionnaires assessed PTSD, anxiety/depression, insecurity, distress, and trauma. Refugee children showed greater initial avoidance of angry and happy faces compared to non-refugee children, and higher trauma exposure was linked to increased sustained attention to angry stimuli. These findings suggest that war-related trauma may have differential effects on the early and later stages of affective processing in refugee children.     

Teaching Chemistry for All Its Worth: The Interaction Between Facts,Ideas, and Language in Lavoisier’s and Priestley’s Chemistry Practice: The Case of the Study of the Composition of Air

Both Lavoisier and Priestley were committed to the role of experiment and observation in their chemistry practice. According to Lavoisier the physical sciences embody three important ingredients; facts, ideas, and language, and Priestley would not have disagreed with this. Ideas had to be consistent with the facts generated from experiment and observation and language needed to be precise and reflect the known chemistry of substances. While Priestley was comfortable with a moderate amount of hypothesis making, Lavoisier had no time for what he termed theoretical speculation about the fundamental nature of matter and avoided the use of the atomic hypothesis and Aristotle’s elements in his Elements of Chemistry. In the preface to this famous work he claims he has good educational reasons for this position. While Priestley and Lavoisier used similar kinds of apparatus in their chemistry practice, they came to their task with completely different worldviews as regards the nature of chemical reactivity. This paper examines these worldviews as practiced in the famous experiment on the composition of air and the implications of this for chemistry education are considered.     

Beliefs About Thought Probability: Evidence for Persistent Errors in Mindreading and Links to Executive Control

Four‐ to 10‐year‐olds' and adults' (N = 263) ability to inhibit privileged knowledge and simulate a naïve perspective were examined. Participants viewed pictures that were then occluded aside from a small ambiguous part. They offered suggestions for how a naïve person might interpret the hidden pictures, as well as rated the probability that a naïve person would think of several different pictures (with one picture being the actual item). Results indicated a significant increase between ages 4 and 7 years in attributing novel interpretations; however, all age groups overestimated the probability that a naïve person could guess the actual pictures. Individual differences in working memory and inhibitory control predicted participants' thought suggestions as well as aspects of their probability judgments.