Going Beyond Convergence in Bayesian Estimation: Why Precision Matters Too and How to Assess It

Most of the software that is available to implement Bayesian approaches uses Markov chain Monte Carlo (MCMC) methods. It is our impression that many researchers are primarily concerned with convergence as assessed by the Potential Scale Reduction (PSR) and that other aspects of MCMC are largely ignored. In this article, we argue that the precision with which the Bayesian estimates are approximated by summary statistics for the MCMC chain is essential to ensure good statistical properties. We discuss the Effective Sample Size (ESS), which indicates how well an estimate is approximated, and present evidence from two simulation studies and an example from organizational research to support our claim that researchers should be concerned not only with convergence but also with precision, particularly when a multilevel model is estimated. In addition, we demonstrate how Mplus can be modified so that users can control the ESS, and we conclude with recommendations.     

King Kong,Storks and Birth Rates

This article discusses the influence extreme observations can exert on linear correlation between variables. It shows that standard p‐values obtained according to ordinary least squares and median regression can be misleading. Bootstrapping can prevent underestimation of the standard error of the regression coefficient and therefore unmask the deceiving correlation.     

A Collective Self-Study to Improve Program Coherence of Clinical Experiences

Student feedback collected through program evaluation of secondary education licensure and Master’s program clinical experiences prompted us to conduct a collective self-study. We used a reflective framework for analysis and discussion of the shifts students in our courses made as they progressed from observers to practicing teachers. Along with our graduate students, we collected and shared data and analysis from two courses – an introductory mathematics course for pre-service teachers and a capstone self-study teacher research course for in-service teachers. Data included students’ reflective accounts of their clinical experiences, dialogue with peers in response memos and focus groups, and our meta-conversation about and interpretations of data captured in meeting notes, audio recordings of meetings, email exchanges, and video conferencing over a two-month period. Analysis resulted in reframed thinking about our teaching and implications for program coherence, including provision of meaningful participant observations in diverse settings, design of dialogic platforms for students to make connections, and support of a critical level of reflection to inform teacher professional practice. The results are informative to teacher educators and programs seeking to better understand their roles in designing dialogic spaces for students to think deeply about the connections of their courses to clinical experiences and in supporting ongoing teacher professional development. The study highlights the benefits of faculty collective self-studies and contributes to the literature on self-study for program development.     

The impact of national educational policies on student achievement: a European study

This paper investigates the impact of national policies for improving teaching and the school learning environment (SLE) on student achievement. In each participating country (i.e., Belgium/Flanders, Cyprus, Germany, Greece, Ireland, and Slovenia), a sample of at least 50 schools was drawn and tests in mathematics and science were administered to all Grade 4 students (N = 10,742) at the beginning and end of school year 2010–2011. National policies were measured through (a) content analysis of policy documents, (b) interviews with policymakers, and (c) head-teacher questionnaires. Multilevel analyses revealed that most aspects of national policies for teaching and SLE were associated with student achievement in each subject irrespective of the source of data used to measure them. Implications are, finally, drawn.     

Development of a Metric to Test Group Differences in Ecological Knowledge as One Component of Environmental Literacy

Abstract

Environmental literacy has been defined in numerous ways and attempts have been made to measure how environmentally literate people are. Many attempts to measure literacy have instead measured people's knowledge about pollution and their attitudes toward the environment. According to many environmental education experts, knowledge and attitudes are important components of environmental literacy, especially if the goal of environmental education is to change behavior. However, the experts also indicate that, to change an individual's behavior, knowledge about the environment must be associated with environmental sensitivity, personal beliefs, and decisionmaking and problem-solving skills. The research presented in this article contributes to environmental literacy research by offering a tested, valid survey instrument to measure ecological knowledge—one component of environmental literacy. In this article, we provide an example of how this instrument can be applied by comparing knowledge levels among diverse groups of Ohio citizens.     

The Assessment of Mathematics and Science Teacher Quality

The purpose of this study was to examine the types of instruments being used to document mathematics and science teacher quality characteristics in 48 nationally funded mathematics and science education awards. Each of the 48 projects operationalized teacher quality and determined how to assess it. The main research questions examined the instruments awardees used to gather data on mathematics and science teacher quality, and the main characteristics of teachers examined by awardees. Results showed that awardees most frequently used surveys or questionnaires to assess characteristics of mathematics and science teacher quality. The most common teacher characteristics examined by awardees' included teacher behaviors, practices, and beliefs, followed by the assessment of subject and pedagogical knowledge, and the documentation of mathematics and science teachers' certification. A few new instruments were under development and in use to assess characteristics of teacher quality. Detailed information on the development and psychometric properties of the instruments used for these examinations was not available from the reports. Because awardees were at different stages in their funded activities and data collection efforts were ongoing at the time of this analysis, this study offers a preliminary and formative review of the use of assessments to document mathematics and science teacher quality characteristics among these awards.     

Self-regulated learning and performance calibration among elementary physical education students

This study examined the effectiveness of a social-cognitive training model of self-regulation on students’ dribbling performance, calibration accuracy, and motivational beliefs. Participants were 120 fifth and sixth graders. Students who sequentially experienced emulative and self-control practice setting either process or performance goals at the emulation or at the self-control level improved their dribbling performance and motivational beliefs from pre- to post-test. Students overestimated their performance except for those in the process goal condition who underestimated it. These findings support the effectiveness of this training model and are discussed with reference to the self-regulation and performance calibration development in physical education.