The Critical Thinking Analytic Rubric (CTAR): Investigating intra-rater and inter-rater reliability of a scoring mechanism for critical thinking performance assessments

The purpose of this study was to investigate the intra-rater and inter-rater reliability of the Critical Thinking Analytic Rubric (CTAR). The CTAR is composed of 6 rubric categories: interpretation, analysis, evaluation, inference, explanation, and disposition. To investigate inter-rater reliability, two trained raters scored four sets of performance-based student work samples derived from a pilot study and subsequent larger study. The two raters also blindly scored a subset of student work samples a second time to investigate intra-rater reliability. Participants in this study were high school seniors enrolled in a college preparation course. Both raters showed acceptable levels of intra-rater reliability (α ≥ 0.70) in five of the six rubric categories. One rater showed poor consistency (α = 0.56) for the analysis category of the rubric, while the other rater showed excellent consistency (α = 0.91) for the same category suggesting the need for further training of the former rater. The results of the inter-rater reliability investigation demonstrate acceptable levels of consistency (α ≥ 0.70) in all rubric categories. This investigation demonstrated that the CTAR can be used by raters to score student work samples in a consistent manner.     

Mediating Science and Society in the EU and UK: From Information-Transmission to Deliberative Democracy?

In this paper we critically review recent developments in policies, practices and philosophies pertaining to the mediation between science and the public within the EU and the UK, focusing in particular on the current paradigm of Public Understanding of Science and Technology (PEST) which seeks to depart from the science information-transmission associated with previous paradigms, and enact a deliberative democracy model. We first outline the features of the current crisis in democracy and discuss deliberative democracy as a response to this crisis. We then map out and critically review the broad outlines of recent policy developments in public-science mediation in the EU and UK contexts, focusing on the shift towards the deliberative-democratic model. We conclude with some critical thoughts on the complex interrelationships between democracy, equality, science and informal pedagogies in public-science mediations. We argue that science and democracy operate within distinct value-spheres that are not necessarily consonant with each other. We also problematize the now common dismissal of information-transmission of science as inimical to democratic engagement, and argue for a reassessment of the role and importance of informal science learning for the “lay” public, provided within the framework of a deliberative democracy that is not reducible to consensus building or the mere expression of opinions rooted in social and cultural givens. This, we argue, can be delivered by a model of PEST that is creative and experimental, with both educational and democratic functions.     

“You Can’t Bring Your Cat to Work”: Challenges Mothers Face Combining Breastfeeding and Working

Despite increasing emphasis in recent years on the importance of breastfeeding for public health, rates in the United States still fall short of goals set by health organizations. In particular, breastfeeding rates for working mothers are lower than for stay at home mothers, despite policy changes to facilitate breastfeeding and working. Based on interviews with 23 mothers who were participants in breastfeeding support groups, this study explores some of the factors contributing to women’s difficulty combining breastfeeding and working. Findings indicate that some women do not return to work because they believe working and breastfeeding are not compatible, while those who do work and breastfeed often lack support from coworkers and managers. In order to improve breastfeeding rates for working mothers, organizations should make their support for breastfeeding mothers explicit beyond formal policies such as lactation rooms.     

Capturing every patron interaction: the move from paper statistics to an electronic system to track the whole library

Reference departments track patron interactions to illustrate the type and number of services provided as well as to tailor librarians' time and expertise to the interest and needs of their patrons. Until 2010 the Reference, Education, and Community Engagement Department at the Calder Memorial Library tracked statistics using a complicated system of paper tic sheets and two Excel? spreadsheets. After considering different electronic systems, the department decided to employ an electronic form created with SurveyMonkey? to track patron interactions. After the system had been in place for three months, the authors administered a satisfaction and use survey to collect faculty and staff feedback on the new system. Seven months later the authors undertook usability testing to collect further evaluative data on the electronic form. The patron interaction form continues to be used to collect statistics, provide data for annual reviews, and recognize the contributions of all faculty and staff at the library.     

Navigational Structures and Information Selection Goals: A Closer Look at Online Selectivity

Using an experimental design coupled with Web-tracking technology, this study explores 2 factors that influence levels of congruent information gathering online. The first factor compares the navigational structure of 2 distinct Web pages—the more open, user-directed search engine versus the organized, assembled structure of a portal Web page. The second factor tests the role of goals for information seeking—telling subjects they will soon engage in a discussion with another person who either disagrees with their viewpoint, agrees, is undecided, or no discussion treatment. Results indicate both experimental factors independently contribute to selectivity in online information seeking.     

“I just do what the boys tell me”: Exploring small group student interactions in an integrated STEM unit

Gender equity issues remain a challenge in science, technology, engineering, and mathematics (STEM) fields, where women are highly underrepresented. As integrated STEM instruction becomes increasingly popular in elementary and middle school classrooms, it is important to consider whether the small group activities that are commonplace in STEM instruction support the equitable participation of young girls. This study builds on the existing body of literature to better understand how gender is related to student participation in small group STEM activities and whether students participate differently in science and engineering activities. A single embedded case study was used to explore the experiences of four students aged 10–11 years as they participated in small group work within an integrated STEM unit in their fifth-grade classroom. Two girls and two boys worked together throughout the unit to explore science content related to electromagnetism and apply their content knowledge to an engineering design challenge. Video and audio of students' small group interactions were analyzed using an observation protocol to code their participation in each 3-min segment of STEM activity. Student- and case-level analyses were used to identify patterns of interaction based on gender and type of activity (science vs. engineering). Findings suggest that boys and girls participate in small group STEM activities in different ways, adopting distinct roles within their group. In addition, students displayed divergent patterns of interaction in science- and engineering-focused lessons, suggesting that students need additional practice and support in navigating between science and engineering in integrated STEM units.