Measuring Quality Technology Integration in Science Classrooms

Journal of Science Education and Technology - Researchers, evaluators, and practitioners need tools to distinguish between applications of technology that support, enhance, and transform classroom...     

Digital Module 12: Think-aloud Interviews and Cognitive Labs https://ncme.elevate.commpartners.com

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze distinct types of verbal reports in the collection of evidence of test-taker response processes. The module includes details on (a) the different types of cognition that are tapped by different interviewer probes, (b) traditional interviewing methods and new automated tools for collecting verbal reports, and (c) options for analyses of verbal reports. This includes a discussion of reliability and validity issues such as potential bias in the collection of verbal reports, ways to mitigate bias, and inter-rater agreement to enhance credibility of analysis. A novel digital tool for data collection called the ABC tool is presented via illustrative videos. As always, the module contains audio-narrated slides, quiz questions with feedback, a glossary, and curated resources.     

A Preliminary Examination of Burnout Among Counselor Trainees Treating Clients With Recent Suicidal Ideation and Borderline Traits

Treating suicidal clients with borderline traits can be conducive to burnout. Dialectical behavior therapy (DBT) may assuage this burnout in counselors. As part of a DBT treatment outcome study, 6 counselors in training collected their own salivary cortisol samples and completed self‐report measures of burnout and well‐being for 1 year. Findings indicate a significant interaction for cortisol levels by treatment condition, such that DBT counselors experienced less physiological stress over time relative to a control group of counselors. There were no group differences in self‐reported burnout or well‐being. DBT may have a salutary effect on trainees' physiological stress levels over time.     

Use of Feedback-Oriented Online Exercises to Help Physiology Students Construct Well-Organized Answers to Short-Answer Questions

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary was used to create feedback-oriented interactive online exercises to help students strengthen certain HOCS as they actively constructed answers to questions concerning the regulation of 1) metabolic rate, 2) blood sugar, 3) erythropoiesis, and 4) stroke volume. Each exercise began with a SAQ presenting an endocrine dysfunction or a physiological challenge; students were prompted to answer between six and eight multiple-choice questions while building their answer to the SAQ. Student outcomes on the SAQ sections of summative exams were compared before and after the introduction of the online tool and also between subgroups of students within the posttool-introduction population who demonstrated different levels of participation in the online exercises. While overall SAQ outcomes were not different before and after the introduction of the online exercises, once the SAQ tool had become available, those students who chose to use it had improved SAQ outcomes compared with those who did not.     

Storytelling Dramas as a Community Building Activity in an Early Childhood Classroom

Healthy social-emotional development is promoted by building a safe, secure and respectful environment in an early childhood setting with positive and consistent relationships among adults, children, and their peers. This study explored storytelling dramas as an opportunity to build community within the context of one early childhood classroom. The study was a qualitative, interpretive analysis of 20 videotaped storytelling drama sessions containing approximately 100 stories told by children in one preschool classroom over a 6-month period. Videotapes of the 20 storytelling sessions were analyzed for patterns and themes that may represent community building within the context of one preschool classroom. Qualitative methods were used to identify themes that emerged from the videotaped data. Triangulation across investigators, time, and methods enhanced trustworthiness of interpretations. Results showed that the storytelling drama activity provided opportunities to promote community building through four emerging themes: (1) individual roles, (2) group membership, (3) inclusion, and (4) relationship building. Storytelling dramas provide teachers with an easy to implement teaching strategy that builds community and aligns with current early childhood education quality standards and child development theory.     

Longitudinal Stability of Reading-Related Skills and Their Prediction of Reading Development

Individual differences in word recognition, spelling, and reading comprehension for 324 children at a mean age of 16 were predicted from their reading-related skills (phoneme awareness, phonological decoding, rapid naming, and IQ) at a mean age of 10 years, after controlling the predictors for the autoregressive effects of the correlated reading skills. There were significant and longitudinally stable individual differences for all four reading-related skills that were independent from each of the reading and spelling skills. Yet the only significant longitudinal prediction of reading skills was from IQ at mean age 10 for reading comprehension at mean age 16. The extremely high longitudinal latent-trait stability correlations for individual differences in word recognition (.98) and spelling (.95) left little independent outcome variance that could be predicted by the reading-related skills. We discuss the practical and theoretical importance of these results and why they differ from studies of younger children.     

Exploring knowledge processes based on teacher research in a school–university research network of a master’s program

School–university research networks aim at closer integration of research and practice by means of teacher research. Such practice-oriented research can benefit both schools and universities. This paper reports on a multiple-case study of five participants in a school–university research network in a Dutch master’s program. The research question was: In what way is knowledge based on practice-oriented research by master’s students developed, shared, and used in school–university research networks in which education is primarily offered within a university setting? Twenty interviews were conducted, on the basis of logs, over a period of 10 months. Results show that (1) for master’s students, the most significant motive for developing, sharing or using knowledge was that the content knowledge about their research topic could be useful to school practice and colleagues; (2) research supervisors reported more than master’s students about the procedural knowledge that they had developed and shared. This knowledge focused on the collaborative process of supporting research and knowledge processes in school and university; (3) activities of knowledge sharing and use appeared to depend to a significant extent on individual purposes and leadership initiatives of master’s students and their supervisors; and (4) in the school–university research network, master’s students and research supervisors continued—to a limited extent—knowledge processes based on master’s students research after their graduation. Outcomes indicate that use of existing network structures in master’s programs is complex, but could be a promising avenue for creating successful school–university research networks.     

Agriculture and HIV/AIDS: A Challenge for Integrated and Interactive Approaches

Abstract

One of the main problems in Southern Africa in relation to HIV/AIDS is food insecurity. The vicious relation between malnutrition, HIV infection and AIDS impact drives individuals, households and communities in a downwards spiral of impoverishment. Although scientists and development practitioners have stressed the importance of interactive approaches to mitigate the impact of AIDS on agriculture and rural development, sustainable implementation is far from easy and straightforward. This study aims to gain insight into the main lessons and challenges with respect to their design and implementation. Literature review of interactive approaches in agriculture and natural resource management shows that several principles and process guidelines are considered key factors to successful implementation. Although HIV/AIDS does not seem to change these conditions, personal experiences from researchers, development practitioners and extension workers do reveal new and unforeseen challenges.     

An Exploratory Investigation of the Counseling Competencies Scale: A Measure of Counseling Skills,Dispositions, and Behaviors

The authors examined the psychometric properties of the Counseling Competencies Scale (CCS; University of Central Florida Counselor Education Faculty, 2009 ), an instrument designed to assess trainee competencies as measured in their counseling skills, dispositions, and behaviors. There was strong internal consistency for the 4‐factor model for midterm data (.927) and the 5‐factor model for final data (.933). Interrater reliability for the total CCS score was .570, and criterion‐related validity (correlation between the total score on the final CCS and semester grade) yielded a moderate correlation (r= .407, p < .01). Thus, the results provide initial support for using the CCS to assess counseling students’ professional competencies.