Structuring asynchronous discussion groups: Comparing scripting by assigning roles with regulation by cross-age peer tutors

The present study focuses on comparing the impact of role assignment and cross-age peer tutors on students' level of knowledge construction in 15 asynchronous discussion groups of nine students each in a first-year university course (N = 135). Content analysis was applied to analyse the level of knowledge construction in students' online postings. The results indicated that students in the tutor-supported discussions reached significantly higher levels of knowledge construction as compared to students in the role-supported group. These findings underline the value of regulation by cross-age peer tutors to foster freshmen's knowledge construction processes.     

An evaluation of racial bias in a life satisfaction scale

This study investigated the possibility of racial bias in one of the few extant life satisfaction measures appropriate for children and adolescents, the Students' Life Satisfaction Scale (Huebner, 1991a). Participants were 115 Black and 106 White adolescents in Grades 8 through 12. There was no evidence of bias with respect to reliability, factorial validity, or concurrent validity.     

Shared Power,Risk-taking,and Innovation: Participatory Action Research in Jewish Education

ABSTRACT

In this article, the authors describe and discuss applications of the Group-Level Assessment/Understanding (GLA/GLU) process, an innovative participatory action research methodology. The authors first describe the GLA/GLU application in the Mandel Teacher Educator Institute (MTEI) and the creation of an MTEI interpretive community to deeply analyze the collected data. The authors then describe adaptations of the process in their home communities to address community-identified dilemmas, tensions, and problems. The article concludes with reflections on common themes that emerged in the GLA/GLU applications–shared power, risk-taking, and methodological innovation.     

Teaching Assistant Professional Development in Biology: Designed for and Driven by Multidimensional Data

Graduate teaching assistants (TAs) are increasingly responsible for instruction in undergraduate science, technology, engineering, and mathematics (STEM) courses. Various professional development (PD) programs have been developed and implemented to prepare TAs for this role, but data about effectiveness are lacking and are derived almost exclusively from self-reported surveys. In this study, we describe the design of a reformed PD (RPD) model and apply Kirkpatrick''s Evaluation Framework to evaluate multiple outcomes of TA PD before, during, and after implementing RPD. This framework allows evaluation that includes both direct measures and self-reported data. In RPD, TAs created and aligned learning objectives and assessments and incorporated more learner-centered instructional practices in their teaching. However, these data are inconsistent with TAs’ self-reported perceptions about RPD and suggest that single measures are insufficient to evaluate TA PD programs.     

Building Strong Community Partnerships: Equal Voice and Mutual Benefits

This article explores an urban partnership and service-learning project deliberately created to improve literacy and strengthen learning communities in an urban, Latino neighborhood of Chicago. The project aligns activities and objectives with resources and needs of university participants, a Latino community organization, and local public schools. The needs addressed include (a) improving literacy achievement in Latino students, (b) improving literacy instruction, (c) expanding students’ awareness and engagement with social injustices, and (d) exploring barriers to literacy access in students’ homes and community. This project serves as a model for developing partnerships and outreach between higher education institutions and the community.     

An Examination of Resilience Processes in Context: The Case of Tasha

This research examined resilience processes in context through a narrative case study of Tasha, a young African-American woman who grew up in a poverty-ridden area of a mid-sized city in the Southeast. Personal and external data are analyzed and interpreted in terms of contextually defined themes of adversity (i.e., intersectionality of social identities, lack of attachment to her primary caregiver, and teenage pregnancy); adaptation (i.e., high school graduation, career goal-setting, commitment to her children, and “street” competence); and, protective processes (i.e., individual attributes, natural mentors, and extended family support). The importance of external sources of support and Tasha as an active agent in her development is highlighted. Research and practical implications are discussed.     

The relationship between epistemological beliefs,learning conceptions,and approaches to study: a cross-cultural structural model?

Recent research has shown interest in studying the relationship between epistemological beliefs and numerous aspects of learning. A new question interests us: Is this kind of relationship homogeneous across cultures? This study focuses on the relationship between epistemological beliefs, learning conceptions, and approaches to study. A sample of Chinese (n = 299) and Flemish (n = 324) first-year university students in Beijing, China and Flanders were involved in the study. A structural equation model (SEM) relating the three concepts was applied to the sample data, largely confirming the theoretical assumptions. The results validated the postulation that epistemological beliefs predict students' conceptions of learning, which in turn are related to specific approaches to study. Multiple group analysis using SEM was applied and the structural weights model was confirmed across the two cultural groups. Mean level variations of the three main concepts were detected between the Chinese and Flemish groups. The results identified in the study offer valuable contributions to a deeper understanding of the interplay between epistemological beliefs and student learning from a cross-cultural perspective. Implications for learning and instruction are discussed.     

Beyond item analysis: Connecting student behaviour and performance using e-assessment logs

Traditional item analyses such as classical test theory (CTT) use exam-taker responses to assessment items to approximate their difficulty and discrimination. The increased adoption by educational institutions of electronic assessment platforms (EAPs) provides new avenues for assessment analytics by capturing detailed logs of an exam-taker's journey through their exam. This paper explores how logs created by EAPs can be employed alongside exam-taker responses and CTT to gain deeper insights into exam items. In particular, we propose an approach for deriving features from exam logs for approximating item difficulty and discrimination based on exam-taker behaviour during an exam. Items for which difficulty and discrimination differ significantly between CTT analysis and our approach are flagged through outlier detection for independent academic review. We demonstrate our approach by analysing de-identified exam logs and responses to assessment items of 463 medical students enrolled in a first-year biomedical sciences course. The analysis shows that the number of times an exam-taker visits an item before selecting a final response is a strong indicator of an item's difficulty and discrimination. Scrutiny by the course instructor of the seven items identified as outliers suggests our log-based analysis can provide insights beyond what is captured by traditional item analyses.

Practitioner notes

What is already known about this topic

• Traditional item analysis is based on exam-taker responses to the items using mathematical and statistical models from classical test theory (CTT). The difficulty and discrimination indices thus calculated can be used to determine the effectiveness of each item and consequently the reliability of the entire exam.

What this paper adds

• Data extracted from exam logs can be used to identify exam-taker behaviours which complement classical test theory in approximating the difficulty and discrimination of an item and identifying items that may require instructor review.

Implications for practice and/or policy

• Identifying the behaviours of successful exam-takers may allow us to develop effective exam-taking strategies and personal recommendations for students.
• Analysing exam logs may also provide an additional tool for identifying struggling students and items in need of revision.