Population validity for educational data mining models: A case study in affect detection

Information and communication technology (ICT)‐enhanced research methods such as educational data mining (EDM) have allowed researchers to effectively model a broad range of constructs pertaining to the student, moving from traditional assessments of knowledge to assessment of engagement, meta‐cognition, strategy and affect. The automated detection of these constructs allows EDM researchers to develop intervention strategies that can be implemented either by the software or the teacher. It also allows for secondary analyses of the construct, where the detectors are applied to a data set that is much larger than one that could be analyzed by more traditional methods. However, in many cases, the data used to develop EDM models are collected from students who may not be representative of the broader populations who are likely to use ICT. In order to use EDM models (automated detectors) with new populations, their generalizability must be verified. In this study, we examine whether detectors of affect remain valid when applied to new populations. Models of four educationally relevant affective states were constructed based on data from urban, suburban and rural students using ASSISTments software for middle school mathematics in the Northeastern United States. We found that affect detectors trained on a population drawn primarily from one demographic grouping do not generalize to populations drawn primarily from the other demographic groupings, even though those populations might be considered part of the same national or regional culture. Models constructed using data from all three subpopulations are more applicable to students in those populations than those trained on a single group, but still do not achieve ideal population validity—the ability to generalize across all subgroups. In particular, models generalize better across urban and suburban students than rural students. These findings have important implications for data collection efforts, validation techniques, and the design of interventions that are intended to be applied at scale.     

Role of questions in inquiry-based instruction: towards a design taxonomy for question-asking and implications for design

Many theories and models describe the various cognitive processes individuals engage in as they solve ill-structured problems. While diverse in perspectives, these theories and models uniformly agree that essential aspects of complex problem solving include iteration and inquiry. This paper further argues that an important yet overlooked component of knowledge construction during problem-solving is the ability to ask meaningful questions. What is needed, but not adequately articulated and validated, is a theoretical taxonomy of question-asking to better understand and guide a learner’s reasoning process. Based on the expert–novice literature, we proffer the following question taxonomy: shallow/simple (verification, disjunctive, concept completion), testing (example, feature specification, quantification, definition, comparison), and deep/complex questions (interpretation, causal antecedent, causal consequence, goal orientation, instrumental/procedural, enablement, expectation, and judgmental). We, therefore, build on existing theories/models of problem-solving, failure, and reflection and their implications towards a taxonomy of question-asking. Given this taxonomy, researchers and designers can better understand learners’ level of understanding and problem-solving trajectories.

     

Implementing summative assessment with a formative flavour: a case study in a large class

Teaching a large class can present real challenges in design, management and standardisation of assessment practices. One of the main dilemmas for university teachers is how to implement effective formative assessment practices with accompanying high-quality feedback consistently over time with large classroom groups. This article reports on how elements of formative practices can be implemented as part of summative assessment in very large undergraduate cohorts (n = 1500 in one semester), studying in different modes (on- and off-campus), with multiple markers, and under common cost and time constraints. Design features implemented include the use of exemplars, rubrics and audio feedback. The article draws on the reflections of the leading teacher, and argues that, for summative assessment to benefit learners, it should contain formative assessment elements. The teaching practices utilised in the case study provide some means to resolve the tensions between formative assessment and summative assessment that may be more generally applicable.     

Erratum to: Middle School Engagement with Mathematics Software and Later Interest and Self-Efficacy for STEM Careers

Journal of Science Education and Technology -     

Rescuing the Childcare Center: One Community’s Efforts to Manage Change Through Generating and Coordinating Resources

Childcare centers are business organizations and are subject to some of the same issues and problems as any small business. Many childcare administrators have little or no business training, and are unable to embrace change in order to help their programs survive economic problems. This article describes how one community saved their childcare center through collaboration.     

Connecting students to the real world: Developing gifted behaviors through service learning

Learning in today's classrooms can be disconnected from students' real world experiences. Providing students the opportunity to address real‐world problems may provide avenues for students to engage in their communities while developing academic skills and knowledge. Additionally, for students whose interests are piqued by the nature of their community's problems, these activities have the potential to offer students meaningful, motivating work in a supportive environment. This article explores how providing students with interest‐based service‐learning opportunities may help them develop and demonstrate gifted behaviors. In addition, methods for integrating student interests and service‐learning projects are presented. © 2012 Wiley Periodicals, Inc.     

Something Old,Something New,Something Borrowed From Something Blue: Experiments on Dual Viewing TV and Twitter

The use of second screens to dual-view television and social media is exponentially increasing. As a result, television producers are increasingly augmenting television content with social media comments from viewers, which may serve as a type of real-time public opinion indicator. The current research effort utilizes two experimental studies to explore the effects of this new media production practice on viewer's attitudes and opinions. In these studies, a Twitter feed was integrated in to entertainment (Study 1) and political (Study 2) television broadcasts and manipulated to convey either positive or negative opinions of the content. Participants' opinions were found to conform to the majority opinion presented in the manipulated Twitter feed in nearly all of the analyses. Implications for dual viewing and second screen use are discussed in light of findings.     

Discourses of forgiveness and resilience in stepchild–stepparent relationships

Challenges and conflicts experienced by stepfamilies are well documented, but researchers are increasingly focused on communication processes that facilitate resilience in these relationships. In other contexts, communicating forgiveness has been linked to relational healing after transgressions or adversity. In the current study, the researchers sought to understand how stepchildren talk about the role of forgiveness in the development of positive adult stepchild–stepparent relationships. Data were drawn from interviews with adult stepchildren who have a positive relationship with a stepparent. Following an interpretive analysis, the researchers identified five themes representing the ways forgiveness was conceptualized and enacted in these positive stepchild–stepparent relationships: forgiveness as (a) healing family connections, (b) explicit negotiation, (c) maturation and acceptance, (d) a response to vulnerability and compassion, and (e) evidence of relational growth. Theoretical and practical applications for understanding and fostering resilient stepfamilies and the role of forgiveness are discussed.