Using Retrospective Pre-Ratings to Counteract Response-Shift Confounding

A potential confounding effect present in research designs which employ self-report instruments is response-shift, i.e., a change in the internalized standard by which a subject rates himself. Howard et al. (6) suggest that when self-report measures must be used to measure behavioral changes there should be a modification of Campbell and Stanley’s design (2) so as to include a “retrospective pre-rating.” In the current research, the response-shift phenomenon is demonstrated in the context of a typical classroom setting. Retrospective pre-ratings are shown to yield significantly more accurate estimates of preinstruction knowledge than simple pre-ratings. However, there was no statistically significant difference between correlation co-efficients relating “behavioral change” and “self-reported change” when self-reported change was defined in terms of retrospective pre-ratings rather than in terms of simple pre-ratings.     

Research Priorities in Performance Technology A Delphi Study

Although a great deal has been written about the need for more research in the HPT field, specific research questions have not recently been identified. This study used a three‐round Delphi approach to identify research questions of interest to experts in the field, resulting in 100 questions that were classified under ten categories. Participants prioritized the research categories and rated each question as to its importance to the field. Summary statistics for all categories and questions are presented.     

Changing Roles and Professional Challenges for Human Performance Technology

From its roots in behavioral science and instructional systems design, the field of human performance technology has broadened significantly during the past three decades in terms of its interventions and the backgrounds and skills areas of its practitioners. This development brings with it many questions as to the field's definition, theoretical underpinnings, and future developments in research and practice. A brief review of the history of HPT, a survey of some of its leaders, and a model of the roots and branches of the field are presented.     

To Each Their Own: Students Asking Questions Through Individualized Projects

Abstract

As mathematics educators we want our students to develop a natural curiosity that will lead them on the path toward solving problems in a changing world, in fields that perhaps do not even exist today. Here we present student projects, adaptable for several mid- and upper-level mathematics courses, that require students to formulate their own questions and to begin to develop the basic research skills needed to answer these questions. These projects, where each student is given an individualized object to study, allow students to take ownership over their own learning while introducing them to the joy and challenge of discovery and research. Each student is directed to use the concepts and techniques presented in class as a set of tools to guide the investigation of their object. We discuss our experiences–both positive and negative–with these inquiry-based projects.     

A Project-Based Approach to Statistics and Data Science

Abstract

In an increasingly data-driven world, facility with statistics is more important than ever for our students. At institutions without a statistician, it often falls to the mathematics faculty to teach statistics courses. This paper presents a model that a mathematician asked to teach statistics can follow. This model entails connecting with faculty from numerous departments on campus to develop a list of topics, building a repository of real-world datasets from these faculty, and creating projects where students interface with these datasets to write lab reports aimed at consumers of statistics in other disciplines. The end result is students who are well prepared for interdisciplinary research, who are accustomed to coping with the idiosyncrasies of real data, and who have sharpened their technical writing and speaking skills.     

Exposure of children to sexual content on the Internet in Croatia

ObjectiveTo determine the prevalence of children and youth exposure to sexual content and inappropriate sexual questions on the Internet; and to identify emotional and behavioral reactions of children after such exposures.MethodsSample of the study included 2,880 of children and youth aged 10–16 who identified themselves as Internet users. Participants were questioned using Questionnaire on Child Experiences in Internet Use.ResultsResults show that 27% of children were exposed to messages of sexual content, mostly containing images of human nudity and sexual activity. Study also shows that children have experienced inappropriate sexual questions on the Internet. Exposure to questions of intimate nature increased with their age with certain differences in exposure and disturbing emotional reactions related to gender and age.ConclusionResults obtained by this study show that about a quarter of children are at risk for exposure to sexual content on the Internet.Practical implicationsResearch results can be used as a starting point for further research in order to throw more light on children and youth exposure to sexual content on the Internet. Furthermore, results can be used in developing prevention strategies for high-risk behavior of children and youth using the Internet and in working with children, parents and teachers.     

Understanding Persistence of At-Risk Students in Higher Education Enrollment Management Using Multiple Linear Regression and Network Analysis

Abstract

This article presents research on persistence among at-risk students using network analysis following multiple linear regression (MLR). Data on a population of enrolled undergraduate students at an urban-serving university over several years (P?=?35,239) is tested using multiple linear regression. Variables interacting at different dimensions of the model are analyzed using IBM SPSS Neural Networks (2017) and Cytoscape (2018) to show network linkages. While variables may not be significant in MLR models where anomalies are ruled out, network analysis takes these anomalies into account and reveals complex layers of interactions between and among variables. Findings show that loans of any kind contribute to attrition while financial aid of any kind contributes to persistence and offsets attrition from loans.     

Paragogy and flipped assessment: experience of designing and running a MOOC on research methods

Abstract

This study draws on the authors’ first-hand experience of designing, developing and delivering (3Ds) a massive open online course (MOOC) entitled ‘Understanding Research Methods’ since 2014, largely but not exclusively for learners in the humanities and social sciences. The greatest challenge facing us was to design an assessment mechanism that was (i) rigorous yet practicable at scale, vis-à-vis over 60,000 students from highly diverse backgrounds; (ii) compatible with the pedagogical orientation of the MOOC provider; and (iii) meaningful to the nature of the course subject. Based on a network analysis of forum interactions and a qualitative analysis of a random sample of 116 research questions proposed by students, we explore how participants’ understanding of research methods developed through a series of carefully sequenced ‘e-tivities’ and ‘open peer assessments’ over the duration of the course. The aim of this study was to consider a model of ‘flipped’ assessment, drawn from elements of ‘paragogy’ and the IR Model that acknowledges and exploits peer learning opportunities that are not routinely captured by completion statistics.     

Questions of chemistry

The research reported here derives from the general field of learner-centred teaching and learning, with specific reference to undergraduate chemistry. It documents the use of student-generated questions as diagnostic of their willingness to engage in classroom interactions. It explores four ways of gathering students' written questions and their relative effectiveness. It examines students' capacity to design and present 'quality questions' during phases of their learning and the extent to which these questions are indicative of particular styles of interaction in the classroom, both with tutors and with other students. The results are drawn from data collected through written questions posted into a question box, the 'hits' recorded on a computer software system, and through one-to-one interviews with a sample of 32 students. The results provide an opportunity to discuss the quality of interactions within fairly formalized systems of teaching and learning of chemistry in a university setting and to suggest further research required in this field.     

Playable Case Studies: A New Educational Genre for Technical Writing Instruction

ABSTRACT

A Playable Case Study (PCS) is a hybrid learning experience where students (1) participate in a fictional narrative that unfolds through an immersive, simulated environment and (2) engage in classroom activities and lessons that provide educational scaffolding and promote metacognition through in-game and out-of-game experiences. We present the Microcore PCS to illustrate the potential of this new type of experiential simulation that incorporates aspects of Alternate Reality Games (ARGs) to increase immersion and teach workplace literacies in the technical communication classroom. We explore results from a pilot test of Microcore with an undergraduate technical communication course, identifying design strategies that worked well and others that led to improvements that are currently being incorporated. We also provide questions to prompt future research of playable case studies and discuss our findings in a broader context of technical communication pedagogy.     

The meaning of student inquiry questions: A teacher's beliefs and responses

This research explores an American high school chemistry teacher's perspective on the meaning of student questions that originate from curiosity and engagement with subject matter. Ethnographic analysis of a teacher's reflective processes and decision-making approach suggests that questions hold contradictory meanings as powerful, conflicting pressures come to play in the everyday patterns of classroom discourse. Although thoughtful intellectual questions are valued as indicators of student attitudes and understandings, they nonetheless create an interruption to the normal flow of things. To the teacher, such interruptions pose threats to his control of classroom events and his ability to cover the content of his course. Although science educators might enthusiastically endorse the idea that classrooms should be characterized by a spirit of inquiry in which student questions are encouraged and respected, findings suggest that it can be difficult for this to happen in actual schools where particular teachers face specific institutional curricular pressures.     

Operant Conditioning in the Classroom Setting: A Review of the Research

Abstract

The purposes of this review were (a) to summarize the research following an applied behavioral analysis which has relevance for public school classrooms and (b) to discuss the problems and important considerations involved in an applied behavioral analysis of classroom behavior. Studies in this area are grouped into the following categories according to the nature of the reinforcement employed and assessed: (a) teacher attention, (b) peer attention, (c) token reinforcement, and (d) vicarious reinforcement. The problems of obtaining teacher cooperation, valid and reliable measurements, and confirmation of stimulus control through design of the experiment were discussed. Finally, the implications of these studies for classroom behavior control, as well as for future research, were explored     

Evaluating Model Fit With Ordered Categorical Data Within a Measurement Invariance Framework: A Comparison of Estimators

A paucity of research has compared estimation methods within a measurement invariance (MI) framework and determined if research conclusions using normal-theory maximum likelihood (ML) generalizes to the robust ML (MLR) and weighted least squares means and variance adjusted (WLSMV) estimators. Using ordered categorical data, this simulation study aimed to address these queries by investigating 342 conditions. When testing for metric and scalar invariance, Δχ² results revealed that Type I error rates varied across estimators (ML, MLR, and WLSMV) with symmetric and asymmetric data. The Δχ² power varied substantially based on the estimator selected, type of noninvariant indicator, number of noninvariant indicators, and sample size. Although some the changes in approximate fit indexes (ΔAFI) are relatively sample size independent, researchers who use the ΔAFI with WLSMV should use caution, as these statistics do not perform well with misspecified models. As a supplemental analysis, our results evaluate and suggest cutoff values based on previous research.     

Ethical issues of behavior modification research in schools

Behavior modification research in the classroom was examined by the National Commission for the Protection of Human Subjects because of the increasingly widespread use of behavioral procedures in the schools, the effectiveness of these procedures in changing academic and social behavior, and the consequent concern about potential misuse. In order to foster the responsible use of behavior modification procedures in the schools on a practical as well as a research basis, the following ethical issues being considered by researchers and the involved public are discussed: informed consent, determination of classroom goals, legitimacy of rewards and aversive controls in the classroom, conceptions of behavior modification as manipulative and mechanistic, who can implement the procedures, research design, and accountability. The authors conclude that the issues regarding protection of human subjects in behavior modification research are no different from other treatment-oriented research with children. However, the high degree of parental and teacher involvement in both research and practice requires shared responsibility for the prevention of misuse of behavior modification procedures.     

The Improvement of Mothers’ and Children’s Emotional and Behavioral Reactions through the Modification of Attentional Bias in Mothers: A Micro-Trial Study

Objective. The aim of this study was to test whether and to what extent inducing attentional bias in mothers toward a child’s positive emotions using a micro-trial method would improve mothers’ emotional and behavioral reactions in parenting-related situations. Effects on children were also assessed. Design. Forty-two mothers of 4- to 5-year-old children participated. Half of the mothers were exposed to an attention bias modification task designed to elicit a transient bias toward positive stimuli. After the manipulation, they were observed during a free-play session and frustration laboratory tasks designed to elicit positive and negative emotions. Results. Mothers exposed to the attention bias modification task displayed more positive emotional and behavioral reactions toward their child during both free-play and frustration tasks. Their children also behaved better, especially during the free-play session. The influence of mothers’ attention allocation on children’s outcomes was mediated by mothers’ behavior. Conclusions. An attention bias modification program is useful in improving interactions between mothers and children.     

Using Multilevel Modeling in Large-Scale Planned Variation Educational Experiments: Improving Understanding of Intervention Effects

The author shows how one can combine a large-scale planned variation experimental design and multilevel analysis to address research questions that go beyond the issue of overall treatment effectiveness. In particular, the design and analysis approach presented here can address the following research questions: how an educational intervention produces its results, for whom the intervention works, and whether the intervention works well across different contexts. The author used data based on a large-scale educational field experiment to describe multilevel models that one can use to address this set of research questions. Important design and analysis considerations are highlighted, especially with regard to assessing the impact of school-level characteristics.     

An evaluation of conjoint behavioral consultation as a model for supporting students with emotional and behavioral difficulties in mainstream classrooms

Abstract

Conjoint behavioral consultation (CBC) is an indirect form KEYW ORDS of service delivery in which parents and teachers collaborate to meet the academic, social, and behavioral needs of children. The purpose of this study was to evaluate CBC as a method of providing behavioral support for two students with emotional and behavioral difficulties (EBD) in mainstream classrooms. A nonconcurrent multiple baseline across participants' design and a follow-up phase were employed to assess an evidence-based intervention (self-management) delivered in the context of the CBC model. Results indicated a significant increase in teacher ratings of behavioral control from baseline to treatment. Positive treatment effects were maintained at a 4 week follow-up. Norm referenced measures produced statistically significant and clinically meaningful changes in teachers' perceptions of disruptive behavior following treatment. Parents and teachers indicated satisfaction with consultation services and viewed CBC as acceptable and effective. The findings are discussed in relation to the limitations of the study, and to future research directions and implications for practice.     

Design Issues in the Use of Robots as Cognitive Enhancement Aids

Abstract

Robotic manipulators are being used in an investigation of their potential as effective classroom learning aids when used by severely orthopaedically disabled children to manipulate educational materials and to play games. During the course of the design and development of a prototype robotic system for educational use, several issues have surfaced that constitute serious considerations in the process. Of particular importance are issues involving accessibility, software design, curriculum integration and specific research questions involving spatial visualisation. Performance data from previous investigations has shown that learning to use robots can be easily accomplished, and that the consequent learning is remarkably resistant to decay over time.     

Effects of response options on the mathematics performance of secondary students with emotional or behavioral disorders

ABSTRACT

This study examined the effects of three response options (traditional responding, response cards, and response systems) on the mathematics performance, participation, and time on-task of secondary students with emotional or behavioral disorders (EBD). A three-way crossover design was utilized to evaluate the efficacy of response options in secondary mathematics classrooms. Thirty-three students with EBD attending an urban high school and their teachers served as participants. Results indicated that the use of response cards (white boards) or response systems (ActivResponders) significantly increased students’ mathematics performance, participation, and time on-task when compared to traditional responding. Further, the use of response cards resulted in significant increases in performance and response accuracy over the increases found when using response systems. Social validity data indicated that students and teachers felt they benefited from the use of response cards and systems. Limitations, discussions, and implications for practice and future research are presented.