Bridging the Research-to-Practice Gap in School-Based Consultation: An Example Using Case Studies

Intervention integrity or adherence describes qualities of carrying out an intervention plan and in research is fundamentally linked to experimental validity questions addressed by measurement of independent and dependent variables. Integrity has been well described in conceptual writing but has been a continuing thorny subject in research and practice with some possibility of misunderstandings. In consultation practice, in contrast to research, adherence questions may be best viewed as a triage situation in that teams examine risks and costs of decisions and plan for sufficient intervention implementation checks accordingly. Furthermore, in consultation practice the measurement of intervention adherence is not necessarily needed for internal validity arguments if internal validity evidence is a key characteristic of prior research used in problem solving. However, adherence estimates remain critical for many aspects of decision making. As much thought and resources may be dedicated to the measurement of intervention adherence as are dedicated to the measurement of dependent variables or outcome measures for both consultation practice and research depending on the decision purpose.     

Understanding and Improving Classroom Emotional Climate and Behavior Management in the “Real World”: The Role of Head Start Teachers' Psychosocial Stressors

Research Findings: This article reports on two studies. Study 1 considered ways in which Head Start teachers' (n = 90) psychosocial stressors are related to teachers' ability to maintain a positive classroom emotional climate and effective behavior management in preschool classrooms. Study 2 tested the hypothesis that among teachers randomly assigned to a treatment condition (n = 48), psychosocial stressors serve as important predictors of their use of an intervention designed to improve classroom emotional climate and behavior management. Practice or Policy: Findings from Study 1 were mixed; notably, teachers' personal stressors were moderately predictive of lower use of effective strategies of behavior management in the classroom. Findings from Study 2 suggest that psychosocial stressors are not a barrier to teachers' use of intervention services. Contrary to our expectations, teachers reporting more stressors attended more training sessions than did teachers reporting fewer stressors. Teachers reporting higher levels of stress availed themselves of less support from mental health consultants during classroom consultation visits offered to treatment group classrooms as part of the intervention.     

Behavioral Consultation as a Process for Linking the Assessment and Treatment of Social Skills

There has been recent interest in social skills assessment and treatment among researchers and practitioners. The research bases in these areas are expanding rapidly, and the identification of valid assessment methods and effective intervention strategies is promising. However, few researchers have identified ways m which social skills assessment and intervention can be linked in a practical manner. Likewise, the process by which services are delivered is rarely addressed. The purpose of this article is to present a model by which the interaction between social skills assessment and intervention can be enhanced, with a focus on the problem-solving process. One effective and efficient manner of providing services to socially unskilled children is through an indirect model of service delivery; that of behavioral consultation. Behavioral consultation is a four-stage problem-solving model that involves the cooperative efforts of two or more persons to clarify a student's needs and develop and implement appropriate strategies for intervention. This article presents the objectives and procedures of each stage of behavioral consultation as a process to facilitate accurate problem identification and effective problem resolution, with the goal of linking social skills assessment directly to treatment.     

The Effects of Training and Performance Feedback During Behavioral Consultation on General Education Middle School Teachers' Integrity to Functional Analysis Procedures

Gickling's model of curriculum-based assessment (CBA) has been linked to problem identification and intervention development and is used in several school consultation approaches. This article uses Ellis's (2001) three levels of research criteria to examine the use of CBA in a school consultation model. Aside from the need for more psychometric data, available research has consistently supported the theoretical soundness and demonstrated the effectiveness of CBA. However, there is evidence that CBA lacks widespread and consistent implementation. Areas for future research and implications for practice are included.     

INCREASING TEACHER TREATMENT INTEGRITY THROUGH PERFORMANCE FEEDBACK PROVIDED BY SCHOOL PERSONNEL

When implementing behavioral interventions in educational settings, some implementers need support to maintain high levels of treatment integrity. Performance feedback has a large body of research supporting it as a strategy for improving teachers’ implementation of classroom interventions. However, in most prior studies, performance feedback has been delivered by a researcher, not by a school staff member, which limits generalizability of results to applied settings. In this study, school personnel (i.e., internal consultants) assessed teachers’ treatment integrity when implementing a classwide behavioral intervention and, when low, provided performance feedback. Further, researchers assessed internal consultants’ treatment integrity and provided performance feedback as needed. Results indicate that internal consultants are able to assess and briefly increase teachers’ treatment integrity with performance feedback, although some teachers needed more support than did others. Likewise, internal consultants’ treatment integrity was fairly high initially, but required consistent performance feedback to increase treatment integrity levels toward the end of the study. Implications for research and practice are discussed.     

Implementing a Multi-Tiered System of Support (MTSS): Collaboration Between School Psychologists and Administrators to Promote Systems-Level Change

Current educational reform mandates the implementation of school-based models for early identification and intervention, progress monitoring, and data-based assessment of student progress. This article provides an overview of interdisciplinary collaboration for systems-level consultation within a Multi-Tiered System of Support (MTSS) framework. The roles of school psychologists and school-based administrators are presented in relation to the implementation of MTSS practices within an implementation science model. The training and expertise of each discipline are highlighted related to respective aspects of implementation drivers (i.e., competency, organization, leadership). Functions of principals and school psychologists during team-based, problem-solving MTSS practices are described based on a problem-solving framework consistent with school-based consultation. Future directions for graduate training of school psychologists and principals and directions for consultation research are provided.     

Implementing Conjoint Behavioral Consultation for African American Children from a Low-SES,Urban Setting

This study investigated the effectiveness of conjoint behavioral consultation (CBC) for addressing externalizing behavior concerns in African American children at home and school in a low-socioeconomic status (SES), urban setting. A small-n, multiple-baseline design was employed across participants. Three of the six caregivers were unable to follow through with the consultation process, constituting a 50% completion rate. The three remaining caregivers implemented the empirically supported interventions with moderate integrity. Caregiver and teacher ratings showed that the procedural acceptability of CBC was high throughout the consultation process. The classroom teachers consistently found the behavioral interventions highly acceptable; however, the caregivers' perceptions of the interventions initially were less favorable and improved as the interventions progressed. Clinically significant gains were observed across settings for all children. Consultants should be prepared to modify consultation and intervention procedures to enhance social validity, integrity, and effectiveness with caregivers of low-SES.     

Implementation Planning to Promote Parents' Treatment Integrity of Behavioral Interventions for Children with Autism

Behavioral interventions delivered across home and school settings can promote positive outcomes for youth with autism spectrum disorders (ASD). Yet, stakeholders who deliver these interventions may struggle to implement interventions as intended. Low levels of treatment integrity can undermine potentially positive intervention outcomes. One way to promote implementers' treatment integrity is Implementation Planning, a logistical planning and barrier reduction strategy that is supported by emerging school-based research. The current study extended the research on Implementation Planning and evaluated the effectiveness of the strategy with parents implementing a behavioral intervention at home within a Conjoint Behavioral Consultation model. The behavioral intervention aimed to increase compliance and decrease aggression for two children with ASD at home. Initially, parents struggled to deliver the intervention consistently; however, after Implementation Planning, parents' treatment integrity increased and, subsequently, child outcomes improved. Implications for future research and consultation are presented.     

Integrating Models of Collaborative Consultation and Systems Change to Implement Forgiveness-Focused Bullying Interventions

Through collaborative consultation with school staff, school psychologists have increasingly helped schools add bullying prevention and intervention programming to their service delivery systems. As schools search for ways to lessen the impact of bullying on the social-emotional health and academic achievement of students, forgiveness education is an area that may offer another perspective to bullying prevention and intervention. In order to infuse forgiveness education into schools' current tiered-service delivery systems, school psychologists and their district partners can use the frameworks of collaborative strategic planning (CSP) and the concerns-based adoption model (CBAM) in tandem to guide the development and implementation of forgiveness-focused bullying interventions at the core, supplementary, and intensive levels of a multitiered system of service delivery.     

An Evaluation of the Treatment Integrity Planning Protocol and Two Schedules of Treatment Integrity Self-Report: Impact on Implementation and Report Accuracy

The evidence-based practice movement has focused on identifying, disseminating, and promoting the adoption of evidence-based interventions. Despite advances in this movement, numerous barriers, such as the lack of treatment integrity assessment methods, remain as challenges in implementation. Accurate teacher self-report could be an efficient treatment integrity assessment method. A multiple baseline across participants design was used to evaluate the effect of the (a) Treatment Integrity Planning Protocol on treatment integrity, (b) accuracy of teachers' self-report when collected daily or weekly, and (c) Good Behavior Game on students' behavior. Results indicate teachers demonstrated a relatively high level of treatment integrity across phases, teachers accurately reported their treatment integrity during daily reporting, and there was no relationship between treatment integrity and behavioral outcomes.     

Effects of Consultation on Professional Learning Communities

ABSTRACT

School psychologists can impact student outcomes by consulting with teams around data. The current study investigated the effects of consultation with Professional Learning Communities (PLC) teacher teams. The study included four teacher teams, observing their PLC practices and providing consultation. Each team was observed with a PLC-implementation rubric using a multiple baseline design, including baseline, intervention, and maintenance phases. The specific areas of observation on the PLC Implementation Rubric were “How Effective Teams Work,” “What Students Need to Know and Do,” and “Assessment for/of Learning.” The data were visually analyzed and a nonoverlap of all pairs effect size was computed. During the intervention phase, each team chose an item to focus on from the same observation strand. Therefore, the data were analyzed on the single strand and the three strands taken together. The results from the study indicated a change in PLC implementation occurred when consultation was added, and the change was maintained after consultation ended. However, the improvements for each team during the intervention and maintenance phases were small in comparison to the baseline phase. In addition, teams displayed greater improvements in implementation fidelity on the single strand in comparison to the three strands taken together. Future research is needed to determine the impact of consultation with PLCs on student outcomes. Implications for research and practice, limitations, and future directions are discussed.     

A SYSTEMATIC FRAMEWORK FOR ADDRESSING TREATMENT INTEGRITY IN SCHOOL SETTINGS

School psychologists are tasked with ensuring treatment integrity because the level of intervention implementation affects decisions about student progress. Treatment integrity includes multiple dimensions that may impact the effectiveness of an intervention including adherence, dosage, quality, and engagement. Unfortunately, treatment integrity is not routinely monitored in consultation. A systematic framework is needed to better prepare practitioners to assess, analyze, and intervene when there are treatment integrity failures. A framework for monitoring and improving multiple dimensions of treatment integrity in natural settings is proposed to provide guidance to practitioners through two phases. The first phase focuses on improving initial treatment integrity and the second phase outlines a problem‐solving process for improving treatment integrity.     

对心理咨询中价值干预问题的反思

文化哲学与心理咨询属于不同的领域,它们有不同的处理水平和研究方法。在东西方不同的文化视野中解决咨询的价值干预问题是非常有意义的,我们认为咨询中的价值干预是不合理的。另外,由于价值干预而带来的咨询技术问题同样显示价值干预不能满足咨询的目的—工具合理性的要求。     

School psychologists’ beliefs and practices about treatment integrity in 2008 and 2017

A random sample of 1,000 Nationally Certified School Psychologists were mailed a 17‐item survey about treatment integrity. A total of 132 responded and answered questions about the importance of treatment integrity data for tiered interventions and the frequency and methods used to measure treatment integrity in one‐to‐one and problem‐solving team consultation. Ninety‐eight percent agreed that treatment integrity data were critical for tiered interventions. However, only 7% in one‐to‐one consultation and 0% in team consultation reported it was “always” collected. Respondents identified barriers of time, workload, system factors, and staff knowledge as explanations for why there was a gap between belief and practice. The participant responses were compared to those from a 2008 survey and found to be almost unchanged. Issues associated with decision‐making when treatment integrity data are lacking and recommendations for improving the assessment and reporting of treatment integrity are discussed.     

Consultation With Culturally Diverse Families

The traditional role of the school psychologist has focused primarily on providing services to school-age children. However, the implementation of Public Law 99-457 has resulted in an increased need for psychologists who are knowledgeable about infants, toddlers, and preschoolers with disabilities and their families (Short, Simeonsson, &; Huntington, 1990). There is also an increased demand for school psychologists to provide consultation, intervention, and parent training services that are necessary components of early intervention programs.     

Lessons Learned From a Consultation Process Overseas

In this commentary I discuss three international school consultation experiences, highlighting aspects that serve as lessons for professional development and the implementation of effective and helpful strategies that meet the needs of children and youth in school systems. Relationships developed and maintained between the consulting teams and the consultees were oriented toward three intervention goals: psychoeducational services, well-being in adolescents, and instructional procedures. In general, the projects described in the three articles were successful and support the utility of international systems-level consultation as a means of helping improve the quality of outcomes in the school contexts in which they worked. I end my commentary by providing some general observations and questions to be considered when engaging in international school consultation.     

Treatment Fidelity Challenges in a Five-State Consultation Study

Consultation is a promising approach to creating change in early childhood programs, from innovations in instructional strategies to the enhancement of global program quality. Studies of consultation effectiveness have been hampered by limited reports of implementation fidelity related to consultation procedures. This article describes the challenges of supporting and measuring implementation fidelity in a 5-state study in which community consultants followed a collaborative consultation model to enhance global quality in childcare programs. The authors consider the limitations of using a randomized experimental design to study the effectiveness of consultation and share lessons learned in their efforts to enhance treatment fidelity without compromising the basic tenets of the model or the rigorous design.     

Cognitive Modeling: A Means for Achieving Prevention in School-Based Consultation

The shift in educational placement of children with disabilities into an integrated approach continues to gain momentum. One strategy for implementing this integrated partnership is the use of general education prereferral intervention techniques. This study specifically examined the longitudinal impact of collaborative consultation as a prereferral intervention on referral accuracy to special education. Several data collection forms were used to provide an accurate count of the number of children in the school populations who were referred for special education assessment and who were found to verify for special education services. Referral accuracy was determined by taking a ratio of the number of students assessed to the number of students verified. Results indicated a significant increase in referral accuracy when the collaborative consultation model was implemented as a prereferral strategy. Implications and suggestions for further research are offered.     

Global Consultation Processes: Lessons Learned from Refugee Teacher Consultation Research in Malaysia

ABSTRACT

The process of global consultation has received little attention despite its potential for promoting international mutual understanding with marginalized communities. This article details theory, entry, implementation, and evaluation processes for global consultation research, including lessons learned from our refugee teacher intervention. The first half of the article addresses the entry process, culture-specific strengths, and challenges that can be faced in global consultation, including our experience with a lack of formal regulatory oversight of refugee education. The second half of the article details feedback collected from consultants, peer trainers, and peer trainees indicating which training content was most valuable; how some Burmese refugee teachers strive for a more student-centered, “free” classroom for their refugee students; and, finally, the toll that intense refugee teacher consultation took on the consultants.     

Dynamic Consultation: Towards process and challenge

This paper outlines the attempts of a group of educational psychologists to apply the theoretical principles underpinning dynamic assessment to the process of solution-focused consultation with teachers at the school-based stages of the Special Educational Needs Code of Practice. Process questions based on dynamic assessment are used within a semi-structured consultative framework in order to challenge thinking, to explore meanings, to mediate learning and to plan interventions. It is suggested that the principles of dynamic assessment lend themselves well to the consultation process, providing a model for effective and reflective practice for educational psychologists and teachers, and non-intrusive intervention with pupils.