Use of Writing Samples on Standardized Tests: Susceptibility to Rule-Based Coaching and the Resulting Effects on Score Improvement

Despite the growing use of writing assessments in standardized tests, little is known about coaching effects on writing assessments. Therefore, this study tested the effects of short-term coaching on standardized writing tests, and the transfer of those effects to other writing genres. College freshmen were randomly assigned to either training (receiving nine hours of rule-based coaching) or a control group. Both groups completed pretest essays on the first day, and posttest and transfer essays (writing in a different genre) on the last day of the experiment. Group membership (training versus control) and an interaction between pretest scores and group membership were significant predictors of posttest scores after controlling for pretest performance. Training also produced higher transfer task scores after controlling for pretest and ACT scores. Implications are discussed.     

Retrieval Cues On Tests: A Strategy for Helping Students Overcome Retrieval Failure

Students often struggle to recall information on tests, frequently claiming to experience a “retrieval failure” of learned information. Thus, the retrieval of information from memory may be a roadblock to student success. I propose a relatively simple adjustment to the wording of test items to help eliminate this potential barrier. Specifically, I examined whether embedding salient information from class lectures in test items as retrieval cues enhanced student performance on tests. In two studies, including both an upper- and lower-division course, student performance on identical test items with and without retrievals was compared. Student performance varied significantly depending on whether retrieval cues were embedded in the items, and in both courses the difference was at least a half letter grade (study 2) or more (study 1). These results suggest that the selective use of retrieval cues on tests may be an effective strategy for helping students overcome retrieval failure on tests.     

The Validity of Value-added Estimates from Low-Stakes Testing Contexts: The Impact of Change in Test-Taking Motivation and Test Consequences

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence conditions: (a) an aggregate of test scores is used solely for institutional effectiveness purposes, (b) personal test score is reported to the student, or (c) personal test score is reported to faculty. Value-added estimates, operationalized as change in performance between two testing occasions for the same individuals where educational programming was experienced between testing occasions, were examined across conditions, in addition to the effects of test-taking motivation. Test consequences did not impact value-added estimates. Change in test-taking motivation, however, had a substantial effect on value-added estimates. In short, value-added estimates were attenuated due to decreased motivation from pretest to posttest.     

“Screening” or “Meritocracy”: Does the Choice of a Private School Help Students Achieve Higher Academic Performance? —Based on the PISA 2018 Analysis of Four Provinces and Municipalities in China

The introduced policy of “synchronized enrollment of public and private schools” has once again triggered the debate on the effectiveness of public and private schools. Based on the data of the Program for International Student Assessment (PISA) 2018 from four Chinese provinces and municipalities, this paper explores whether private schools gain a relative advantage in student academic performance through student “screening” or academic “meritocracy,” through a hierarchical linear model (HLM) and an empirical test of the propensity score matching (PSM). It has been found that the academic performance of students in private schools is significantly better than that in public schools. But with background, metacognitive ability, and learning hours of students in private schools controlled for, such academic performance is not significantly superior, suggesting that private schools rely heavily on student “screening” to achieve a relative advantage in student academic performance. This finding has also verified the scientific nature of the above policy.     

The use of questions within in-the-moment coaching in initial mathematics teacher education: enhancing participation,reflection, and co-construction in rehearsals of practice

Managing mathematical discussion is known to be challenging for novice teachers. Coaching within student teacher rehearsals of teaching has been shown to develop mathematics teaching practice, but can be time consuming. To examine how coaching using questions could assist novice teachers to promote mathematical thinking and discussions within time-constrained programmes, videos of rehearsals, reflective debriefs, and student teacher surveys were collected across a range of courses over 4 years. Findings included that student teacher roles in rehearsals were enhanced through coaching with questions and co-construction was enabled. Coaching questions exposed effective practice, particularly in relation to orchestrating mathematical discussion, enabling student teachers to reflect, discuss, make decisions, and immediately trial teaching strategies. Questions appeared to lengthen rehearsals but improved their effectiveness through enhancing participation and enabling co-construction of meaning. Findings indicate that questions used in coaching of rehearsals inform and empower novice teachers, essential factors within initial teacher education for equitable and ambitious mathematics teaching.     

Does teaching to the test improve student learning?

A central concern surrounding test-based accountability is that teachers may narrow teaching practices to improve test performance on a curriculum-based specific knowledge test rather than student learning more broadly. Two of the most common teaching practices that “teach to the test” are providing test-specific classwork and increasing the frequency with which students take practice tests. Whether such teaching practices improve student learning—both in terms of learning the content associated with a specific knowledge test as well as more general learning—is a largely unanswered question. To approach this question, this paper uses a student fixed effects approach to analyze the impact of these kinds of narrow teaching practices on student performance on a specific test as well as a general knowledge test. We find that test-specific classwork and practice tests with specific test items tend to have little or negative impacts on curriculum specific or general knowledge test performance, except for male students, and that subject practice tests (without emphasizing test-specific items) have positive effects on student outcomes on both kinds of tests, but larger on the curriculum-specific than on the general test, and much larger on the curriculum-specific test for male students. We discuss the logic for these results and what they tell us about the effectiveness of test-focused teaching practices more generally.     

Uncomfortable encounters between elite and “shadow education” in India—Indian Institutes of Technology and the Joint Entrance Examination coaching industry

India’s elite sector of engineering universities, Indian Institutes of Technology (IITs), are seen as safe gateways to a life in the politically hyped “new India” of the global knowledge economy. The Indian entrance exam coaching industry each year enrolls hundreds of thousands of students in classes strictly directed at “cracking” the institutes’ famous Joint Entrance Examination (JEE). Vast majorities of students at IITs are by now former coaching students, and coaching is increasingly supplanting performance in secondary education as the perceived prerequisite for IIT admission. This poses serious questions about the ability of the institutions to autonomously steer student selection and recruit the select exceptional students whom until now have kept “IITians” in the center of imaginaries of India’s future. This article explores the case of residential pre-entrance exam coaching to assess the coaching sector’s role in shaping India’s future technological leaders. It assesses the educational structure of the sector, its effect on student lives, the life aspirations it relies on, and how it is shaping IIT education itself. The case of entrance exam coaching in India, it is argued, prompt a reassessment of the concept of “shadow education” in order to begin a more thorough research agenda focused on the educational production and policy consequences of this “shadow” industry as an integrated (even if unwanted) and co-constitutive part of the higher education sector.     

Mothers' Social Coaching, Mother-Child Relationship Style, and Children's Peer Competence: Is the Medium the Message?

Contributions of mothers' social coaching and responsive style to preschoolers' peer competence were evaluated in 2 studies. In Study 1, 43 mother-child dyads participated in 3 laboratory tasks; videotapes were coded for responsive interaction style in play, advice regarding videotaped peer dilemmas (coaching), and nonsocial teaching in a puzzle task. Coaching and style were largely independent and were correlated with measures of social competence. In Study 2 ( n = 62), coaching and style uniquely predicted teacher ratings, but only style predicted peer acceptance. To investigate whether coaching mediated the effects of style and/or whether style moderated the effects of coaching, the samples were combined. No evidence was found for mediation, but coaching was a more powerful predictor of lower levels of boys' aggression when the mother-child relationship was less responsive. Discussion focuses on models of socialization that stress the interplay of general style and specific socialization practices in promoting social competence.     

大学生职业生涯辅导中引入教练技术的可行性分析

教练技术是一种简洁有效的辅导工具,将它引入高校大学生职业生涯辅导中,通过采用"奇迹式发问""生命平衡轮""换框"等实用性工具,不仅可以有效地帮助学生解决很多认识问题,改善学习、工作和生活模式,激发潜能并促进内在素质的全面提升,而且还可以带动职业生涯教学方法的改革、教学质量的提升。因此,大学生职业生涯辅导中引入教练技术,对于构建新型高校毕业生就业服务体系具有积极意义。     

Teacher coaching in Kenya: Examining instructional support in public and nonformal schools

Instructional coaching has improved student outcomes in the United States, and may help to solve Kenya's literacy problems. Coaching is costly, however, and evidence is lacking regarding the most cost-efficient teacher-to-coach ratio. We used student literacy outcome data from more than 8000 students participating in the Kenya Primary Math and Reading Initiative—a randomized controlled trial of instructional interventions in public and nonformal schools—to fill this gap. Coaches in larger public zones made fewer visits per teacher, and teacher-coach ratio and student performance were negatively associated. Using causal methods, we concluded that lower ratios might improve nonformal school outcomes.     

The Impact of Time Spent Coaching for Teacher Efficacy on Student Achievement

Coaching for increased teacher efficacy (both instructional and self) has been an essential component to various educational reforms such as No Child Left Behind; Reading First projects and Early Reading First Projects. Those seeking to improve teacher performance leading to enhanced student outcomes on various state assessments have also incorporated coaching into the methodology. The purpose of this study was to look at the linkage between hours spent coaching teachers in the classroom for efficacy in content instruction and child achievements/outcomes. A significant correlation was seen in year one between the time coaches spent in the classroom and students’ alphabet recognition scores. The coaching model for year one was one that focused coaching for instructional efficacy in specific content and teaching methods and saw the coaches directly facilitate and support theory to practice. In year two and three, no significant correlation was found. Year two and three used a coaching model which was less specific in focus and increased time spent on site with teachers. The implications for coaching practice includes balancing time between four components to effective coaching; (1) instructing for specific content, (2) modeling techniques and instructional practices, (3) observing teacher practices and (4) consulting for reflection.     

Early Childhood Professional Development: Coaching and Coursework Effects on Indicators of Children’s School Readiness

Research Findings: Effects on children’s school readiness were evaluated for 2 interventions focused on improving teacher–student interactions (coursework, coaching) implemented sequentially across 2 years. Teachers from public prekindergarten programs in 10 locations were assigned randomly to treatment or control conditions in each year. Children’s language behavior was observed during the coaching year: Coaching and the course each had positive impacts on children’s multiword language behavior. Treatment impacts on directly assessed literacy, language, and self-regulation skills were evaluated within an intent-to-treat framework for children taught by the participating teachers in the coaching and postcoaching years. Children demonstrated higher levels of inhibitory control in direct assessments when their teacher had received coaching the prior year. Teachers who received both coursework and coaching reported in the postcoaching year that children in their classrooms demonstrated greater levels of behavioral control. Treatment effects did not differ as a consequence of child, classroom, or program characteristics, and there were no significant effects on directly assessed literacy or language skills. Practice or Policy: Results suggest modest benefits for children’s language behavior and self-regulation for intervention(s) that improve the quality of teacher–child interaction.     

Manager Coaching Skills: Development and Application

The concept of “manager as coach” is increasingly popular in the management literature as a mechanism for improving employee involvement and performance. This paper summarizes a study to evaluate the effectiveness of a “coaching skills” program for sales managers. The program began with a five–day coaching skills course and was followed by on–the–job activities that called for application of the coaching skills covered in the course. The study used telephone interviews with managers' subordinates to collect data regarding managers' coaching effectiveness prior to the program. Follow–up interviews were conducted three months later. The interviews focused on the eight coaching behaviors identified by Schelling (1991). Quantitative analyses showed statistically significant increases on the follow–up ratings on five of the eight coaching behaviors. Further analysis revealed that subordinates who had not worked with their supervisors long tended to give lower ratings. Additionally, those managers with fewer subordinates often received higher scores on the eight coaching behaviors.     

Beyond genetics in Mental Rotation Test performance: The power of effort attribution

This study compares the effects on Mental Rotation Test (MRT) performance of instructions that stress the importance of (a) personal effort, and (b) genetically driven ability. A total of 120 high-school students were assigned to three groups, and administered two sub-tests of the MRT. Between the first and second sub-tests, the groups received one of the following instructions: effort (“anyone can succeed in this task by putting in effort”), ability (“performance on the test depends on genetic determinants”), and neutral for control (“this is an important test used in many countries”). We predicted that effort but not ability instructions would affect performance. Results confirmed the prediction and showed that, after controlling for baseline performance, the effort group outperformed the ability and control groups, which did not differ from each other. Discussion focuses on the mechanisms implied in believing ability to be genetically determined or experientially driven.     

Using collaborative two‐stage examinations to address test anxiety in a large enrollment gateway course

Large enrollment foundational courses are perceived as “high stakes” because of their potential to act as barriers for progression to the next course or admittance to a program. The nature of gateway courses makes them ideal settings to explore the relationship between anxiety, pedagogical interventions, and student performance. Here, two‐stage collaborative examinations were implemented to improve test‐taking skills and address widespread test anxiety in an introductory human anatomy course. Test anxiety data were collected (using the Motivated Strategies for Learning Questionnaire) before the first examination and last examination. Most students experienced decreased test anxiety over the course of the semester; however, some students may have experienced performance limiting conditions due to test anxiety at the end of the semester based on academic ability in the course (in “C” students when compared to “A” students: P < 0.00006 and “B” students: P < 0.05), overall academic ability (in academically weaker students: P < 0.025), and demographic factors (in women: P < 0.025). The strongest performances on examinations were primarily observed in already academically strong students (mean individual performance: P < 0.000, mean group performance: P < 0.000). Furthermore, changes in test anxiety were not significantly associated with the group portion of the examinations. Patterns of changes in test anxiety over the course of the semester underscore a complex interaction between test anxiety, student background, and student performance. Results suggest that pathways for test anxiety in “high stakes” courses may be separate from the mechanisms responsible for the benefits of collaborative testing. Anat Sci Educ 10: 409–422. © 2017 American Association of Anatomists.     

Learning to Coach in Practice-Based Teacher Education: A Self-Study

In some forms of practice-based teacher education, one important task for the teacher educator is to undertake in-the-moment coaching during rehearsals of practice. However, being such a coach is a new role for many teacher educators and requires a different skill set to other forms of teacher educator practice. In addition, there is little literature to which teacher educators can turn when seeking to address the problem of enactment in this context. This article seeks to address this gap in the literature. It reports a self-study undertaken by one mathematics teacher educator as he learned to coach pre-service teachers on the fly, while in turn they learned to orchestrate whole-class mathematical discussions. It seeks to illustrate how the process of journaling can support the journey of discovery that is the development of new practice. Through consulting the literature and story-telling, a picture is painted of how the educator addressed early concerns such as “what is a coach supposed to do?” and “what should a coach pause a rehearsal to talk about?” and began to master coaching – work that was never routine, but rather situated, adaptive, and responsive. The stories draw from a personal journal of field notes and reflections from such events as student rehearsals, lesson conferences, team meetings, reading student work, and professional reading. Journal entries from 12 rehearsal cycles over four years were consulted.     

Kallinikos: A Dialogue Set in the 20th Century

This dialogue assumes that Socrates has reappeared in the 20th century (through a wrinkle in time) and is actively engaged in a discussion with two Greek graduate students in physical education. The coach, Kallinikos (whose name means “glorious victor” in Greek), sheds light on the views on our society toward sport and the importance of winning. Cassandra (named for a prophet in the Trojan War whose prophecies were ignored) is a physical education teacher who aids Socrates in his quest for understanding how the field of “gymnastics” has changed in the past 2,400 years. Within the dialogue, discussion centers around the similarities and differences between coaching as a profession and teaching physical education. Some of the issues encountered include a definition of physical education, the domains involved in coaching and teaching, outcomes of teaching and coaching, the value of sport in society, activity as a form of expression, and a definition of the physically educated student.     

Beyond the Rhetoric: A framework for evaluating improvements to the student experience

A framework is described to assist institutions in evaluating the extent to which activities described as “quality improvements” or “quality enhancements” are likely to directly improve the student experience. The framework classifies ways of improving the student experience into “coaching improvements”, “umpiring improvements”, and “facilities improvements”, while also considering the location of improvements along a “risk avoidance—quality assurance—quality enhancement” continuum. The utility of this framework is explored through case studies of sector‐wide initiatives in Scotland and Australia. If used to stimulate internal discussion, the framework can help institutions to better balance their efforts to improve the student experience.     

Factors,issues and interdependencies in the incorporation of a Web 2.0 based learning environment in higher education

This work investigates the effect a Web 2.0 learning environment may have in higher education in adding value to the students’ existing competencies. The major issues that this work examines are whether the incorporation of a Web 2.0 environment in higher education has an effect on the students’ performance and what are the significant factors that should be taken into account in the deployment of these technologies to achieve the maximum possible benefits and whether and how they correlate to each other. These factors are derived from the students’ views on the use of technology in a university course deployment and from the students’ personal opinions about a pilot course in a Web 2.0 learning environment. Although the results indicate no direct effect on the students’ performance, significant factors have been revealed via a thorough assessment, which has been performed in the context of a semester–long course, utilizing statistical process control techniques. The derived factors are namely: “Technology as an educational reinforcement”, “Technology as a tool to enhance comprehension” and “Enhancement of student interest and experience”, while in the second one “Completeness of the educational approach”, “Satisfaction from the educational approach” and “Course demands”. These factors can then form the basis for a feedback processes and a monitoring mechanism for a continuously updated educational process.