Using stakeholder feedback to improve online professional development opportunities

Abstract

Traditional professional development is often characterized as being expensive, time consuming, and lacking impact. In contrast, online professional development provides greater flexibility and is becoming increasingly popular for school personnel. In this article, we report the process and outcomes of gathering feedback to adapt traditional in-person to online training differentiated for the participants to maximize utility, efficiency, and effectiveness in meeting the needs of key stakeholders. Focus groups were conducted with teachers, administrators, and other specialists to gather feedback on content as well as how online learning modules (OLMs) could be tailored to meet specific school site and team needs. We discuss our findings in the context of continuing efforts to improve general and specific professional development opportunities.     

Toward a better understanding of student perceptions of writing feedback: a mixed methods study

This explanatory sequential mixed methods study investigated the writing feedback perceptions of middle and high school students (N = 598). The predictive and mediational roles of writing self-efficacy and perceptions of writing feedback on student writing self-regulation aptitude were examined using mediation regression analysis. To augment the quantitative findings, the explanations students provided for either liking or disliking writing feedback were explored using open-ended questions. Quantitative findings revealed that students’ perceptions of the feedback they receive about their writing partially mediated the relationship between writing self-efficacy and writing self-regulation aptitude. Qualitative data suggested ways in which students perceive writing feedback—both positive and negative. Collectively, the quantitative and qualitative data illustrate the influential role writing feedback perceptions plays in middle and high school student writing motivation and self-regulation beliefs.     

Using Sociocultural Theory to Understand the Relationship between Teacher Change and a Science-based Professional Education Program

This paper focuses on a model of teacher change based on a study of a science discipline-based professional education program and on an understanding of teacher change in terms of an agency| structure dialectic. Professional education programs should expand teachers' capacity to act in a range of fields. Conducted over one year, this study used socio-cultural theory to examine the role of cultural schema and resources in the enactment of new pedagogical structures by two teachers who demonstrated widely variable responses to their experience of a professional chemistry education program. Hermeneutic and phenomenological methods of study supported the examination of teacher actions and narratives as sources of data. The analyses of these data sources resulted in greater understanding of the relationship between schema, resources and structure and the relationship between structure and teacher agency. Structures are dynamic and if a teacher uses a resource such as an inquiry-based instruction protocol without the attendant cultural schema such as the value of questioning then the structure that is implemented will be different from that the teacher experienced in the professional education program. This understanding supported an explanation of teacher change in terms of teacher agency that constituted our learning from the study and resulted in changes to aspects of the professional education program.     

The overall effects of end-of-course assessment on student performance: A comparison between multiple choice testing, peer assessment, case-based assessment and portfolio assessment

This study investigates the effect of method of assessment on student performance. Five research conditions go together with one of four assessment modes, namely: portfolio, case-based, peer assessment, and multiple choice evaluation. Data collection is done by means of a pre-test/ post-test-design with the help of two standardised tests (N=816). Results show that assessment method does make a difference: assessments do not produce overall effects on student performance. Moreover, student-activating instruction efforts do not automatically result in more extensive learning gains. Finally, test results show, when compared to other assessments, a statistically significant positive effect of the multiple choice test on students' test scores. However, students' preparation level and the closed book format of the tests might serve explanatory purposes.     

Mental toughness and transitions to high school and to undergraduate study

Mental toughness can be conceptualised as a set of attributes that allow people to deal effectively with challenges, stressors and pressure. Recent work has suggested that it may be a valuable construct to consider within educational settings. The current studies explored the associations between mental toughness and educational transitions. Study 1 examined the relationships between mental toughness and concerns about moving to a new school in 105 children aged 12–13 years of age. The results revealed significant relationships between several aspects of mental toughness, but particularly confidence in abilities, and children’s concerns. Study 2 examined the relationships between mental toughness and adjustment to university in 200 undergraduate students at various stages of their course. The results revealed a role for several aspects of mental toughness; commitment, control of life, control of emotion, confidence in abilities and interpersonal confidence. The results are discussed in terms of implications for educational practice. It is suggested that measures of mental toughness could be used to identify individuals who may benefit from additional support during transition to a new school or to university, and that future research should explore the potential benefits of mental toughness training.     

Personalized learning in iSTART: Past modifications and future design

Abstract

Computer-based learning environments (CBLEs) provide unprecedented opportunities for personalized learning at scale. One such system, iSTART (Interactive Strategy Training for Active Reading and Thinking) is an adaptive, game-based tutoring system for reading comprehension. This paper describes how efforts to increase personalized learning have improved the system. It also provides results of a recent implementation of an adaptive logic that increases or decreases text difficulty based on students’ performance rather than presenting texts randomly. High school students who received adaptive text selection showed increased sense of learning. Adaptive text selection also resulted in greater pre-training to post-training comprehension test gains, especially for less-skilled readers. The findings demonstrate that system-driven, just-in-time support consistent with the goals of personalized learning benefit the efficacy of computer-based learning environments.     

Factors affecting journal submission numbers: Impact factor and peer review reputation

Previous research has found that researchers rank journal reputation and impact factor (IF) amongst the key selection criteria when choosing where to submit. We explored the actual effect upon submission numbers of several possible factors. We retrieved 10 years of submission data from over a thousand journals, as well as data on IF, retractions, and other factors. We performed statistical analysis and identified correlations. We also undertook case study research on the 55 most significant submission decreases. We found a statistically significant correlation between changes in IF, ISI percentage ranking, and changes in submissions numbers in subsequent years. We also found a statistically significant effect on submission numbers in the year following the publication of a retraction. Our case studies identified other factors, including negative feedback on the peer review process. Our findings regarding IF confirm previous indications about the significance of IF on submissions. We explain the correlation with retractions through the concept of ‘peer review reputation’. These results indicate that editors and publishers need to focus on a journal's peer review practices, as well as a journal's IF, if they are to maintain and grow submissions.