Formative observation of teaching: focusing peer assistance on teachers’ developmental goals

Peer observation of teaching can provide valuable insights into effective educational practices. By adopting a developmental focus, peer observation can also provide insights into how practices might be enhanced and, importantly, how enhancements in practices might be aligned to teachers’ development goals. However, a review of peer observation of teaching undertaken at Australian universities demonstrates that observation instruments and protocols typically do not explicitly afford alignment of peers’ observations with teachers’ developmental goals. Analysis of observers’ uses of popular peer observation instruments through the deployment of the Peer Assisted Teaching Scheme through multiple institutions across Australia has informed the development and trial of a novel observation instrument and protocol design that is aligned with observer use characteristics, and provides a focus on development goals. This study will be of interest to teachers and academic developers researching and implementing goal-oriented curricular and pedagogical development through peer observation.     

Small data,online learning and assessment practices in higher education: a case study of failure?

In this paper, we present an in-depth case study of a single student who failed an online module which formed part of a master’s programme in Professional Education and Leadership. We use this case study to examine assessment practices in higher education in the online environment. In taking this approach, we go against the current predilection for Big Data which has given rise to ‘learning analytics’, a data-intensive approach to monitoring learning. In particular, we draw attention to the model of the learner produced by learning analytics and to issues of ‘dataveillance’ in online learning. We also use the case to examine assessment in higher education more broadly, exploring the tensions between the requirements for certification and the need for learning. We conclude that assessment practices in higher education may have more to do with ‘quality assurance’ and regulatory frameworks than with ‘enhancing the student experience’ and inculcating the qualities that mark out higher education as an ethical project.     

Academics’ perceptions of the impact of internal quality assurance on teaching and learning

Internal quality assurance systems are expected to improve the institutions’ core mission of teaching and learning. Using data gathered through an online survey, distributed in 2014/2015, to the teaching staff of all Portuguese private and public higher education institutions, this paper examines the impact of internal quality assurance systems on teaching and learning from the perspective of academics. Findings suggest that Portuguese academics feel that, despite the positive contribution of internal quality assurance towards an increased awareness of teaching quality issues at their institutions, the practical effects of these systems have been more related to increasing bureaucracy than to substantive improvements in teaching and learning. The use of information with a view to improvement and teaching staff involvement in the development of quality assurance were found to induce positive changes in teaching and learning, in academics’ perceptions. Based on the findings, the paper makes recommendations for institutional practice.     

University-level teaching of Anthropogenic Global Climate Change (AGCC) via student inquiry

This paper reviews university-level efforts to improve understanding of anthropogenic global climate change (AGCC) through curricula that enable student scientific inquiry. We examined 152 refereed publications and proceedings from academic conferences and selected 26 cases of inquiry learning that overcome specific challenges to AGCC teaching. This review identifies both the strengths and weaknesses of each of these case studies. It is the first to go beyond examining the impact of specific inquiry instructional approaches to offer a synthesis of cases. We find that inquiry teaching can succeed by concretising scientific processes, providing access to global data and evidence, imparting critical and higher order thinking about AGCC science/policy and contextualising learning with places and scientific facts. We recommend educational researchers and scientists collaborate to create and refine curricula that utilise geospatial technologies, climate models and communication technologies to bring students into contact with scientists, climate data and authentic AGCC research processes. Many available science education technologies and curricula also require further research to maximise trade-offs between implementation and training costs and their educational value.     

Academics’ and employers’ perceptions about responsibilities for employability and their initiatives towards its development

This paper reports the results of preliminary research into how Portuguese academics and employers perceive the responsibility of different higher education stakeholders—students, teaching staff, higher education institutions, employers, and policy-makers—for developing graduate employability. The study was conducted 8 years after the implementation of the Bologna Process, the reform that placed employability firmly on the agenda of higher education institutions (HEIs) in Portugal. This paper aims to assess the extent to which higher education is held responsible for developing employability, and to characterize the activities undertaken by the two actors to achieve that end. In particular, with respect to academics, we characterize curricular and other changes to study programmes, and, with respect to employers, their participation in activities undertaken by HEIs meant to ease the transition of students to the labour market. The data comes from a survey responded to by 684 Portuguese academics and 64 employers. Academics and employers alike were found to attribute high responsibility for developing employability to higher education, suggesting that the political message of the Bologna Process regarding the relation between higher education and the labour market has been assimilated. However, the activities reported by both types of respondents indicate only an average commitment to developing employability. Here, the low participation of employers in internal institutional activities is noteworthy, suggesting that the recognition of employers as stakeholders in higher education, as advocated by policy-makers, has yet to happen in Portugal.     

Teacher evaluation in Illinois: school leaders’ perceptions and practices

The aim of the current study is to assess school leaders’ perceptions and practices in the context of a new policy that emphasizes teacher evaluation. The study draws from survey data of 606 K-12 school leaders in the USA in a state implementing a new teacher evaluation model under Race to the Top. Findings illustrate that school leaders spent significant time on teacher evaluation. Some felt this was a good investment of time (e.g., rich conversations with teachers), increasing the ability for evaluations to improve instruction. Most, however, perceived the time demands as a cost (e.g., spending longer hours on the job, delegating more tasks to others). School leaders felt very confident in their ability to conduct observations and provide feedback to teachers. The opposite was found for student achievement data. Administrators’ reported preparedness, confidence, and beliefs suggest that barriers exist to using student achievement data to evaluate teachers. Findings suggest that school leaders need resources to build capacity, particularly in accommodating the new time demands of teacher evaluation. Administrators could benefit from professional development that addresses the use and value of student achievement if this measure continues to be a substantial component in teacher evaluation models.     

Prevention: Necessary But Insufficient? A 2-Year Follow-Up of an Effective First-Grade Mathematics Intervention

We present first-grade, second-grade, and third-grade impacts for a first-grade intervention targeting the conceptual and procedural bases that support arithmetic. At-risk students (average age at pretest = 6.5) were randomly assigned to three conditions: a control group (n = 224) and two variants of the intervention (same conceptual instruction but different forms of practice: speeded [n = 211] vs. nonspeeded [n = 204]). Impacts on all first-grade content outcomes were significant and positive, but no follow-up impacts were significant. Many intervention children achieved average mathematics achievement at the end of third grade, and prior math and reading assessment performance predicted which students will require sustained intervention. Finally, projecting impacts 2 years later based on nonexperimental estimates of effects of first-grade math skills overestimates long-term intervention effects.     

Performance Modeling That Integrates Latent Trait and Class Theory

The qualitative characterization of individual performance that is central to modem psychological theory is not adequately modeled by traditional psychometric theory that assumes, among other things, unidimensionality. In the present study, data are presented that are more adequately modeled by HYBRID, a model that incorporates both latent trait and latent class components. The latent classes were defined by a cognitive analysis of the understanding that individuals have for a circumscribed domain. In addition to providing a better statistical fit, the analysis also improves the amount of diagnostic information available for a given individual.     

Making Meaningful Choices: an investigation into young children's intonation patterns in storytelling

Abstract This paper investigates the meaningful choices in intonation made by young children. A category system for classifying choices is outlined and an experiment is reported in which randomly selected groups of 41/2‐5 year‐olds heard and retold stories in different situations. Results indicate that all groups distinguished narrative from other forms of discourse and drew upon intonation resources appropriately. Differences were found between recalling a story with pictures and one without, suggesting that these are different cognitive tasks and that children make different selections from choices available to them.