A person-centred approach to understanding cultures of assessment

The purpose of the present study was to investigate how faculty members coalesce into distinguishable groups in terms of their perceived cultures of assessment at their respective institutions. To date, although researchers have posited the existence of various cultures of assessment, no study to our knowledge has empirically demonstrated the presence of these unobserved (latent) cultures analytically. Accordingly, a latent profile analysis was conducted using Mplus to identify these unobserved groups based on faculty (n = 1148) members’ responses to 12 items (6-point Likert scale) selected from the 2014 Faculty Survey of Assessment Culture. The resulting 4-class solution, including a previously unidentified group, was confirmed by the Lo-Mendell-Rubin Adjusted Likelihood Ratio Test: Culture of Student Learning (n = 502); Evolving Student Learning Culture (n = 398); Culture of Compliance (n = 168); and Culture of Fear (n = 80). Characteristics of each class are described and the prevalence of each class by type of degree granting institution and primary discipline is provided.     

Threats to the inclusive movement

Anthony Feiler, senior lecturer in special needs, and Howard Gibson, senior lecturer in language and literature (both at Bath Spa University College),suggest that within the field of special educational needs the movement towards inclusion is endangered. Four key threats are explored: the lack of precisionin definitions of inclusion; the lack of research evidence; the tendency for some children to experience what is termed 'internal exclusion' inschools; and the continuing inclination to label children (as an example of labelling the media's presentation of the term dyslexia is examined). Theauthors argue that if inclusion is to take hold in schools more attention needs to be paid to these threats.     

Sources of Inequity: understanding students' responses to assessment

This article considers some of the implications for assessment practice of current views about the nature of learning, and achievement. Evidence from national surveys is presented that demonstrates some of the different ways, ‘tasks' and responses to them are understood by assessors and students. This is followed by a review of evidence about differential sub‐group performance which is then examined to identify potential sources of inequity in assessment practice.     

Unveiling professional learning: Shifting from the delivery of courses to an understanding of the processes

This exploratory study is an attempt to shed light on the internal dynamics of secondary teachers’ and academics’ professional learning, its context and its occasions, in a course of a university-provided in-service professional development programme in Greece, using the experiences and perceptions of its participants. In investigating the above, the study harnesses a qualitative methodology and a research framework that draws upon a set of ideas that cohere under the rubric programme development, in order to generate a heuristic that guides research techniques and analysis procedures. The investigation reveals professional learning to be characterised by a number of dimensions: professionality, mutuality, emotionality and formality. Professional learning is therefore seen as a complex process rather than linear, a step-by-step event. The article concludes by emphasising a shift from the delivery of the in-service courses to an understanding of the complexity of the processes by which professional learning is developed.     

Threats to the Valid Use of Assessments

Validity is the most important quality of an assessment, but its evaluation is often neglected. The step‐by‐step approach suggested here provides structured guidance to validators of educational assessments. Assessment is depicted as a chain of eight linked stages: administration, scoring, aggregation, generalization, extrapolation, evaluation, decision and impact. Evaluating validity requires careful consideration of threats to validity associated with each link. Several threats are described and exemplified for each link. These sets of threats are intended to be illustrative rather than comprehensive. The chain model suggests that validity is limited by the weakest link, and that efforts to make other links particularly strong may be wasteful or even harmful. The chain model and list of threats is also shown to be valuable when planning assessments.     

Getting the story, understanding the lives: From career stories to teachers' professional development

To understand teachers' professional development, the career stories of 10 experienced Flemish (Belgian) Primary School teachers were collected. The analysis of these narrative data culminated in the reconstruction of a professional self and a subjective educational theory, both conceived of as indicators for the professional development. These general concepts were differentiated to develop a conceptual framework for understanding teachers' professional development from their career stories. The comparative analysis of the stories revealed two important recurring themes, the strive for job stability and the feelings of vulnerability for the teacher. In this paper the “biographical perspective” is depicted as a general theoretical approach, and as a concrete research procedure for data collection and analysis. The author concludes that a narrative-biographical approach constitutes a viable perspective for understanding professional development from the subjective viewpoint of the teachers.     

Personal understanding of assessment and the link to assessment practice: the perspectives of higher education staff

The study investigates how higher education staff understand assessment, and the relationship between these understandings and their assessment practices. Nine individuals attended a workshop that guided them through the creation of a concept map about assessment, which was subsequently discussed in one-to-one semi-structured interviews. We found considerable variation in understanding of assessment, both between and within participants, and this appeared to be a consequence of the varied contexts within which assessment operates. Some assessment practices were highly complex, and at times closely entwined with teaching. In addition, individuals’ practices helped to illuminate variation in how underlying concepts (e.g. assessment for learning) were understood. The approach supported the construction of the participants’ understanding of assessment, and enabled the exploration of the interplay between thinking and reported practice, which were closely aligned. It also drew attention to the need to further develop methodologies which capture both the complexity of thinking about assessment and real-world assessment practices.     

Training and the early years professional: understanding visual impairment

Despite a significant increase in the incidence of visual impairment (VI) in early years children, research has afforded the subject scant attention. Perhaps as a result of underfunding, research into VI typically adopts a single case study approach, with the training needs of early years professionals largely ignored. This paper seeks to inform the debate by presenting empirical evidence from a questionnaire designed to gather data on the incidence of VI in early years settings and the nature and extent of awareness training available. Data from the questionnaire survey and the qualitative dimensions of the study indicate an increase in the incidence of VI and, despite high levels of interest, a paucity of training on issues related to VI. Concern was expressed with delays in diagnosis, the lack of screening available and the extent to which the differing terms used militate against interagency collaboration.     

法语专业四级听写错误分析及教学策略

听写是考察法语专业学生综合语言能力的一种有效测试手段。本文通过分析学生的短文听写,总结听写错误在语音、词汇及语法等方面的规律,并提出相应的听写训练策略,以期有效提高学生的短文听写能力。     

Developing teacher assessment skills: The impact of the dynamic approach to teacher professional development

This study investigates the extent to which the Dynamic Approach (DA) to Teacher Professional Development (TPD) can help teachers develop their assessment skills and through that contribute to the improvement of student learning outcomes. To achieve this aim, a multi-treatment group randomisation study was conducted to compare the impact of the DA with the impact of the Competency-Based Approach (CBA) on developing assessment skills and promoting student learning outcomes. Assessment skills of 178 teachers and achievement of their students (n = 2358) were measured before and after the intervention. The DA had greater impact on teacher assessment skills and student learning outcomes than the CBA. Differential effects were also identified since differences in the impact of each approach were only identified for teachers who were situated at higher stages of assessment skills. Implications of findings for research, policy and practice are drawn.     

中等职业学校专业教学指导方案解读及实施对策

我国加入WTO及社会主义市场经济的发展,给中等职业技术教育与课程改革注入了新的活力.科学技术的发展,对职业教育培养目标提出了挑战:生产标准向个性化转变,要求劳动者具有综合职业能力:企业人事组织岗位的变化,更看重人的综合素质;职业综合化发展的趋势,使得文化基础、技能、专业教育的多样性变得越来越重要;生产岗位的变化也使得职业的流动性越来越强,要求人们注重终身受教育.在这样的变化下,教育部职成教司抓住机遇重新制定了中等职业学校的专业目录,并以现代教育与课程改革的理念重新编写了中等职业学校82个重点专业教学指导方案(下简称新方案).     

一种新的评定临床技能成绩的方法

英国北部设菲尔德市儿童医院开发了一种用门诊病人医案来评定儿科医生临床技能的量表,并估计了该量表的信度、可行性、效度和教育的影响。实践表明该量表是可行的,在对培训中的儿科注册医师进行年度评定中它提供的结果是可靠的,量表的反馈有利于被评医生提高自身的临床书面交流能力。这一考评方法具有操作简便、信度和效应较好的优点,它可以作为评定综合性临床能力的一部分,经过试验,这一方法也可用于其他医疗专业的考评。     

Writing for professional recognition in higher education: understanding genre and expertise

ABSTRACT

This study draws on the theoretical frameworks of genre theory and writing expertise to explore how educators manage and excel in writing for professional recognition. Semi-structured interviews were conducted with four educators from different disciplines in which participants discussed their experiences of preparing and writing for Senior Fellow. Despite the fact that writing for professional recognition can be a contentious genre to manage with its reflective features favouring those from certain disciplinary backgrounds, the participants described positive and affirming experiences. The findings also suggest that educators are strategic in their approach, and that the writing process can have unexpected affordances including a developed knowledge of writing, professional confidence and a sense of empowerment. The findings have implications for developing systems and resources to support educators preparing for fellowship.     

Simulation-based performance assessment: an innovative approach to exploring understanding of physical science concepts

This paper illustrates the use of simulation-based performance assessment (PA) methodology in a recent study of eighth-grade students’ understanding of physical science concepts. A set of four simulation-based PA tasks were iteratively developed to assess student understanding of an array of physical science concepts, including net force, acceleration, velocity, and inertia. Illustrative examples drawn from the administration of these simulation-based PA tasks to a sample of eighth-grade students (n?=?74) highlight the potential of simulation-based tasks for revealing conceptual understanding of science concepts and for informing curriculum development within the context of design-based implementation research. The paper also describes a variety of challenges encountered over the course of the development, administration, and analysis of the PA data that may be informative for researchers and educators as they consider implementing simulation-based PAs.     

Strategic counting: A novel assessment of place-value understanding

Children's counting strategies reflect how much they understand the place-value structure of numbers. In Study 1, a novel task, namely the strategic counting task, elicited strategies from kindergarteners and first graders that showed a trend of increasing place-value knowledge – from perceiving number as an undivided entity to seeing it as a collection of independent groups of powers of ten. In Study 2, first-graders' strategic counting task scores at the end of fall semester were better predictors of year-end mathematical achievement than the traditional place-value tasks. In Study 3, a five-item subset of strategic counting was the best among 15 various cognitive predictors of end of second-grade mathematical achievement. Growth curve modeling revealed that low-mathematics achievers at the end of second grade had been lagging behind their peers in strategic counting since early first grade. Implications for early support for children with difficulties in place-value knowledge are discussed.     

Women and professional development in higher education: A search for understanding

Abstract

Participation in professional development related to teaching is higher for female academics than for male academics at the University of Canberra. There is some evidence that this trend is widespread although variable across different universities and professional development activities. Various explanations are suggested as to why this occurs, including: that more teaching in universities is done by women than men; that women are naturally more committed to teaching than men; that structural inequities cause women to be more concentrated in the lower academic ranks and, therefore, more involved in teaching‐related activities; that women more than men believe professional development is important to enhance their teaching practice; that they are less confident in their academic role than men; that they feel more alienated and isolated in their work environment; and, that they are seeking role models and mentors. The paper explores these various explanations and suggests that a combination of factors probably causes the observed differential participation by women in professional development activities. What is more important than a search for explanations is an acknowledgment of the need to value and reward such behaviour. The paper concludes with an argument for valuing women's emphasis on teaching and their continued involvement in professional development related to teaching.     

Threats to student evaluative judgement and their management

ABSTRACT

Students’ capacity for making evaluative judgements of their own work is widely acknowledged as central to their learning within programmes as well as being vital to their subsequent professional practice. In higher education literature, the act of evaluative judgement is usually portrayed as a process of deliberative, analytical reasoning requiring student agency and objectivity, typically scaffolded by points of reference such as explicit criteria, rubrics or exemplars. This article challenges this common portrayal of judgement by drawing attention to research from outside higher education on the role of unconscious factors in judgement and decision-making. Drawing from the field of heuristics and bias studies, the article outlines six unconscious factors that have the potential to distort students’ analytical judgement of their work. A recent challenge to the heuristics and bias approach that radically repositions the place of reasoning in judgement is also considered. Since these unconscious factors have received scant attention in higher education literature, the purpose of this article is to draw attention to them, to identify the challenges they pose to current understandings of evaluative judgement, and to outline their implications for enhancing assessment practice.     

Using activity theory to evaluate a professional learning and development initiative in the use of narrative assessment

Analysis of the impact of professional learning and development (PLD) programmes for educators is complex. This article presents an analysis of a PLD initiative in which classroom teachers learned to use narrative assessment for students with ‘high’ and ‘very high’ learning needs. Using Cultural Historical Activity Theory (CHAT), the analysis showed how various tensions arose across the activity system of participants during the initiative. Tensions were associated with the roles of those involved, the narrative assessment approach, and the rules of the initiative. While the new narrative assessment approach resulted in benefits for the students and their parents, role conflict emerged in relation to established assessment approaches already used by the educators. It is argued that CHAT enables a more nuanced understanding of the complex ways in which teachers actually engage with official curriculum, pedagogy or assessment PLD initiatives, than do theories that position teachers as simply resistant to change.     

Teacher leadership enactment in professional learning community contexts: towards a better understanding of the phenomenon

Professional learning communities (PLCs) have gained considerable attention in education. However, PLCs are dependent on how group members collectively work and learn towards shared goals on improving teaching and learning. This would require leadership to support meaningful and productive interactions within PLC contexts, and hence, the importance of teacher leaders. In this article, we report on an ethnographic case study involving three PLCs investigating how teacher leadership supports PLC conversations using an intervention framework provided by the research team. The findings showed that teacher leadership has potential in supporting PLC conversations along three dimensions of its construct.