Assessment of the English Skills of Tertiary Students

Despite increasing concern about student writing at the tertiary level there has been little empirical research into the nature and extent of the problem in Australia. The writing skills of three samples of university students in different courses were assessed using the multiple choice English Skills Assessment (ESA) test, and two other measures developed by the researchers: a detailed error checklist and wholistic ratings. The error checklist was intended to supplement as well as complement the skills areas covered by the ESA. On average, students responded correctly to 86 per cent of the ESA test items and made a total of 21 errors per 1000 words when writing narrative. The checklist enabled the detection of important deficiencies in writing not identified by the ESA, particularly in some areas of punctuation and sentence structure. Some different emphases are indicated for the testing of writing skills at the university level.     

Self-assessment to incite learning in higher education: developing ontological awareness

Incorporating self-assessment tasks in higher education involves a conceptual shift of the function of assessment for both learners and teachers. Self-assessment is an innovative assessment initiative that foregrounds ontological knowledge and professional identity in higher education, especially where external professional bodies require additional competencies for learners to be work-ready. As a tool to develop learners’ metacognitive strategies, self-assessment challenges views around learning and assessment. The defined task that constitutes ‘self-assessment’ is considered for two key reasons. First, it is essentially a tool to reflect student-staff partnership in learning and assessment if students are positioned as agentic in the assessment process, and, second, it challenges the relationship between assessment and learning; no longer dichotomous, and more culturally relevant. This paper outlines the introduction of self-assessment over three years in a university postgraduate programme. Using cultural historical activity theory, a framework of analysis that recognises multiple networks of activity, the question ‘what constitutes a self-assessment task?’ is addressed. Results show that the development of self-assessment tasks needs to be considered in the learning-assessment nexus. While these forms of assessment initially unsettle students, they are designed to enable students to participate with an eye on their learning, not the grade.     

Using activity theory to evaluate a professional learning and development initiative in the use of narrative assessment

Analysis of the impact of professional learning and development (PLD) programmes for educators is complex. This article presents an analysis of a PLD initiative in which classroom teachers learned to use narrative assessment for students with ‘high’ and ‘very high’ learning needs. Using Cultural Historical Activity Theory (CHAT), the analysis showed how various tensions arose across the activity system of participants during the initiative. Tensions were associated with the roles of those involved, the narrative assessment approach, and the rules of the initiative. While the new narrative assessment approach resulted in benefits for the students and their parents, role conflict emerged in relation to established assessment approaches already used by the educators. It is argued that CHAT enables a more nuanced understanding of the complex ways in which teachers actually engage with official curriculum, pedagogy or assessment PLD initiatives, than do theories that position teachers as simply resistant to change.     

Discourses of inclusion in initial teacher education: Unravelling a New Zealand ‘number eight wire’ knot

Institutional politics and diversity of ideological positions create challenges for teaching staff with polarised beliefs about inclusive education. This paper provides a methodological justification for a longitudinal study of the experience of developing an integrated ‘inclusive education’ curriculum in one initial teacher education programme. The research focus is on the day-to-day practicalities of how teacher education programme reform is attempted, rather than abstract theories about how it should take place. First, the paper considers why an ‘inclusive education’ approach is problematic. Second, the case narrative approach is explained. Finally, examples from two years of programme development are discussed.     

Assessment practices of educational psychologists in Aotearoa/New Zealand: from diagnostic to dialogic ways of working

Psychologists working in education in Aotearoa/New Zealand work in diverse educational environments making day-to-day decisions informed by evidence-based practice. As a relatively small professional group with a complex work programme, they contribute to the assessments and decision-making processes of children and young people across multiple settings. This paper explores the results of a small-scale national survey of psychologists working in education through the Ministry of Education. Results showed that these psychologists use at least 25 assessment methods including assessments within behavioural, emotional, social, and cognitive domains. The assessment data are used for three primary reasons: to understand the child, inform decision-making, and contribute to discussions around appropriate interventions. The use of interviews, observation and collaboration were identified as key to their assessment practices, illustrating a preference towards more dialogic and ecological ways of working. While the majority used assessment practices that align with facilitating the learning of the child across contexts, the psychologists reported that ethical dilemmas arose when they were expected to be more diagnostic in their focus.     

Reflexive professionalism: reclaiming the voice of authority in shaping the discourses of education policy

The nature and value of “professionalism” has long been contested by both producers and consumers of policy. Most recently, governments have rewritten and redefined professionalism as compliance with externally imposed “standards.” This has been achieved by silencing the voices of those who inhabit the professional field of education. This article uses Foucauldian archaeology to excavate the enunciative field of professionalism by digging through the academic and institutional (political) archive, and in doing so identifies two key policy documents for further analysis. The excavation shows that while the voices of (academic) authority speak of competing discourses emerging, with professional standards promulgated as the mechanism to enhance professionalism, an alternative regime of truth identifies the privileged use of (managerial) voices from outside the field of education to create a discourse of compliance. There has long been a mismatch between the voices of authority on discourses around professionalism from the academic archive and those that count in contemporary and emerging Australian educational policy. In this article, we counter this mismatch and argue that reflexive educators’ regimes of truth are worthy of attention and should be heard and amplified.     

Assessing the Support Needs of Children with a Disability in Regular Classes

This paper reports the development of an instrument to assess the support needs of students with a disability in regular classes. The instrument was developed by a University-based research team on behalf of the New South Wales Department of Education and Training, and was used as the basis for providing funding support for over 12,000 students in the year 2000. The developmental process was robust in that it was based on three types of information: assessment approaches being used in other locations; expert judgement by Departmental officers; and statistical analyses of data obtained using an initial form of the instrument. Statistical analysis was based on a final form of the instrument consisting of 11 focus areas structured into three domains - physical needs, learning needs, and social needs of students. These domains had good construct and face validities and high score reliabilities.     

Cognitive constraints and the early learning goals in writing

This study examined the relative importance of a number of cognitive factors (i.e. working memory, vocabulary knowledge, general cognitive ability and reading skills) in accounting for differences in the rate of progress made by children in the development of emergent writing skills. Sixty-seven children were assessed on tasks measuring the visuospatial, phonological and central executive components of working memory. The children's written texts were analysed according to the assessment scale for writing from the Early Years Foundation Stage Profile. The results indicate that reading performance and visuospatial memory skills are crucial to determining whether or not children aged 4–5 years are able to meet the UK government's prescribed educational standards for writing. The importance of visual skills in the acquisition of orthographic knowledge and writing conventions gained through reading is discussed in relation to current instructional strategies within schools.