Balancing varied assessment functions to attain systemic validity: Three is the magic number

Accountability-oriented reforms demand immediate and continual gains on achievement test, for all students, and without diminishing other outcomes or undermining instruction. This paper describes a framework for aligning classroom assessment and external testing with the aim of negotiating these seemingly contradictory goals. The framework varies the sensitivity to instruction and the representations of knowledge across approaches to assessment. Cycles of design- based studies successively refine relationships between a curriculum and the frame that each assessment provides. Doing so, we argue, leverages the unique formative and summative balance across assessments in order to scaffold learning and demonstrate the “consequential” validity of our strategy without compromising curricula, instruction, or the “evidential” validity that warrants their continued use.     

Discovering the Laws of Sampling

That the sample mean and variance are “good” estimates of the corresponding population parameters is easily accepted as “obvious” by students, but the concept of standard error of the mean is often found to be quite a hurdle. That this standard error decreases inversely as the square-root of the sample size, and the mysterious appearance of the Normal distribution, are often taken as magical and incomprehensible effects, and non-mathematical students can often be turned away from further understanding. This article describes a program which provides an experimental framework in which the student can rapidly develop an intuition for the basic properties of sampling.     

To jump the wave or not: teachers’ perceptions of research evidence in education

This article presents a microanalysis of how a group of primary school teachers deals with research evidence in their work. Based on analysis of a group of Norwegian teachers’ interactions over issues of educational research and research-based knowledge, we find that teachers’ representations of educational research particularly center on the following issues: educational research being perceived as circular, ‘polyphonic’, and a matter of accommodation to their experience-based knowledge. These metaphors also shed light upon the dilemmas that arise when research evidence meets teachers’ more contextual knowledge. We conclude that teachers’ practice-based evidence may take new forms with an increased policy focus on research-based evidence, as well as bringing forth challenges for teacher work and professionalism.     

The linguistic construction of expert identity in professor–student discussions of science

This study examines how participation in a verbal exchange during an inquiry-based classroom activity allows three college students and their science instructor to use linguistic signs (choices of words, grammatical structures, discursive structures, prosody and poetic discourse) to construct authority and expertise. Our work explores linguistic and interactional processes of identification (the dynamic construction and transaction of expert identity) and examines how discursive strategies adopted by the professor at different moments of the verbal exchange influence the students’ subsequent discursive practices and perceptions of authority. We adopt a dialogic, socio-constructivist perspective on identity, viewing personal identities as being partially constructed via interactional positioning. Our findings reveal that the attainment of expertise involves two different types of language-mediated processes: the transmission of a professional vision or intension and the emergence of a perception of agency among students. The former is centered on referential-denotative meanings of speech (elicitation of standard account and operational definition) while the latter requires effective use of pragmatic–performative functions of speech (non-evaluative and more than minimal recipient practices). Consideration is given to the need for science instructors to be able to utilize pragmatic functions of language strategically to encourage students to position themselves within the identity of science expertise.     

Designing minimal computer manuals from scratch

We designed from scratch a minimal manual of the kind proposed by Carroll (1990) for Unix e-mail. The design process involved acquiring from a set of experts information about e-mail use that would be helpful to novices, and acquiring from novices information that guided subsequent versions of the manual. The seventh version of the minimal manual was tested against a commercial manual, in a comparative performance experiment, with 30 naive subjects. It had approximately 13% of the pages of the commercial manual; it resulted in 30% faster learning and more effective use of the e-mail system overall, and significantly better performance on individual subtasks; including the recovery from errors. Significantly more users were satisfied with it than with the conventional manual. Carroll's general principles of manual design for minimal manuals were found to be a good basis for design, and we suggest these guidelines are suitable for the design of such manuals from scratch.     

The localization,diagnostic, and monitoring functions of student ratings in a model for improving university teaching

A diversity of student questionnaires are used by colleges and universities to provide data on faculty teaching performance. Yet the purposes for collecting this data are frequently unclear, and at times superficial. Rarely is student rating data used as a tool to improve faculty teaching. A more relevant approach incorporates a variety of types of student ratings into a model for improving university teaching. One type of student rating data is used to identify broad instructional problem areas. Another type pinpoints probable causes and solutions for the instructional problems. Instructional improvement procedures are designed on the basis of this data. A third type of student rating data evaluates the instructional improvement procedures and indicates when modifications are needed. In addition to these three types of student ratings, and the generation of appropriate questionnaires, this paper presents an overview of the teaching improvement model and discusses its effectiveness.     

Recruiting the graduate voice: informing higher education initiatives to underpin an emerging,veterinary paraprofession in Australia

In Australia, the inception of veterinary technology, as a higher education discipline underpinning an emerging, mid-tier paraveterinary field, reflected global trends for more highly educated veterinary paraprofessionals to meet changing societal demands. In this study, veterinary technology graduates were surveyed about their experiences in the workforce and reflections on their education. Seeking feedback on how well a new programme has prepared graduates for the workforce is a useful quality assurance tool. Clinical veterinary practice was the primary employment sector with the majority of respondents in full-time employment. Career advancement, professional recognition and salaries were identified as key career challenges. The important roles of the veterinary and veterinary nursing professions, the university, government and graduates in the development of this mid-tier, veterinary paraprofession were elucidated. Graduates’ feedback on criteria that underpinned ‘work-readiness’ revealed seven key domains: communication skills, research skills, knowledge, critical thinking/problem-solving, employability, practical skills and professionalism. Veterinary nursing skills, work placement, practice management and production animal health were flagged as areas for curricular improvement. This study illuminated facilitators and barriers critical to establishing a mid-tier veterinary paraprofession, bridging the divide between the vocational and higher education sectors in Australia.

Abbreviations: AUD: Australian dollar; AVA: Australian Veterinary Association; AVBC: Australasian Veterinary Boards Council; AVMA: American Veterinary Medical Association; BVNA: British Veterinary Nursing Association; CSU: Charles Sturt University; DAF: Department of Agriculture and Fisheries; FWC: Fair Work Commission; GCA: Graduate Careers Australia; HE: Higher Education; NHMRC: National Health and Medical Research Council; QLD: Queensland; RCVS: Royal College of Veterinary Surgeons; UK: United Kingdom; UQ: University of Queensland; VN: Veterinary nursing; VNCA: Veterinary Nurses Council of Australia; VSB: Veterinary Surgeons Board; VT: Veterinary technology; WIL: Work-integrated learning.     

Placing cybereducation in the UK classroom

The use of the Internet in the classroom has often been characterized as a practice that disconnects the teacher from traditional forms of externally imposed influence. This paper examines this assertion by mapping the emerging field of cybereducation and considering how endemic knowledge is contextualized by national curricular authorities. The field theories of Pierre Bourdieu and Basil Bernstein are employed in order to demonstrate the relationship between expert discourse and classroom pedagogy, using the National Grid for Learning (NGfL) as a case study. This attempt to capture the dynamics of cybereducation ultimately suggests how this emergent intellectual field’s fragmentation and decoupling from State education forces offers policymakers the capacity to influence use. Progress of the UK government in integrating knowledge from an emergent educational field with its incumbent priorities is gauged, demonstrating the way in which national education officials have attempted to constrain potential departures from unregulated, officially mandated curriculum.