Assessing students’ performance by measured patterns of perceived strengths: does preference make a difference?

This paper is an empirical field study of whether college students’ preferences for assessment type correspond to their performance in assessment that tests that particular strength. For example, if students say they prefer assessment that tests their creativity, do they actually perform better on assessment tasks requiring the use of creativity? Seventy-eight students in three different courses were surveyed to determine their preferences in four types of assessment: memorisation, analysis, creativity and practical application. These preferences were then compared to student grades on corresponding forms of assessment to see if the preferences corresponded to actual performance. The study found that, while students had a clear preference for memorisation, they were not likely to deliver their best performances on memorisation tasks. There was no relationship at all between student preferences in assessment type and their performance in the respective assessments. These results indicate that, while in theory assessing students based on their preferences is reasonable for improved learning, we were not able to find evidence that it actually leads to higher performance.     

The impact of criteria-referenced formative assessment on fifth-grade students’ theater arts achievement

The purpose of this study was to examine the effects of criteria-referenced formative assessment (CRFA) on students’ achievement in theater arts. The role of type of task in differentiating the treatment-achievement relationship was explored. The analytical sample included 520 fifth-grade students from 13 schools in New York City. Schools were randomly assigned to the treatment or control group. Selection bias in treatment assignment at student level was adjusted with propensity score analysis. CRFA had a positive effect on students’ achievement on performance tasks (d = 0.25), but no significant effect on students’ performance on the analytical constructed response tasks or the theater vocabulary multiple-choice items.     

Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance

Feedback is known to have a large influence on student learning gains, and the emergence of online tools has greatly enhanced the opportunity for delivering timely, expressive, digital feedback and for investigating its learning impacts. However, to date there have been no large quantitative investigations of the feedback provided by large teams of markers, feedback use by large cohorts of students, nor its impact on students’ academic performance across successive assessment tasks. We have developed an innovative online system to collect large-scale data on digital feedback provision and use. Our markers (n = 38) used both audio and typed feedback modalities extensively, providing 388 ± 4 and 1126 ± 37 words per report for first- and second-year students, respectively. Furthermore, 92% of first year and 85% of second-year students accessed their feedback, with 58% accessing their feedback for over an hour. Lastly, the amount of time students spent interacting with feedback is significantly related to the rate of improvement in subsequent assessment tasks. This study challenges assertions that many students do not collect, or use, their feedback. More importantly, we offer novel insights into the relationships between feedback provision, feedback use and successful academic outcomes.     

中学生物学科中的表现性评价及其实例

表现性评价以评价学生在任务情景中所表现出来的能力为核心,强调任务的真实性和情景性。实施表现性评价的重点在于制定一套科学、严谨的评分规则。生物学科中的观察、实验、调查、角色扮演、设计、制作和课外实践等活动类型适合进行表现性评价。表现性评价是一种新型的过程性评价和质性评价,对教师的教学效果和学生的学业水平有着综合的评价和重要的反馈作用。     

First-year students’ appraisal of assessment tasks: implications for efficacy,engagement and performance

This study investigated students’ appraisals of assessment tasks and the impact of this on both their task-related efficacy and engagement and subsequent task performance. Two hundred and fifty-seven first-year students rated their experience of an assessment task (essay, oral presentation, laboratory report or exam) that they had previously completed. First-year students evaluated these assessment tasks in terms of two general factors: the motivational value of the task and its manageability. Students’ evaluations were consistent across a range of characteristics and level of academic achievement. Students’ evaluations of motivational value generally predict their engagement and their evaluations of task manageability generally predict their sense of task efficacy. Engagement was a significant predictor of task performance (viz. actual mark) for exam and laboratory report tasks but not for essay-based tasks. Findings are discussed in terms of the implications for assessment design and management.     

French teachers' intentions to use accommodated materials in learning and assessment

The implementation of inclusive practices in mainstream education remains particularly difficult in the French context and is influenced by various factors including the types of disability labels, and the type of assessment practices that are used. Indeed, how student disability is labelled could impact teacher attitudes by notably disfavouring students labelled with autism. Moreover, normative assessment is strongly linked with selection at schools—a function that works against teacher attitudes towards inclusive education. This article reports on a study in which we examined teacher intentions to use materials accommodated to special educational needs students, as a function of special needs labelling. Specifically, this refers to the use of labels for either a disability or special educational need, in connection to tasks associated with learning or assessment. The results of our study revealed that, for both types of labels, the intentions to use accommodated materials are lower when teachers are asked to assess student competence than when prompted to teach this competence. These findings are discussed with consideration to the incompatibility between selection in schools—which is aligned with the principle of meritocracy—and efforts to promote inclusive education practices.     

What English Counts as Writing Assessment? An Australian Move to Mainstream Critical Literacy

This article focuses on the demands of assessment tasks to address the question: What is entailed in becoming recognised as an accomplished student‐writer? In taking up this focus, the writers use authentic samples to show how tasks for assessing writing can be read as instantiations of particular approaches to English education. They investigate how the tasks inevitably draw on cultural knowledges as a primary resource and raise the issue of what is involved when writing assessment moves away, as it is doing in some Australian schools, from concerns with personal voice and individual growth to a socially critical, discourse‐oriented approach.     

Preservice Teachers' Development and Implementation of Science Performance Assessment Tasks

Preservice teachers in a science methods course were provided instruction on performance assessment, then guided through a design and implementation process of performance assessment tasks. We assessed the effect of designing and implementing a performance assessment task on preservice teachers' understanding of standards-based assessment. The findings show that these preservice teachers improved in their understanding of assessment as a formative process as well as their science content understanding of the topic addressed in their designed task. We found that preservice teachers need to experiment with performance assessment tasks in an authentic context in order to understand the full potential and value of the task.     

建立发展性的学校评价模式

建立发展性的学校评价模式，应以校为本，重视自我评价，强调诊断性评价功能；要实现以鉴定为主的评价观向以发展为主的评价观转变，促使学校不断挖掘自身潜力和价值，承担发展目标的责任，真正做到评价为中小学校发展服务，为创新教育服务。     

The assessment process in a Swedish year five classroom: ‘Reach page 52!’

This paper describes and analyses the assessment process in a Swedish year five classroom, involving pupils aged 11 to 12?years. The paper is based on classroom observations and interviews, which were analysed to explore the assessment process in daily classroom practice, and investigates how the assessment process was understood by pupils and the teacher. The results indicated that the assessment process embodied mainly oversimplified learning goals; teaching was organised as individual work with tasks according to a weekly plan; and assessment and feedback were directed to deconstructed, easily marked goals.     

Conceptualizing teachers' understanding of students' mathematical learning by using assessment tasks*

The study was designed to support teachers on conceptualizing their understanding of students' learning by the use of assessment tasks. A school-based assessment team consisting of the researcher and four third-grade teachers teaching in the same school was set up as a learning context of supporting teachers in developing assessment tasks integral to instruction. The assessment tasks along with students' responses to the task, classroom observations, interviews, routine weekly meetings, teachers' weekly reflective journals, and students' responses to the assessment tasks were the data collected in the study. The teachers' views of using assessment tasks and the generation of assessment tasks were developed in the course of the study. In the process of generating assessment tasks, teachers improved their awareness of students' various solutions and learning difficulties to a specific problem, their awareness of the importance of developing students' critical thinking, and their awareness of where students need to make a remedial instruction. The research reported in the paper was supported by the National Science Council of Taiwan under Grant NSC 90-2521-S134-003-. The opinions expressed in this paper are those of the author and do not necessarily reflect the view of funding agency.     

Study Skills for FE Teachers

This article reports the key findings of a project commissioned in 2005 by the UK Department for Education and Skills to consider the use of synchronous digital video for observation, feedback and assessment of teaching practice in post‐compulsory education and training. A protocol for the remote observation of teaching is presented that was developed after consultation with teachers and observers. Twenty‐five lessons were observed, in real time, and judgements of in‐class and online observers compared. The study demonstrated that, in the conditions tested, synchronous digital observation was a viable alternative to face‐to‐face observation for assessment and feedback on teaching performance.     

Student performance on argumentation task in the Swedish National Assessment in science

The aim of this study is to investigate the influence of content knowledge on students’ socio-scientific argumentation in the Swedish National Assessment in biology, chemistry and physics for 12-year-olds. In Sweden, the assessment of socio-scientific argumentation has been a major part of the National Assessment during three consecutive years and this study utilizes data on student performance to investigate (a) the relationship between tasks primarily addressing argumentation and tasks addressing primarily content knowledge as well as (b) students’ performance on argumentation tasks, which differ in relation to content, subject, aspect of argumentation and assessment criteria. Findings suggest a strong and positive relationship between content knowledge and students’ performance on argumentation tasks. The analysis also provides some hypotheses about the task difficulty of argumentation tasks that may be pursued in future investigations.     

Teaching domain-specific skills before peer assessment skills is superior to teaching them simultaneously

Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students (mean age 14.0?years; 45.2% male) with the between-subjects factor instruction (stepwise, combined). In the stepwise condition, study tasks in Phase 1 were domain-specific and study tasks in Phase 2 had both domain-specific and peer assessment components. In the combined condition, these two components were present in all tasks in both phases. Final performance (i.e. speed and accuracy in domain-specific skills and peer assessment skills) showed no significant differences, but performance improved more from Phase 1 to Phase 2 in the stepwise condition than in the combined condition. The results suggest that, with complex study tasks, it might be beneficial to teach domain-specific skills before peer assessment skills.     

Integrative assessment: reframing assessment practice for current and future learning

The requirement to provide timely formative tasks that are designed to facilitate student learning and autonomy has provoked a wider examination of the role of assessment in higher education and encouraged further investigation of the alignment of learning, teaching and assessment in curriculum design frameworks. Many current authors have proposed that the primary purpose of assessment is to enhance current and future learning and that current practice tends to overemphasise the importance of assessment for progression and certification purposes. This paper proposes that a clearer distinction be made between assessment tasks designed to facilitate and test current learning through the use of formative and summative assessments, and those tasks primarily designed to enhance future learning, which could be better termed integrative assessments. This distinction would allow students and teachers to have greater clarity around the proposed outcomes and reward mechanisms associated with assessment tasks and feedback. This paper proposes that teachers should strive to incorporate four different types of assessment tasks throughout a programme of study, namely diagnostic, formative, integrative and summative tasks, and that the outcomes and reward mechanisms for different assessment types be explained more clearly to students.     

Measuring Primary Students’ Graph Interpretation Skills Via a Performance Assessment: A case study in instrument development

This case study was conducted within the context of a place-based education project that was implemented with primary school students in the USA. The authors and participating teachers created a performance assessment of standards-aligned tasks to examine 6–10-year-old students’ graph interpretation skills as part of an exploratory research project. Fifty-five students participated in a performance assessment interview at the beginning and end of a place-based investigation. Two forms of the assessment were created and counterbalanced within class at pre and post. In situ scoring was conducted such that responses were scored as correct versus incorrect during the assessment's administration. Criterion validity analysis demonstrated an age-level progression in student scores. Tests of discriminant validity showed that the instrument detected variability in interpretation skills across each of three graph types (line, bar, dot plot). Convergent validity was established by correlating in situ scores with those from the Graph Interpretation Scoring Rubric. Students’ proficiency with interpreting different types of graphs matched expectations based on age and the standards-based progression of graphs across primary school grades. The assessment tasks were also effective at detecting pre–post gains in students’ interpretation of line graphs and dot plots after the place-based project. The results of the case study are discussed in relation to the common challenges associated with performance assessment. Implications are presented in relation to the need for authentic and performance-based instructional and assessment tasks to respond to the Common Core State Standards and the Next Generation Science Standards.     

If first-year students are afraid of public speaking assessments what can teachers do to alleviate such anxiety?

Public speaking and oral assessments are common in higher education, and they can be a major cause of anxiety and stress for students. This study was designed to measure the student experience of public speaking assessment tasks in a mandatory first-year course at a regional Australian university. The research conducted was an instrumental case study, with a student-centred focus. Surveys were designed to elicit student perceptions of their emotions and experience before and after engaging in public speaking skill development exercises and a public assessment task. After undertaking public speaking desensitisation and assessment, students experienced increased satisfaction and decreased fear, indecision and confusion. However, students’ perceptions of their confidence to control nerves, maintain eye contact, use gestures and comfortably speak in front of 25 people reduced – an unexpected outcome of the research. The reasons for this remain unclear, which provides a window for further research. Public speaking assessment tasks should be aligned with learning activities, and opportunities to minimise the impact of barriers to students engaging in the learning activities or tasks should be incorporated into curriculum.     

A Study in Correlation of Allied English Abilities

ABSTRACT

The authors explored teachers' and principals’ perceptions of the feedback report from the National Tests in Trinidad and Tobago and the extent to which they used the report in making curricular decisions to impact student learning. The sample comprised 133 primary school teachers (79 from low-performing and 54 from high-performing schools) and 10 principals. Results of the quantitative and qualitative data indicated that while many teachers were uncomfortable with interpreting the data presented in the report, teachers in higher performing schools were more inclined through department-wide collaboration to use the report to make pedagogical and curricular decisions. The major conclusion drawn was the need for teacher training in the use and interpretation of assessment data. Other issues emerging from the data and a possible subject for further research included the branding of schools as good schools and bad schools based on the school performance on the tests.     

Enrolment,content and assessment: a review of examinable senior secondary (16–19 year olds) physical education courses: an international perspective

Senior secondary physical education courses for certification continue to attract increasing student enrolments amidst international concerns for the state and status of physical education in schools. Curricula analysis of senior secondary physical education has typically focussed on courses in local contexts. This review aims to contribute to the current discussion around physical education curricula through a document analysis of 15 senior secondary physical education courses for certification. Results from the analysis of curricula documents reveal similarities in subject aims, objectives and rationales, subject specific content and assessment. Senior secondary physical education is firmly based in both the biophysical and sociocultural fields of study and draws on a broad range of disciplines from which to study human movement. The stated rationales of the courses reviewed suggested that an understanding of the complex interrelationships between content areas underpins senior secondary physical education; however content was mostly prescribed in stand-alone units. This review identified more similarities than differences in content and assessment practices in senior secondary physical education, a point of distinction between the courses reviewed was those that assess physical performance and those that do not. Internal assessment provided for a variety of tasks to determine student learning, however, external assessment was dominated by a written examination.