Students’ use of a rubric for research theses

A rubric for research theses was developed, based on the manual of the American Psychological Association, to be used as an assessment tool for teachers and students. The aim was to make students aware of what is expected, get familiar with criteria, and interpret teacher and peer feedback. In two studies, it was examined whether students use and value these functions. In the first study, a rubric was provided to 105 Educational Sciences students working on their bachelor’s thesis. Questionnaire data indicated that students did value the rubric for the intended functions, although rubric use was not related to ability. In a panel interview, teachers stated that the number of proficiency levels should be increased to be able to distinguish between good and excellent students adequately, and that a criterion concerning student’s role during supervision should be added. Therefore, in the second study, 11 teachers were interviewed about their motives to give high grades and about the supervision process. This lead to an extra criterion concerning student’s role during supervision and an additional proficiency level to assess excellent performance. It is argued that an adequate course organisation is conditional for the rubric’s effectiveness.     

Development of a performance assessment task and rubric to measure prospective secondary school mathematics teachers’ pedagogical content knowledge and skills

The purpose of this paper is to share a performance assessment task and rubric designed to assess secondary school mathematics preservice teachers’ pedagogical content knowledge and skills. The assessment task and rubric were developed in collaboration with five education faculty, four arts and sciences faculty, and four high school teachers over a period of one year. Over this period, the group met more than 15 times and designed an assessment task and rubric to measure secondary school preservice teachers’ pedagogical content knowledge and skills. The assessment task and rubric were piloted at the end of the year and extensively revised using the pilot data. The redesigned task and rubric were successfully carried out in the second and subsequent years. Other teacher education programs can benefit from this assessment of teacher candidates’ pedagogical content knowledge and skills.     

Measuring scientific reasoning – a review of test instruments

Education systems increasingly emphasize the importance of scientific reasoning skills such as generating hypotheses and evaluating evidence. Despite this importance, we do not know which tests of scientific reasoning exist, which skills they emphasize, how they conceptualize scientific reasoning, and how well they are evaluated. Therefore, this article reviews 38 scientific reasoning tests. They used to primarily consist of multiple-choice questions, but since then have become more diverse, even including tests that automatically analyse virtual experiments. Furthermore, this review revealed that the tests focus on the skills of generating hypotheses, generating evidence, evaluating evidence, and drawing conclusions. Additionally, conceptualizations of scientific reasoning have moved towards a domain-specific set of different but coordinated skills over the years. Finally, concluding from gaps in test evaluation, a future focus should be on testing theoretical assumptions, comparing different scientific reasoning tests, and how relevant test results are in predicting criterion variables like academic performance.     

‘Photo-words’: promoting language skills using photographs

Abstract

This study, using a mixed methods design, examined the use of a photograph-based model to improve students’ language and writing skills. Classes were assigned to receive the photograph-based intervention (experimental) or to receive the regular language-based curriculum (control). Both second and fifth grade students in the experimental group significantly improved their language and writing skills compared to the control group. Second grade students improved significantly more than fifth grade students. The findings also enabled the research team to identify deficiencies that required specific modifications in language curriculum design.     

Assessing cohesion in children’s writing: Development of a checklist

Cohesion in writing is achieved through the use of linguistic devices that tie ideas together across a text, and is an important element in the development of coherent writing. Research shows that inter- and intra-developmental differences may appear in how children learn to use these devices, but cohesion is commonly overlooked in the evaluation and instruction of writing. In this study, we developed a checklist to assess cohesion in the writing of children in Grades 4–7, with the purpose of informing instructional practices. Following the procedure outlined by Crocker and Algina (1986), we developed and evaluated a checklist designed to assess the types of cohesive devices present in the writing of children. The checklist items showed fair to good discrimination between high and low scoring writers as demonstrated by a classical item analysis. We also found good interrater reliability, and evidence for discriminative validity. As internal consistency was weak, however, further research is needed to refine the instrument. Implications for the assessment of cohesion and future research are discussed.     

Development of a badminton teaching system with wearable technology for improving students’ badminton doubles skills

The aim of this study was to develop a badminton teaching system using the wearable technology for improving badminton teaching and learning. This system can provide the similarity scores automatically by comparing a student’s movement and strength while playing badminton with a well-trained expert model. A quasi-experiment was conducted for eight weeks to evaluate the effectiveness of the developed system. A paired-sample t-test was analyzed to evaluate whether there is a significant difference between the pretest and posttest for the experimental group (EG) and the control group (CG) respectively. Also, an independent sample t test was utilized to compare the posttests between EG and CG. The results show that the badminton teaching system developed in this study could enhance the learning effectiveness of novice badminton learners. The results not only show that applying wearable technology, the Myo armband, can benefit learners’ badminton training, but also can demonstrate the importance of providing instant and adaptive feedback in motor skill learning.

     

Gender-fair assessment of young gifted students’ scientific thinking skills

This paper describes an Israeli national-level research examining the extent to which admissions of elementary school students to the gifted programmes based on standardised tests are gender-fair. In the research, the gifted students consisted of 275 boys, 128 girls, and additional 80 girls who were admitted to the gifted programme through affirmative action (AA). To assess these young students’ scientific thinking skills, also referred to as science practices, open-ended questions of case-based questionnaires were developed. The investigated scientific thinking skills were question posing, explanation, graphing, inquiry, and metacognition. Analysis of the students’ responses revealed that gifted girls who entered the programmes through AA performed at the same level as the other gifted students. We found significant differences between the three research groups in question posing and graphing skills. We suggest increasing gender-fairness by revising the standard national testing system to include case-based narratives followed by open-ended questions that assess gifted students’ scientific thinking skills. This may diminish the gender inequity expressed by the different number of girls and boys accepted to the gifted programmes. We show that open-ended tools for analysing students’ scientific thinking might better serve both research and practice by identifying gifted girls and boys equally well.     

Development of implanted deaf children’s conversational skills

Previous studies of preverbal development have highlighted the recurrent difficulties experienced by deaf children in acquiring knowledge of the social rules and social skills pertaining to discourse. We expected cochlear implants in children with bilateral profound deafness to improve their use of verbal language, so that their communication skill profile resembled that of younger, hearing children. Using conversation samples taken from videos recorded every 6 months over a 2-year period, we monitored the development of communication skills in a group of 18 prelingually profoundly deaf children (mean implantation age, 3 years and 5 months). Results corroborated our hypothesis that the overall communication performances of children with cochlear implants improve, both quantitatively and qualitatively, as early as the first year post-implantation.     

Development of a questionnaire for assessing students’ perceptions of the teaching and learning environment and its use in quality assurance

There are few available instruments that assess students’ perceptions of university teaching and learning environments and can be used to provide diagnostic feedback, at the degree or program level, on the quality of the environment. This article describes the development, testing and application, for quality assurance purposes, of a suitable instrument. The final version of the questionnaire includes scales seeking students’ feedback on nine facets of the teaching and learning environment. There are also scales seeking students’ perceptions of the influence of the environment on the development of eight generic capabilities. The 17 scales have been shown to be reliable. Validity has been established by the use of faculty panels to select appropriate generic capabilities and by testing, by structural equation modelling, of an underlying model of the nurturing of capabilities by the environment. The questionnaire has proved to be highly diagnostic when used for quality assurance purposes. A case is given showing how the questionnaire identifies strengths and weaknesses, which can lead to action plans for quality improvement.     

An empirical study of using history as a ‘goal’

This article discusses an empirical study on the use of history as a goal. A historical module is designed and implemented in a Danish upper secondary class in order to study the students’ capabilities at engaging in meta-issue discussions and reflections on mathematics and its history. Based on videos of the implementation, students’ hand-in essay assignments, questionnaires, and follow-up interviews, the conditions, sense, and extent to which the students are able to perform such discussions and reflections are analyzed using a described theoretical framework.     

Exploring tertiary English as a Foreign Language writing tutors’ perceptions of the appropriateness of peer assessment for writing

Despite the increasing volume of research in peer assessment for writing, few studies have been conducted to explore teachers’ perceptions of its appropriateness for writing instruction. It is essential to understand teachers’ perceptions of peer assessment as teachers play an important role in whether and how peer assessment is implemented in their instruction. The current study investigated tertiary English writing tutors’ perceptions of the appropriateness of peer assessment for English as a Foreign Language writing in China, where peer assessment has been increasingly discussed and researched but only occasionally used in teaching. The current study scrutinised the reasons behind its limited use via in-depth exploratory interviews with 25 writing tutors with different teaching backgrounds. The interview data showed tutors’ limited knowledge of peer assessment and unanimous hesitation in using it. The former was explained by insufficient instruction and training in peer assessment. The latter relates to the incompatibility of peer assessment with the examinations-oriented education system, learners’ low English language proficiency and learning motivation, and the conflict of peer assessment with the entrenched teacher-driven learning culture. Suggestions are made about training and engaging teachers to effectively use peer assessment in instruction.     

‘Models of’ versus ‘Models for’

The inclusion of the practice of “developing and using models” in the Framework for K-12 Science Education and in the Next Generation Science Standards provides an opportunity for educators to examine the role this practice plays in science and how it can be leveraged in a science classroom. Drawing on conceptions of models in the philosophy of science, we bring forward an agent-based account of models and discuss the implications of this view for enacting modeling in science classrooms. Models, according to this account, can only be understood with respect to the aims and intentions of a cognitive agent (models for), not solely in terms of how they represent phenomena in the world (models of). We present this contrast as a heuristic—models of versus models for—that can be used to help educators notice and interpret how models are positioned in standards, curriculum, and classrooms.     

The different impact of a structured peer-assessment task in relation to university undergraduates’ initial writing skills

This article presents an empirical evaluation of the validity and reliability of a peer-assessment activity to improve academic writing competences. Specifically, we explored a large group of psychology undergraduate students with different initial writing skills. Participants (n?=?365) produced two different essays, which were evaluated by their course peers and professors using a specific grading instrument (rubric). The validity of the task was demonstrated by a high inter-grader agreement and a strong degree of consistency between the ratings of the peers and professors. Although all students did not improve their writing skills between their first and second essays, the peer-assessment activity enhanced the writing abilities of low but not high-achieving participants. The pedagogical implications of these results are discussed.     

Development and validation of an instrument for assessing high-school students’ perceptions of socio-scientific issues-based learning in biology

In this research, we developed and validate an instrument for assessing high-school students’ perceptions of socio-scientific issues (SSI)-based learning in biology. The development of the instrument was carried out using the following four steps: item formulation, content validation, construct validation and reliability calculation. According to an extensive literature review, 28 initial items were formulated for four SSI-based instruction aspects: (1) contextualisation of SSI, (2) student involvement, (3) student attitudes towards SSI-learning and (4) SSI-based learning objectives. Based on the pilot study conducted for construct validation, 24 items were successfully constructed for the four scales and subsequently administered in biology classrooms to 151 students. Factor analysis showed that each of the 24 items had a factor loading at least 0.40 on its own scale and no other scale. Moreover, the four scales accounted for 58.32% of the total variance and the alpha reliability coefficients for the scales ranged from 0.75 to 0.85. According to these findings, the SSI-based Learning Environment Inventory in Biology is valid, reliable and useful.

     

‘It’s not a hobby’: reconceptualizing the place of writing in academic work

The writing activities involved in research are not fully articulated in discussions of academic work. In this context, academics say they have to disengage from other tasks in order to write, which raises fundamental questions about the place of writing in academic work. A study designed to find out more about this disengagement showed that it involved acts of engagement with writing. Reconceptualizing disengagement from other tasks as engagement with writing repositions writing as part of academic work. This is critical for new and emerging researchers: it provides concepts to underpin practices that will enable them regularly to write. This article provides a model for physical, social and cognitive engagement with writing and explores how it can be put into practice. Implications for academics and those responsible for developing research capacity are discussed.     

Development of vocabulary sophistication across genres in English children’s writing

This paper aims to advance our understanding of how children’s use of vocabulary in writing changes as they progress through their school careers. It examines the extent to which a model of lexical sophistication as use of low-frequency, register-appropriate words adequately captures development in vocabulary use across the course of compulsory education in England. We find that the received model needs elaborating in a number of important ways. Specifically: (1) the average frequency of words in the repertoire used by older children is no lower than that of younger children. However, younger children’s writing is characterized by extensive repetition of high frequency verbs and adjectives and of low frequency nouns (the latter being a product of a focus on entities which are rarely discussed in adult writing). The role of repetition in this finding implies that lexical sophistication is inseparable from lexical diversity, a construct which is usually treated as distinct. (2) Younger children’s writing shows a preference for fiction-like vocabulary over academic-like vocabulary. As they mature, children come to make greater use of academic vocabulary in both their literary and non-literary writing, though this increase is greatest in their non-literary writing. Use of fiction vocabulary remains constant across year groups but decreases sharply in non-literary writing, showing an enhanced sense of register appropriateness. This development of register appropriate word use can be captured by relatively simple frequency-based measures that could readily be employed by teachers and researchers to track writers’ development in this aspect of word use.

     

The mediating effect of task presentation on collaboration and children’s acquisition of scientific reasoning

There has been considerable research concerning peer interaction and the acquisition of children’s scientific reasoning. This study investigated differences in collaborative activity between pairs of children working around a computer with pairs of children working with physical apparatus and related any differences to the development of children’s scientific reasoning. Children aged between 9 and 10 years old (48 boys and 48 girls) were placed into either same ability or mixed ability pairs according to their individual, pre-test performance on a scientific reasoning task. These pairs then worked on either a computer version or a physical version of Inhelder and Piaget’s (1958) chemical combination task. Type of presentation was found to mediate the nature and type of collaborative activity. The mixed-ability pairs working around the computer talked proportionally more about the task and management of the task; had proportionally more transactive discussions and used the record more productively than children working with the physical apparatus. Type of presentation was also found to mediated children’s learning. Children in same ability pairs who worked with the physical apparatus improved significantly more than same ability pairs who worked around the computer. These findings were partially predicted from a socio-cultural theory and show the importance of tools for mediating collaborative activity and collaborative learning.