Understanding how a case-based assessment instrument influences student teachers’ learning approaches

In order to stimulate student teachers to thoroughly comprehend the main variables influencing their work, teaching and assessment strategies in teacher education have changed significantly. One of the changes in the assessment of student teachers in teacher education programs is the use of case-based assessment instruments. Such instruments evaluate the extent to which student teachers are able to handle authentic problems. It is expected that implementing this mode of assessment will stimulate student teachers to adopt a deep approach to learning. In this study we examine student teachers’ learning approaches in the context of case-based assessment. Hereto, we investigated the direct effects of the student teachers’ general beliefs on the cognitive demands of assessment on their learning approaches. Also the student teachers’ perceptions of the cognitive demands of the case-based assessment instrument were considered as a mediating variable. The present study is conducted in the Netherlands, in the third year of a 4-year initial teacher training program for primary education. A case-based assessment instrument, called the OverAll Test, was implemented as the major determinate of the third-year final examination grade of the student teachers.     

Parent and student perceptions of classroom learning environment and its association with student outcomes

This research is distinctive in that parents’ perceptions were utilised in conjunction with students’ perceptions in investigating science classroom learning environments among Grade 4 and 5 students in South Florida. The What Is Happening In this Class? (WIHIC) questionnaire was modified for young students and their parents and administered to 520 students and 120 parents. Data analyses supported the WIHIC’s factorial validity, internal consistency reliability and ability to differentiate between the perceptions of students in different classrooms. Both students and parents preferred a more positive classroom environment than the one perceived to be actually present, but effect sizes for actual-preferred differences were larger for parents than for students. Associations were found between some learning environment dimensions (especially task orientation) and student outcomes (especially attitudes). Qualitative methods suggested that students and parents were generally satisfied with the classroom environment, but that students would prefer more investigation while parents would prefer more teacher support. The study provides a pioneering look at how parents and students perceive the science learning environment and opens the way for further learning environment studies involving both parents and students.     

Development and validation of an instrument to assess secondary school students’ perceptions of assessment tasks

Research aimed at developing and validating an instrument to assess secondary school students’ perceptions of assessment tasks was conducted. Following a review of literature, a five‐scale instrument of 40 items was trialled with a sample of 658 science students in 11 English secondary schools. Based on internal consistency reliability data and exploratory factor analysis, refinement decisions resulted in a five‐scale instrument called the Perceptions of assessment tasks inventory (PATI). The scales of the PATI are Congruence with planned learning, Authenticity, Student consultation, Transparency and Diversity.     

College student perceptions of teaching and learning quality

Numerous instructional design models have been proposed over the past several decades. Instead of focusing on the design process (means), this study investigated how learners perceived the quality of instruction they experienced (ends). An electronic survey instrument containing nine a priori scales was developed. Students responded from 89 different undergraduate and graduate courses at multiple institutions (n = 140). Data analysis indicated strong correlations between student self-reports on academic learning time, how much they learned, First Principles of Instruction, their satisfaction with the course, perceptions of their mastery of course objectives, and global course ratings. Most importantly, these scales measure principles with which instructional developers and teachers can evaluate their products and courses, regardless of design processes used: provide authentic tasks for students to do; activate prior learning; demonstrate what is to be learned; provide repeated opportunities for students to successfully complete authentic tasks with coaching and feedback; and help students integrate what they have learned into their personal lives.

Measuring teacher regulating activities concerning student learning in secondary education classrooms: Reliability and validity of student perceptions

.This article describes the use and validation of the Pedagogical Practices Inventory, which uses student perceptions arranged into five subscales to measure teacher activities concerning the regulation of student learning in secondary education. To determine the reliability and validity of the instrument, an inventory study (N = 2128) and a study in which observational data (N = 11) and inventory data (N = 201) were combined, were carried out. Analysis of the inventory data showed internal subscale reliabilities between .83 and .90, indicating consistency of the PPI subscale scores. Correlations between inventory and observational data showed significant relations for three of the five subscales, indicating that the PPI is suitable to tap teacher regulating activities in classroom contexts.     

Effects of active learning classrooms on student learning: a two-year empirical investigation on student perceptions and academic performance

Recent studies on active learning classrooms (ACLs) have demonstrated their positive influence on student learning. However, most of the research evidence is derived from a few subject-specific courses or limited student enrolment. Empirical studies on this topic involving large student populations are rare. The present work involved a large-scale two-year study that examined the effects of ACL on student perceptions of their learning experience and the relationship with academic performance in a General Education programme. An institutional survey was used to gather more than 35,000 units of student perception data from all 306 courses in the programme. Our empirical findings show that students thought courses that adopted an ACL as the key learning environment were significantly better designed and more encouraging of student creativity and innovation than courses which used regular classrooms; thus, student perceptions were improved. We are also the first to report that this positive effect on creativity and innovation is statistically unaffected by academic performance, with high, middle and low achievers all benefiting from the use of the facility. The results suggest that ACLs are better environments for nurturing innovation for all students, regardless of their academic ability.     

The role of student characteristics in studying micro teaching–learning environments

This study explored the role of student characteristics in studying micro teaching–learning environments. The overarching hypothesis is that teachers teach differently to micro environments in their classrooms. This study is the first of a series exploring the following four questions: (1) What student profiles are identified at the beginning of a school year with respect to cognitive and motivational-affective factors? (2) How do students with different profiles perceive conditions in their learning environment? (3) To what degree do classrooms differ in the composition of student profiles? (4) What are possible consequences for examining micro teaching–learning environments? The study investigated 82 randomly selected high school science classrooms. Student characteristics were assessed at the beginning of the school year. After a video taped teaching unit, students were asked to rate the degree to which they experienced learning conditions as supportive. Latent class analysis (LCA) showed five distinct student profiles that varied along cognitive and motivational-affective dimensions. Multilevel analyses showed effects of student profiles assessed at the beginning of the school year on the students’ perception of learning conditions in a teaching unit 4 months later. To illustrate consequences for examining micro teaching–learning environments, student profiles were linked to video examples. The examples point to the special value of LCA in studying micro teaching–learning environments: they make it possible to focus on the individual student and to investigate the interplay of student characteristics and the learning environment.     

We agree on what we see: Teacher and student perceptions of formative assessment practice

This study examines teacher and student perceptions of formative assessment (FA) activities used by teachers in the classroom. These activities are divided into five phases that together comprise the FA cycle: (1) clarifying expectations, (2) eliciting responses, (3) analysing and interpreting responses, (4) communicating about responses and (5) adjusting teaching and learning. Reliable questionnaires were used to measure the perceptions of 96 teachers and 1,095 students with regard to FA practice. Paired t-tests indicated no differences between the perceptions of teachers and students, except for with regard to clarifying expectations. Teachers used FA activities primarily to clarify expectations and elicit student responses, and they were least likely to apply them to adjust teaching and learning. The results suggest that the framework of the FA cycle could be used as an analytical lens for the reliable evaluation of the FA activities of teachers.     

Validity and reliability of student perceptions of teaching quality in primary education

ABSTRACT

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.     

Student perceptions of assessment and student self-efficacy in competence-based education

The purpose of this study was to provide insight into the interplay between student perceptions of competence-based assessment and student self-efficacy, and how this influences student learning outcomes. Results reveal that student perceptions of the form authenticity aspect and the quality feedback aspect of assessment do predict student self-efficacy, confirming the role of mastery experiences and social persuasions in enhancing student self-efficacy as stated by social cognitive theory. Findings do not confirm mastery experiences as being a stronger source of self-efficacy information than social persuasions. Study results confirm the predictive role of students’ self-efficacy on their competence outcomes. Mediation analysis results indicate that student’s perceptions of assessment have an indirect effect on student’s competence evaluation outcomes through student’s self-efficacy. Study findings highlight which assessment characteristics, positively influencing students’ learning, contribute to the effectiveness of competence-based education. Limitations of the study and directions for future research are indicated.     

Intelligent design: student perceptions of teaching and learning in large social work classes

Research into the effects of large classes demonstrates that students are disadvantaged in terms of higher order learning because interactions between teachers and students occur at lower cognitive levels. This has significance for social work education, with its emphasis on the development of critical thinking and problem solving, both higher order cognitive skills. This paper reports on quantitative and qualitative research that explored social work students’ perceptions of different teaching and learning strategies in a large mental health course designed with reference to principles of student‐centred learning and constructive alignment. Findings revealed that well‐integrated design, relevance to the real world and teacher enthusiasm were seen as most useful by students, rather than particular learning strategies per se. Higher satisfaction ratings and grades were also associated with this student‐centred course compared with an earlier traditional lecture‐style course. The paper concludes that design based on the interplay between diverse learning activities, including lecture input, strengthened the student‐centred orientation of learning and recommends further research that compares learning outcomes associated with these contrasting approaches to professional education.     

Applying the scholarship of teaching and learning: student perceptions,behaviours and success online and face-to-face

This study compares student perceptions, learning behaviours and success in online and face-to-face versions of a Principles of Microeconomics course. It follows a Scholarship of Teaching and Learning (SoTL) approach by using a cycle of empirical analysis, reflection and action to improve the learning experience for students. The online course design involves 58 interactive narrated online modules, interactive online quizzes and biweekly online meetings with the instructor via video and voice-over-IP technology. Findings indicate that schedule flexibility motivates students to choose the online course format. Students in both learning environments felt they had high-quality communication with the instructor, while online students indicated limited peer-to-peer communication. Online students report studying more at home than face-to-face students, but not enough to compensate for the time face-to-face students spend in class. Reflecting on the findings, the authors suggest actions to improve the online course experience.     

Assessing postgraduate student perceptions and measures of learning in a peer review feedback process

Peer review feedback, developed to assist students with increasing the quality of group reports and developing peer review skills, was added to a master’s level Climate Change Policy and Planning unit. A pre- and post-survey was conducted to determine whether students found the process a valuable learning opportunity: 87% of students responding to the post-review survey indicated they saw benefit in both developing and receiving peer review feedback. Peer review design minimising the potential for plagiarism resulted in low levels of student concern surrounding plagiarism. Marks allocated by students were valid (consistent with the lecturer) and were generally reliable; however, distribution of marks had a higher variance where group report quality was low. Training on completing the peer review template could result in more reliable feedback. Consistent with the literature, the feedback developed during the peer review process focused on style and presentation preferentially to content. Seven out of eight group reports improved between report submissions, with all groups responding to peer review feedback. Peer review feedback and changes made to group reports indicated students had limited capacity to judge the quality of referencing and critical analysis.     

Observational,student, and teacher perspectives on interpersonal teacher behavior: Shared and unique associations with teacher and student emotions

Teachers’ interpersonal behavior in class is important for teacher and student emotions. Often the same rater (either teacher or students) is used to assess both perceptions of teacher behavior and emotions, which makes it vulnerable to common-method bias. Including other perspectives on teacher behavior has been proposed as a solution, but it is unclear to what extent different perspectives are correlated and how to separate their shared and unique variance in explaining emotions. Behavior of 80 teachers was rated from three perspectives (observers, students, and teachers) in terms of Agency (i.e., social influence) and Communion (i.e., friendliness). The three perspectives overlapped more strongly for teacher agency than for communion. Especially for students, teacher communion was a stronger predictor of emotions than agency. Our innovative statistical approach showed that the strong association between ratings of teacher behavior and emotions of the same rater are unlikely to result from common-method bias only.     

Supporting the less-adaptive student: the role of learning analytics,formative assessment and blended learning

Abstract

How can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile.     

Teachers’ and students’ perceptions of assessments: A review and a study into the ability and accuracy of estimating the difficulty levels of assessment items

In today's higher education, high quality assessments play an important role. Little is known, however, about the degree to which assessments are correctly aimed at the students’ levels of competence in relation to the defined learning goals. This article reviews previous research into teachers’ and students’ perceptions of item difficulty. It focuses on the item difficulty of assessments and students’ and teachers’ abilities to estimate item difficulty correctly. The review indicates that teachers tend to overestimate the difficulty of easy items and underestimate the difficulty of difficult items. Students seem to be better estimators of item difficulty. The accuracy of the estimates can be improved by: the information the estimators or teachers have about the target group and their earlier assessment results; defining the target group before the estimation process; the possibility of having discussions about the defined target group of students and their corresponding standards during the estimation process; and by the amount of training in item construction and estimating. In the subsequent study, the ability and accuracy of teachers and students to estimate the difficulty levels of assessment items was examined. In higher education, results show that teachers are able to estimate the difficulty levels correctly for only a small proportion of the assessment items. They overestimate the difficulty level of most of the assessment items. Students, on the other hand, underestimate their own performances. In addition, the relationships between the students’ perceptions of the difficulty levels of the assessment items and their performances on the assessments were investigated. Results provide evidence that the students who performed best on the assessments underestimated their performances the most. Several explanations are discussed and suggestions for additional research are offered.     

Preservice teachers’ perceptions of an ICT-rich learning environment: Development of an instrument

This article reports the development of an instrument to measure preservice teachers’ perceptions of the Study Landscape (SLS), which is an ICT-infused learning environment that encourages preservice teachers to direct their own learning to build a two-way relationship between theory and teaching practice. This study comprised a qualitative and quantitative part. Six factors derived from interviews with users formed the basis of the instrument: (1) Support of Learners’ Initiatives; (2) Support of Information Searches; (3) Support of Interaction; (4) Relationship with Fellow Students; (5) Relationship with Teacher Educators; and (6) Relationship with SLS Staff. Once developed, the questionnaire was responded to by 186 students. Analysis of the data supported five out of six factors.     

Collaborative learning practices: teacher and student perceived obstacles to effective student collaboration

While the educational literature mentions several obstacles affecting the effectiveness of collaborative learning (CL), they have often been investigated through the perceptions of only one actor, either teachers or students. Therefore, some sources of obstacles that teachers and students encounter may not have been revealed. In this study, 19 teachers and 23 students in different disciplines at a pre-service teacher education faculty at a university in Vietnam were interviewed. In total, 47% of the teachers taught science subjects and 53% taught social subjects; 35% of the students majored in science subjects, 57% in social subjects, and 8% in primary education. With regard to study cohorts, 22% of the students were in the first and second year while 78% were in the third and fourth year of their four-year bachelor’s programme. These programmes produce qualified teachers for primary and secondary schools nationwide. Based on grounded theory analysis, four common obstacles to collaboration were identified: students’ lack of collaborative skills, free-riding, competence status, and friendship. Furthermore, the results showed three interrelated antecedents that contribute to these obstacles. Central to the antecedents is the strong focus of the teachers on the cognitive aspects of CL, which led the participating teachers to neglect the collaborative aspects of CL. These antecedents were demonstrated in the ways teachers set CL goals, provided instruction, and assessed student collaboration. This study may be useful for educators, designers, and researchers to foster the quality of student collaboration.     

Exploring processes of collaborative creativity—The role of emotions in children''s joint creative writing

This paper reports a study on children's classroom-based collaborative creative writing. Based on socio-cultural theory, the central aim of the research was to contribute to current understanding of young children's creativity, and describe ways in which peer collaboration can resource, stimulate and enhance classroom-based creative writing. The study drew on longitudinal observations of ongoing classroom activities in year 3 and year 4 classrooms, working with 24 children (12 pairs) aged 7–9 in England. The pairs’ collaborative creative writing sessions were observed and recorded using video and audio equipment in the literacy classroom and in the ICT suite with 2–4 recordings per pair. A functional model was developed to analyse cognitive processes associated with creative text composition (engagement and reflection) via the in-depth study of collaborative discourse. Based on the analysis of paired talk, the study has identified discourse patterns and collaborative strategies which facilitate sharedness and thus support joint creative writing activities. A key finding was the centrality of emotions in the observed creative writing sessions. This paper discusses the role of emotion-driven thinking in phases of shared engagement. The study has implications for creativity research and pedagogy, revealing the special features of shared creative thinking. It also contributes to the current methodological debate about how best to analyse collaborative discourse, highlighting the need to explore the generalisability and domain specificity of existing characterisations of productive groupwork.