Convergence of observer ratings and student perceptions of reform practices in sixth-grade mathematics classrooms

As part of a research project examining relationships between instructional practices and student cognitive and social outcomes in middle-school mathematics classes, external observers and students reported perceptions of teachers’ instructional practices. The extent to which students in classrooms identified by external raters as reform-oriented actually perceive instruction in ways aligned with reform principles has not been established. A 25-item observation protocol aligned with the reform practices called for in the Standards of the National Council of Teachers of Mathematics (NCTM) was used to develop a quantitative profile of instructional practices across two lessons in each of 28 classes of 15 participating teachers. Students in each of the observed classes completed a 49-item survey of their perceptions of instructional practices. As items for both the observation protocol and Student Survey were designed to measure alignment with the same dimensions of reform practice, the convergence of these two data sets was examined as a means to confirm the observation ratings. The findings show moderately strong correlations between ratings of external observers and perceptions of sixth-grade students across three dimensions (pedagogy, tasks and mathematical interactions) of reform-oriented teacher practice in mathematics classrooms. Implications of these findings for future research are discussed. The research in this article was supported by the National Science Foundation (NSF) under grant REC 0125868. The opinions expressed here are those of the authors and do not necessarily reflect the view of NSF. The research was also supported by the Roysters’ Fellowship to Mark Ellis from the Graduate School at the University of North Carolina at Chapel Hill.     

Understanding how a case-based assessment instrument influences student teachers’ learning approaches

In order to stimulate student teachers to thoroughly comprehend the main variables influencing their work, teaching and assessment strategies in teacher education have changed significantly. One of the changes in the assessment of student teachers in teacher education programs is the use of case-based assessment instruments. Such instruments evaluate the extent to which student teachers are able to handle authentic problems. It is expected that implementing this mode of assessment will stimulate student teachers to adopt a deep approach to learning. In this study we examine student teachers’ learning approaches in the context of case-based assessment. Hereto, we investigated the direct effects of the student teachers’ general beliefs on the cognitive demands of assessment on their learning approaches. Also the student teachers’ perceptions of the cognitive demands of the case-based assessment instrument were considered as a mediating variable. The present study is conducted in the Netherlands, in the third year of a 4-year initial teacher training program for primary education. A case-based assessment instrument, called the OverAll Test, was implemented as the major determinate of the third-year final examination grade of the student teachers.     

Comparative analysis of the impact of traditional versus innovative learning environment on student attitudes and learning outcomes

This study explored the claim that different classroom layouts can affect teaching and learning. At the time of the study, there were few robust evaluative frameworks able to isolate and then measure the impact of different educational layouts. In response, this study employed a quasi-experimental approached facilitated by a Single Subject Research Design (SSRD) to compare two different classroom layouts - a traditional classroom layout and ‘Innovative Learning Environment’ (ILE) in an Australian secondary schooling context. The study compared students’ attitudes to their learning experiences, motivation, engagement and academic outcomes in each layout over a school year. Comparative analyses highlighted how students’ attitudes to their learning experiences and engagement differed in the two designs. A correlation was identified between enhanced student attitudes in an ILE and higher English, Humanities and Mathematics academic achievement when compared with cognitively matched peers who occupied a traditional classroom for the same period. This initial empirical evidence, even though restricted to a single site, was able to discern a measurable link between the occupation of different learning spaces and an impact on student learning experiences, engagement and academic outcomes in secondary schooling context.     

Preservice teachers’ perceptions of an ICT-rich learning environment: Development of an instrument

This article reports the development of an instrument to measure preservice teachers’ perceptions of the Study Landscape (SLS), which is an ICT-infused learning environment that encourages preservice teachers to direct their own learning to build a two-way relationship between theory and teaching practice. This study comprised a qualitative and quantitative part. Six factors derived from interviews with users formed the basis of the instrument: (1) Support of Learners’ Initiatives; (2) Support of Information Searches; (3) Support of Interaction; (4) Relationship with Fellow Students; (5) Relationship with Teacher Educators; and (6) Relationship with SLS Staff. Once developed, the questionnaire was responded to by 186 students. Analysis of the data supported five out of six factors.     

The role of relationships and emotions in student perceptions of learning and assessment

The paper addresses the way in which participants in a qualitative study drew upon accounts of relationships and emotions in sharing their perceptions of assessment. By first exploring ideas about emotions and relationships in learning and assessment through the literature and subsequently discussing an interpretation of participant narratives, the author suggests that emotions and relationships surrounding past learning and assessment contexts can influence current perceptions of assessment and learning in powerful ways. The study also reveals how students value opportunities to express their beliefs, feelings and emotions during the assessment process. They also expect teachers to balance objectivity in assessment with empathy for those parts of themselves shared in the process. The conclusion is drawn that there are important implications for learning in the emotional response of students to assessment and in the nature of teaching and learning relationships that are worthy of further investigation.     

Examining the relationship among student perception of support, course satisfaction, and learning outcomes in online learning

Support for student learning is a key element in optimizing student learning experiences in any learning environment and its importance has been widely discussed. This study looked at student support, particularly in the course context, focusing mainly on guidance provided to students within a course. Three categories of support were identified and used for the purpose of this study: instructional, peer, and technical support. A total of 110 students completed an online survey on students' perceptions of support and course satisfaction in an undergraduate online course at a large southeastern university. The results showed perceived support was significantly related to their overall satisfaction of the online course. The findings of this study suggest that teachers should communicate what types of support are available to students and provide an easy way of accessing and taking advantage of the support.     

Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling

In educational research, characteristics of the learning environment (e.g., social climate, instructional quality, goal orientation) are often assessed via student reports, and their associations with outcome variables such as school achievement or student motivation then tested. However, studying the effects of the learning environment presents a series of methodological challenges. This article discusses three crucial elements in research that uses student reports to gauge the impact of the learning environment on student outcomes. First, from a conceptual point of view, it is argued that ratings aggregated at the relevant level (e.g., class or school level), and not individual student ratings, are of primary interest in these studies. Second, the reliability of aggregated student ratings must be routinely assessed before these perceptions are related to outcome variables. Third, researchers conducting multilevel analyses need to make very clear which centering option was chosen for the predictor variables. This article shows that conclusions about the impact of learning environments can be substantially affected by the choice of a specific centering option for the individual student ratings.     

A comparative study on student perceptions of their learning outcomes in undergraduate science degree programmes with differing curriculum models

ABSTRACT

This study investigated students’ perceptions of their graduate learning outcomes including content knowledge, communication, writing, teamwork, quantitative skills, and ethical thinking in two Australian universities. One university has a traditional discipline-orientated curriculum and the other, an interdisciplinary curriculum in the entry semester of first year. The Science Students Skills Inventory asked students (n?=?613) in first and final years to rate their perceptions of the importance of developing graduate learning outcomes within the programme; how much they improved their graduate learning outcomes throughout their undergraduate science programme; how much they saw learning outcomes included in the programme; and how confident they were about their learning outcomes. A framework of progressive curriculum development was adopted to interpret results. Students in the discipline-oriented degree programme reported higher perceptions of scientific content knowledge and ethical thinking while students from the interdisciplinary curriculum indicated higher perceptions of oral communication and teamwork. Implications for curriculum development include ensuring progressive development from first to third years, a need for enhanced focus on scientific ethics, and career opportunities from first year onwards.     

Measuring teacher regulating activities concerning student learning in secondary education classrooms: Reliability and validity of student perceptions

.This article describes the use and validation of the Pedagogical Practices Inventory, which uses student perceptions arranged into five subscales to measure teacher activities concerning the regulation of student learning in secondary education. To determine the reliability and validity of the instrument, an inventory study (N = 2128) and a study in which observational data (N = 11) and inventory data (N = 201) were combined, were carried out. Analysis of the inventory data showed internal subscale reliabilities between .83 and .90, indicating consistency of the PPI subscale scores. Correlations between inventory and observational data showed significant relations for three of the five subscales, indicating that the PPI is suitable to tap teacher regulating activities in classroom contexts.     

Using student perceptions to compare actual and preferred classroom environment in Queensland schools

Students’ perceptions of actual and preferred classroom environment were investigated using the What is happening in this class? questionnaire (WIHIC). The WIHIC assesses seven classroom environment dimensions: student cohesiveness, teacher support, involvement, task orientation, investigation, cooperation and equity. A sample of 978 secondary school students from 63 classes in Queensland responded to the WIHIC. For each item on the WIHIC, students recorded their perceptions of the actual (or real) and preferred (or ideal) classroom environment. Results revealed that statistically significant differences between actual and preferred environments, and that the gap between actual and preferred environment was smaller for more positive classroom environments.     

Student activity and learning outcomes in a virtual learning environment

The aim of the study was to explore the relationship between degree of participation and learning outcomes in an e-learning course on medical informatics. Overall activity in using course materials and degree of participation in the discussion forums of an online course were studied among 39 medical students. Students were able to utilise the course material in discussion groups focusing on the lectures, quizzes and students’ own notes. Each student’s data recording of activities and individual participation in discussion in the online course was analysed in order to assess which activities predicted learning outcome. Higher course grades were associated with studying the course material frequently and also with regular participation in reading postings and replying to them. There were no connections between learning outcome and the students’ original contributions to the discussion forums. There were no statistically significant differences between male and female students in how they utilised the various components of the learning material.     

Evaluating student perceptions of learning processes and intended learning outcomes under inquiry approaches

Inquiry-based learning (IBL) is promoted as a teaching approach that can enhance student learning outcomes. IBL can be categorised according to scale (e.g. tasks, course/module/paper, degree), mode (structured, guided, open) and framing (information or discovery-oriented). Our research used a survey instrument to determine how student perceptions of learning processes and intended learning outcomes (ILOs) varied in response to courses with different modes and framing of IBL. The survey was completed by 940 students in 15 IBL courses across a range of disciplines and levels. All types of IBL courses were well rated by students for encouraging learning processes and ILOs congruent with a well-designed inquiry experience. Regarding modes of IBL, there was a clear hierarchy from open (most highly rated) to guided and then structured inquiry. For the framing of IBL, courses using discovery-oriented IBL were more highly rated than information-oriented IBL. Overall, the most highly rated course design was open, discovery-oriented IBL, but other types of IBL remained important in terms of developing research and inquiry skills. To determine whether all types of IBL courses are promoting enhanced ILOs compared to more traditionally taught courses, a comparative study should be undertaken.     

Building bridges to student learning: Perceptions of the learning environment,engagement, and learning outcomes among Chinese undergraduates

The study examined the relationships among students’ perceptions of the learning environment, prior academic achievement, engagement, and learning outcomes (cumulative university GPA, generic skills development, and learning satisfaction) with a sample of 2,616 seniors from a full-time research-oriented university in Mainland China. The results supported a model which showed that students’ perceptions of the learning environment and prior academic achievement had direct effects on learning outcomes, and indirect effects via their engagement. The effects, however, varied depending on the type of the outcome in question: (1) Student engagement mediated the relationship between course experience and generic skills development, (2) cocurricular experience positively predicted learning satisfaction, (3) first semester GPA positively predicted cumulative university GPA, and (4) National College Entrance Examination scores did not correlate with any other factor. A major proportion of the variance in the three types of learning outcomes was accounted for by the model, showing its effectiveness in predicting university students’ learning. Implications for improving undergraduate education in China are provided.     

College student perceptions of teaching and learning quality

Numerous instructional design models have been proposed over the past several decades. Instead of focusing on the design process (means), this study investigated how learners perceived the quality of instruction they experienced (ends). An electronic survey instrument containing nine a priori scales was developed. Students responded from 89 different undergraduate and graduate courses at multiple institutions (n = 140). Data analysis indicated strong correlations between student self-reports on academic learning time, how much they learned, First Principles of Instruction, their satisfaction with the course, perceptions of their mastery of course objectives, and global course ratings. Most importantly, these scales measure principles with which instructional developers and teachers can evaluate their products and courses, regardless of design processes used: provide authentic tasks for students to do; activate prior learning; demonstrate what is to be learned; provide repeated opportunities for students to successfully complete authentic tasks with coaching and feedback; and help students integrate what they have learned into their personal lives.

The association of school environment to student teachers' satisfaction and teaching commitment

A supportive school environment is crucial to the enhancement of student teaching experiences. This study assesses student teachers' perceptions of secondary school environments, and then relates the perceptions to their satisfaction with school experiences and teaching commitment. The results show that considerable disparities between student teachers' perceptions of actual and preferred school environments and suggest certain directions for improvement. Student teachers' perceptions about their school environments, especially in the areas of professional interest and staff freedom, were positively associated with their satisfaction. Several school environmental aspects influenced the total years they planned to teach and their intention to teach at the placement schools.     

Validity and reliability of student perceptions of teaching quality in primary education

ABSTRACT

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.     

Effects of flipping the classroom on learning outcomes and satisfaction: A meta-analysis

In a flipped classroom, students study instructional material before class and apply this material during class. To provide a statistical synthesis of current research on effects of flipped classrooms, we conducted meta-analyses that included 114 studies which compared flipped and non-flipped classrooms in secondary and postsecondary education. We found a small positive effect on learning outcomes, but no effect was found on student satisfaction regarding the learning environment. In addition, we found considerable heterogeneity between studies. Moderator analyses showed that students in flipped classrooms achieve higher learning outcomes when the face-to-face class time was not reduced compared to non-flipped classrooms, or when quizzes were added in the flipped classrooms. We conclude that a flipping the classroom (FTC) approach is a promising pedagogical approach when appropriately designed. Our results provide insights into effective instructional FTC design characteristics that support an evidence-informed application of FTC.     

Advances in research on classroom dialogue: learning outcomes and assessments

The goal of this special issue is to examine how certain modes of classroom dialogue might contribute to students' learning outcomes. The articles in this special issue share the idea of classroom talk as a problem-oriented dialogue. In other words, an interactional configuration based on exchanges among students and teachers that go beyond the predominantly monologic approaches of classroom talk. In each of the contributions to this special issue, different types of learning outcomes were studied as a result of specific ways of orchestrating classroom dialogue. All in all, the studies in this special issue yield a picture of the field as a productive research area: they provide evidence for the plausibility of the assumption that dialogic orchestrations of classroom talk may produce various desired learning and developmental outcomes in students, depending on what outcomes we want to articulate, and how they are assessed. Although the studies in this special issue yield promising results for future improvements of classroom practice more (preferably longitudinal) research is required.     

Relations between student teachers’ learning patterns and their concrete learning activities

This study aims to unravel the relationships between student teachers’ learning patterns and how they actually learn in practice as measured during multiple concrete learning experiences. In previous research aptitude and event measures often pointed in different directions. 90 student teachers’ learning patterns were measured with an aptitude instrument, designed for the specific context of learning to teach. Multiple concrete learning activities were measured with a structured digital log. Results showed meaningful relations between students’ learning patterns and their learning activities, taking multiple learning experiences into account. Survival oriented student teachers show more inactiveness in their learning, reproduction oriented student teachers learn by doing to improve their teaching behavior, dependent meaning oriented student teachers are more influenced by previous negative experiences and independent meaning oriented student teachers show the most deep and most active way of learning. But interestingly, the results also show that some relations as described in literature did not show up. The choice for a particular processing strategy and also the intentionality of the learning experiences was not related to student teachers’ learning patterns. This study demonstrates the added value of combining both types of instruments in research and practice.     

Measuring perceptions of the learning environment and approaches to learning: validation of the learn questionnaire

While focus on quality in Danish higher education has been growing in recent years, limited attention has been devoted to developing and thoroughly validating instruments that allow collecting data about university students’ perceptions of the teaching-learning environment. Based on data from a large sample of Danish university students, a Danish version of the Learn questionnaire was validated using confirmatory and exploratory factor analysis. Analyses confirmed the existence of three scales reflecting students’ approaches to learning and six scales reflecting students’ perception of the teaching-learning environment. The results suggest that the Danish version of Learn is a valid instrument to be used for evaluation of the teaching-learning environment as well as for research into Danish university students’ learning strategies.