Student knowledgeability,student sex,class size,and class level: Their interactions and influences on student ratings of instruction

Student knowledgeability, class size, and class level were found to significantly influence students' ratings of instruction. In general, the more knowledgeable the student in an area, the higher his ratings of courses and instructors in that area. Also, large courses and advanced courses were most highly rated by students. The effect of student sex on student ratings of instruction varied as a function of the particular aspect of instruction being evaluated. Significant interactions among the four main effects were also found across the judgmental dimensions students utilized in evaluating instruction, as assessed by factor analysis. Student knowledgeability and class size were found to be the main predictors of student ratings on these dimensions.     

Improving instruction of veteran physics professors

In spite of the abundance of publications describing university faculty development programs and activities, little is known about the effectiveness of such programs on specific disciplines or subject areas. The fact that differences have been identified in the dimensions on which students of different university departments rate their teachers suggests that instructors of different departments need different types of programs for teaching improvement. This article describes a study that has looked into methods for improving instruction of university physics full professors with many years of teaching experience. Two methods for this aim were examined for effectiveness: a workshop and individualized consultation, both augmenting students' midterm ratings of their instructors. Analysis of pre- and postworkshop questionnaires reveals impressive improvement on the majority of items, particularly those of specific teaching techniques discussed in the workshop, but not on the global ratings of the teacher. The special consultation procedure has been shown to bring about substantial increase on overall teaching performance. We conclude that veteran teachers are often unable to improve significantly their overall teaching performance when provided with midterm feedback from students' questionnaires or when participating in a workshop for teaching improvement. Improving their instruction requires substantial and continuous expert consultation as well as investing substantial time and efforts of their own.     

Developing Teachers' Classroom Interactions: A Description of a Video Review Process for Early Childhood Education Students

This article describes a video review process for providing feedback to students and documents students' teaching practices using the CLASS in a practicum course and student teaching. Students videotaped themselves in their field-based settings and then met with the course instructors and classmates in small groups to review strengths and challenges of their teaching using the CLASS framework of teacher–child interactions. These videos were also coded by trained CLASS observers across 10 dimensions in the areas of emotional support, classroom organization, and instructional support. Results from preservice teachers' CLASS ratings indicate a pattern similar to national data sets using the CLASS, higher scores in the emotional support and classroom organization domains than in the domain of instructional support. Also, findings from the current study revealed that CLASS scores declined from students' practicum placement to the end of student teaching in the domain of emotional support and specifically in the dimensions of regard for student perspectives and behavior management. The process of using videos for providing feedback in field-based experiences is discussed as well as implications for teacher development in light of students' CLASS scores and changes in CLASS scores.     

Effect of sex,class standing,and academic performance on perceived importance of teacher behaviors

An implicit assumption made in most teaching evaluation instruments is that teaching behaviors are equally important to students. Using specific teacher behaviors which have appeared in a number of teaching assessment devices, the importance of teacher behaviors questionnaire (ITB) was constructed to measure students' perceptions of the importance of selected teacher behaviors. Data collected from 105 college students were utilized in the present study for the following purposes: (a) to determine if there are differences among students' ratings of teaching behaviors in terms of importance and (b) to determine if the ratings of importance given to selected teacher behaviors vary according to students' sex, class standing, or academic performance. Results of the study indicated that there were significant differences in perceived importance of selected teacher behaviors. Furthermore, it was found that ratings of some of these behaviors tended to vary across sex groups. Implications for utilizing importance information as a weighting component in teaching evaluations are discussed.     

Emotion in online college classrooms: examining the influence of perceived teacher communication behaviour on students’ emotional experiences

This research focused on teacher communication behaviour as an influential factor in students’ educational experiences. This study examined students’ perceptions of emotion (involving teachers’ emotional support, students’ emotional work and students’ positive emotional valence toward class and teacher) as influenced by a variety of predicting variables: perceptions of teacher affinity-seeking as well as teachers’ positive behaviour alteration techniques, verbal immediacy and teacher online presence (involving the three factors of instructional design, organisation facilitating discourse and direct instruction). Relying on survey data collected from undergraduate and graduate students across disciplines enrolled in course offerings at a large public university, quantitative analysis examined relationships among existing factors previously studied in educational and communication research. Although this study uncovered multiple significant relationships between variables in the data set, students’ perceptions of their teachers’ verbal immediacy and presence in their instructional design were found to be most predictive relative to students’ emotions in online classrooms. Ultimately this project addresses and emphasises the need to more fully examine students’ emotions and related social experiences with virtual teachers and course content in higher education.     

Convergence of observer ratings and student perceptions of reform practices in sixth-grade mathematics classrooms

As part of a research project examining relationships between instructional practices and student cognitive and social outcomes in middle-school mathematics classes, external observers and students reported perceptions of teachers’ instructional practices. The extent to which students in classrooms identified by external raters as reform-oriented actually perceive instruction in ways aligned with reform principles has not been established. A 25-item observation protocol aligned with the reform practices called for in the Standards of the National Council of Teachers of Mathematics (NCTM) was used to develop a quantitative profile of instructional practices across two lessons in each of 28 classes of 15 participating teachers. Students in each of the observed classes completed a 49-item survey of their perceptions of instructional practices. As items for both the observation protocol and Student Survey were designed to measure alignment with the same dimensions of reform practice, the convergence of these two data sets was examined as a means to confirm the observation ratings. The findings show moderately strong correlations between ratings of external observers and perceptions of sixth-grade students across three dimensions (pedagogy, tasks and mathematical interactions) of reform-oriented teacher practice in mathematics classrooms. Implications of these findings for future research are discussed. The research in this article was supported by the National Science Foundation (NSF) under grant REC 0125868. The opinions expressed here are those of the authors and do not necessarily reflect the view of NSF. The research was also supported by the Roysters’ Fellowship to Mark Ellis from the Graduate School at the University of North Carolina at Chapel Hill.     

Student ratings and various instructional variables from a within-instructor perspective

The relationship between class size, instructional method, course level, reason for enrollment, and student ratings of instruction was assessed from a within-instructor perspective. Two hundred fifty-four pairs of courses taught by the same instructor were correspondingly identified and subjected to a stepwise multiple regression procedure. Only class size was found to be a significant predictor of ratings once individual differences between instructors were controlled, hence underlining the importance of (1) taking cognizance of the size of the course when using student ratings of instructors as a measure of teaching effectiveness, and (2) controlling for systematic variation due to instructor idiosyncracies in instructional research.     

Embracing the Complexity of Instruction: A Study of the Effects of Teachers' Instruction on Students' Reading Comprehension

The purpose of this study was to determine whether third-grade teachers' instructional actions during reading comprehension lessons contributed to their students' reading comprehension achievement. Our framework focused on teachers' emphasis on three dimensions of instruction (pedagogical structure, teacher-directed instruction, and support for student learning), as observed in comprehension lessons across a year. Third-grade teachers' instruction was analyzed first by measuring their latent propensity to engage in instructional actions in the three dimensions and then by using these latent variables in a multilevel model to examine their students' gains in reading comprehension. Results provided support for the theoretical dimensions, taking into account contextual variables including lesson, student, and teacher characteristics; teachers' engagement in teacher-directed instruction and their support for student learning significantly contributed to their students' reading comprehension. Results suggest that analysis of teachers' instructional actions within and across lessons is a promising approach for the study of effective reading instruction.     

Who is the expert? Construct and criteria validity of student and teacher ratings of instruction

In this article, we examine the construct and criteria validity of student and teacher ratings as indicators of instructional features. As parsimonious measures, student and teacher reports are frequently used to assess aspects of the learning environment. From a methodological perspective, however, both approaches have been questioned. Whereas student ratings are occasionally criticised as being undifferentiated and easily influenced by personal preferences, teacher reports are sometimes considered to be biased by self-serving strategies or teaching ideals. Instead of pitting one method against the other, our study aimed at establishing the specific value of each approach. The analyses draw on data from a German extension to the 2003 PISA assessment, in which 288 mathematics teachers and their students completed questionnaires using identical items to tap various aspects of instruction. Mean student ratings were computed for each class. Exploratory and confirmatory factor analyses revealed specific conceptual structures for student and teacher ratings, with teachers elaborating on the use of tasks and methods, and students focusing on their teacher’s support in personal and learning matters. Three shared dimensions were also established: occurrence of classroom management problems, degree of cognitive autonomy during lessons, and tempo of interaction. Teacher/student agreement on these dimensions varied across constructs, with considerable agreement on classroom management, low agreement on cognitive autonomy, and no significant agreement on whether or not the interaction tempo was appropriate. Accordingly, correlations with external criteria (student motivation, teacher motivation, mathematical achievement scores, and characteristics of the tasks set in class) also varied across constructs. We conclude that student and teacher ratings are best suited to tapping different aspects of the learning environment, and recommend that care be taken in choosing a data source appropriate for the construct to be measured.

How Fair are Student Ratings in Assessing the Teaching Performance of University Teachers?

This paper examines the effects of course characteristics on student ratings of university teaching. The multivariate effects of various course characteristics on student ratings of university teachers were examined by a 5×4×3×2×2 multivariate analysis of variance (MANOVA) with academic discipline, class size, level of course, type of course, and mode of study as independent variables and a set of six composite student ratings as the dependent variable. Data were obtained from a university in Hong Kong and consisted of 4996 course average ratings collected from 25 departments over two academic years. Significant differences were found in course average student ratings across academic disciplines, class size groups, course levels, types of course, and modes of study. The effect sizes of the largest differences between sub‐groups within each of the factors were also estimated. Academic discipline differences and class size were found to have the largest effect on student ratings, with effect sizes of 0.43–0.86 and 0.55–1.01 respectively. Implications of the findings are discussed.     

Filipino and American student perceptions of teacher effectiveness

Filipino and American undergraduate students rated college instructor characteristics according to their perceived importance for effective teaching. Items were selected to reflect relevant value orientations in Filipino and American cultures. Factor analysis of the ratings revealed six underlying dimensions. MANOVA results showed that the group ratings on the six corresponding subscales were significantly different. Discriminant function analysis revealed that Filipino students rated items pertaining to authoritarianism and personal appearance of the instructor as significantly more important for effective teaching than did American students. This suggests that cross-cultural differences in perceptions of effective teaching may be predictable from a knowledge of both similar and conflicting value orientations in the specific cultures. Implications for the academic adjustment of students from different cultures were discussed.     

Perceived autonomy support,intrinsic motivation,and student ratings of instruction

Motivation theory suggests that autonomy supportiveness in instruction often leads to many positive outcomes in the classroom, such as higher levels of intrinsic motivation and engagement. The purpose of this study was to determine whether perceived autonomy support and course-related intrinsic motivation in college classrooms positively predict student ratings of instruction. Data were collected from 47 undergraduate education courses and 914 students. Consistent with expectations, the results indicated that both intrinsic motivation and autonomy support were positively associated with multiple dimensions of student ratings of instruction. Results also showed that intrinsic motivation moderated the association between autonomy support and instructional ratings—the higher intrinsic motivation, the less predictive autonomy support, and the lower intrinsic motivation, the more predictive autonomy support. These results suggest that incorporating classroom activities that engender autonomy support may lead to improved student perceptions of classroom instruction and may also enhance both student motivation and learning.     

Writing instruction in first grade: an observational study

As schools work to meet the ambitious Common Core State Standards in writing in the US, instructional approaches are likely to be examined (National Governors Association Center for Best Practices, Council of Chief State School Officers, 2010). However, there is little research on the current state of instruction. This study was designed to provide a comprehensive analysis of first-grade writing instruction across 13 schools in one state in the US. Daylong observations were conducted four times during the year in 50 first-grade classrooms. Using a time-sampled, observational protocol, observers coded multiple dimensions of instruction, including grouping, instructional focus, teacher instructional activity, and student writing activity. Results revealed that writing was taught for less than 30 min a day on average, and instruction in skills or process writing was common. Most instruction was organized in whole-class settings with teachers either presenting information or asking students questions. Variability in the amount and focus of writing instruction and in student writing activity was examined at the classroom and school levels. A small number of classrooms and schools were identified with distinctive patterns in their approach to instruction and writing activity. Several moderate relationships were found between the writing instructional focus and the nature of student writing. These findings suggest that first-grade writing instruction is inconsistent across classrooms and schools and point to instructional implications for teachers and schools in the US.     

Some effects of training on teaching effectiveness of untrained university teaching assistants

This paper presents an assessment of the effects which a brief training program had on teaching effectiveness of graduate teaching assistants (TAs). Twenty-two inexperienced and previously untrained university TAs from economics, geography, and business administration were assigned to a training or control group by a stratified random method with stratification based on TA departmental affiliation. Teaching experts rated two videotapes of each Ta's university class, one tape made before training and one following training. Ratings were obtained on two factors: (1) planning instruction to meet clear goals and organizing meaningful content in a logical fashion, and (2) involving students in instruction. Results from analyses of covariance indicate that the training group received significantly higher final ratings than the control group on the total score and on each of the two factors when final scores were adjusted for group differences in initial ratings. Teaching experience alone did not result in significantly higher ratings for control group TAs. Participants in training evaluated most topics and the overall program favorably both immediately after training and one semester later.     

Effects of a Theory-Based Feedback and Consultation Process on Instruction and Learning in College Classrooms

This study examined how midterm student ratings feedback provided to teaching assistants via a theory-based ratings instrument, combined with consultation on instructional practices, would affect teaching practices, ratings of teaching effectiveness, and student learning and motivation. The student ratings instrument that was employed focused on a series of instructional activities derived from Gagné's theory of instruction and Reiser and Dick's instructional model. Thirty-seven teaching assistants in undergraduate computer science and chemistry courses were randomly assigned to either a feedback + consultation group or a no-feedback group. Results of this study indicated that the feedback and consultation process had a significant impact on instructional practices and ratings of teaching effectiveness. Student learning and student motivation were positively correlated with the frequency with which the various instructional activities examined in this study were utilized. Implications of these findings and suggestions for future research are discussed.     

The Impact of Student Perceptions and Characteristics on Teaching Evaluations: A case study in finance education

This study uses an ordered probit model to examine the impact of student characteristics and perceptions of the teaching evaluation process on student ratings. The results indicate that expected grade, ethnic background, gender and age are a significant influence on student ratings. A primary student-based influence on teaching evaluation performance would appear to be the perceived potential outcome of the evaluation in terms of tenure, promotion and salary decisions, and improvements in teaching and staff allocation. The impact of student perceptions and characteristics is also found to vary across the various dimensions of teaching performance with the potential bias being highest for evaluation questions relating to overall performance, and lowest for questions relating to formative assessment and deep learning outcomes.     

Errorless Discrimination of Alphabet Letters

The study attempted to determine whether general college student ratings were biased in favor of one type of instructional method or another, and what the structure of these differences was. Ratings on twenty-nine items were compared across five different methods of instruction, utilizing both univariate analyses of variance and multiple group discriminant analysis. The results indicate that the ratings for method differed in three independent ways, two of which were related to students’ perceived effectiveness of the instruction.     

Ratings of university teacher instruction: how much do student and course characteristics really matter?

Several student and course characteristics were examined in relation to student ratings of instruction. Students at a major Canadian university completed the Universal Student Ratings of Instruction instrument at the end of every course over a three‐year period, providing 371,131 student ratings. Analyses of between‐group differences indicate that students who attend class often and expect high grades provide high ratings of their instructors (p < .001). In addition, lab‐type courses receive higher ratings than lectures or tutorials, and courses in the social sciences receive higher ratings than courses in the natural sciences (p < .001). Regression analyses indicated, however, that student and course characteristics explain little variance in student ratings of their instructors (<7%). It is concluded that student ratings are more related to teaching instruction and behavior of the instructor than to these variables.     

Correlations,trends and potential biases among publicly accessible web-based student evaluations of teaching: a large-scale study of RateMyProfessors.com data

Student evaluations of teaching are widely adopted across academic institutions, but there are many underlying trends and biases that can influence their interpretation. Publicly accessible web-based student evaluations of teaching are of particular relevance, due to their widespread use by students in the course selection process and the quantity of data available for analysis. In this study, data from the most popular of these websites, RateMyProfessors.com, is analysed for correlations between measures of instruction quality, easiness, physical attractiveness, discipline and gender. This study of 7,882,980 RateMyProfessors ratings (from 190,006 US professors with at least 20 student ratings) provides further insight into student perceptions of academic instruction and possible variables in student evaluations. Positive correlations were observed between ratings of instruction quality and easiness, as well as between instruction quality and attractiveness. On average, professors in science and engineering disciplines have lower ratings than in the humanities and arts. When looking at RateMyProfessors as a whole, the effect of a professor’s gender on rating criteria is small but statistically significant. When analysing the data as a function of discipline, however, the effects of gender are significantly more pronounced, albeit more complex. The potential implications are discussed.