Relationships between student perceptions of teaching behavior and learning outcomes in college biology

This study examined relationships between student perceptions of teaching behavior and learning outcomes in college biology. One-hundred one students who enrolled in an introductory college biology course reported the frequencies of 20 overt, in-class teaching behaviors exhibited by the instructor and rated the instructor on 12 measures of teaching effectiveness. Achievement tests were administered periodically throughout the two-semester time interval. A series of simple correlations between teaching behavior factors and both achievement and student ratings revealed a complex pattern of relationships. Moderately strong relationships were found between student perceptions of “information-transmitting” behaviors and achievement, while generally stronger relationships linked behavior factors with student ratings of teaching effectiveness.     

Predicting student ratings: the relationship between actual student ratings and instructors’ predictions

This study examined the relationship between student ratings and instructors’ predictions of these ratings, taking into account other instructor, student, and course characteristics. Participants in the study were 198 instructors in the School of Education at a major teacher training college in Israel. Data corresponding to one randomly selected course per instructor were collected using student and instructor questionnaires and college records. Results indicate a systematic positive relationship between instructors’ predictions and actual student ratings with respect to overall ratings and the ratings of three dimensions of teaching. Results also demonstrate a systematic trend whereby low‐rated instructors tend to overestimate their student ratings, high‐rated instructors underestimated ratings, and moderately rated instructors gave accurate predictions. Results have implications for using predictions to motivate teaching improvement.     

EDUCATIONISTS AND ACADEMICS: RATINGS OF COMMUNITY COLLEGE INSTRUCTORS

Relationships between student ratings, instructor pedagogical training, subject‐matter preparation in teaching field, and length of teaching experience were examined for community college university transfer instructors. Moderate but statistically signficant relationships were found between pedagogical training, amount of subject‐matter preparation in teaching area, and the rating subscale of Course Organization and Planning. Results indicated that students tend to give higher ratings to instructors with pedagogical training, while instructors with greater amounts of graduate‐level, subject‐matter preparation tend to receive lower ratings.     

Factorial Validity of Student Ratings of Instruction

This study tested the Systematic Distortion Hypothesis by examining the factorial validity of student ratings of university teaching. Factorial validity is defined as the degree to which covariance among judged traits resembles the actual or true covariation of observable behaviors underlying these traits. Although many studies have examined the factorial validity of ratings, results are inconsistent. The present study used a more complete methodology to address some of the limitations of previous studies. Student ratings of teaching and measurements of actual teaching behaviors were obtained for 32 instructors. Student ratings were compared to frequency counts of actual teaching behaviors obtained from videotape and to students’ similarity judgments of teacher characteristics. It was found, first, that the structure of student ratings showed a moderately strong relation to the structure of actual behaviors, and a somewhat stronger relation to the structure of conceptual associations; and second, that the effects of systematic distortion were more pronounced for low-inference student ratings than for high-inference ratings.     

Grading leniency, grade discrepancy, and student ratings of instruction

The purpose of this study was to examine how grading leniency and grade discrepancy (the difference between expected grades and deserved grades) were associated with various dimensions of student ratings of instruction. A sample of 754 undergraduate college students completed a student ratings of instruction instrument and provided responses to a number of other questions on topics such as course difficulty and workload. A series of multilevel regression analyses were conducted and results showed that an instructor's grading leniency, as perceived by students, was positively associated with student ratings on 11 of 12 dimensions of instruction examined. This finding suggests that more lenient instructors tend to receive higher student ratings. The second finding shows that grade discrepancy was negatively associated with most dimensions of instruction. This supports the self-serving bias hypothesis under attribution theory (Gigliotti & Buchtel, 1990) in that students tended to punish instructors with lower ratings when expected grades were lower than students believed they deserved, yet little evidence of a pattern of rewards existed in student ratings when students expected grades higher than they deserved.     

A path analysis of factors often found to be related to student ratings of teaching effectiveness

The relationships among several variables outside of the instructor's classroom control and student ratings of teaching effectiveness are investigated in a causal network. Student ratings are relatively independent of external variables. Students may be able to take into account more factors than generally assumed when they rate their instructors.     

Faculty ratings of course evaluation items

Instructors whose teaching was evaluated by students were given the opportunity to rate how applicable the evaluation items were to their classes. This study examined the kinds of items which instructors felt to be applicable or inapplicable, the relationships between the student ratings and the instructor applicability ratings, and the effect on an overall evaluation score of using the instructor applicability judgments as weights.Results generally support the consensus procedure of establishing rating forms; they suggest that the common criticism that faculty judgments of item applicability are influenced by anticipation of student ratings may be true for specific items and that while weighting composite evaluation scores by means of faculty applicability judgments does not affect those overall scores, the distributions of certain items may be altered.     

Student task involvement in activity oriented science

The focus of this investigation was on relationships between teaching behaviors and student engagement in 13 middle school science classes. The results indicated that seven managerial variables and four instructional variables were significantly related to student engagement rates. Also the types of tasks allocated by teachers in science lessons were significantly related to the types of tasks undertaken by students. A canonical correlation analysis indicated significant relationships between three allocated task dimensions and three student engagement dimensions. Although teachers allocated adequate time for students to engage in investigation planning, data collecting, and data processing, the results indicated that overt engagement was prevalent only when data were collected. Attending was the predominant type of student engagement when investigations were planned and data were processed. The percentage of student time on task was approximately 63%. Rates of student off task behavior tended to be consistently high across all types of allocated tasks.     

Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses

In this study we investigate the underlying relational structure between student evaluations of teaching effectiveness (SETEs) and achievement of student learning outcomes in 116 business related courses. Utilizing traditional statistical techniques, a neural network analysis and a Bayesian data reduction and classification algorithm, we find little or no support for the validity of SETEs as a general indicator of teaching effectiveness or student learning. In fact, the underlying structure appears to be non-linear and possibly negatively bimodal where the most effective instructors are within the middle percentiles of student course ratings, while instructors receiving ratings in the top quintile or the bottom quintile are associated with significantly lower levels of student achievement.     

Student ratings and various instructional variables from a within-instructor perspective

The relationship between class size, instructional method, course level, reason for enrollment, and student ratings of instruction was assessed from a within-instructor perspective. Two hundred fifty-four pairs of courses taught by the same instructor were correspondingly identified and subjected to a stepwise multiple regression procedure. Only class size was found to be a significant predictor of ratings once individual differences between instructors were controlled, hence underlining the importance of (1) taking cognizance of the size of the course when using student ratings of instructors as a measure of teaching effectiveness, and (2) controlling for systematic variation due to instructor idiosyncracies in instructional research.     

Interpreting Students' Course Evaluations

Student evaluation of courses and instructors are accorded an important role in schools of social work in relation to educational planning and faculty promotion, tenure and salary decisions. This study examined the dimensions underlying student rating to aid in the interpretation of student judgements of teaching effectiveness. Exploratory factor analyses identified three dimensions of teaching effectiveness: Instructional Merit or Skill; Evaluation Process or Feedback; and Course Value and Content. Implications of the factor structure for social work education are discussed.     

Teaching Effectiveness: The relationship between reaction and learning evaluation criteria

This study used a pre/post design to assess student learning for the purposes of examining relationships among student grades, student learning, and student evaluations of teaching. These relationships were reframed in terms of reaction (Level I) and learning (Level II) evaluation criteria. Participants were 652 undergraduate students enrolled in seven sections of an introductory psychology course. Our results indicated a medium relationship between student grades and the pre/post learning measure. In addition, a small relationship was observed between student ratings of teaching effectiveness and a pre/post measure of learning. We conclude that student ratings and learning measures assess different aspects of teaching effectiveness and should not be used interchangeably. The most appropriate criterion for assessing teaching effectiveness is a function of the goal of evaluation. However, reaction and learning measures may be used in conjunction to obtain a more complete picture of instructor effectiveness.     

Comparing student,instructor, classroom and institutional data to evaluate a seven-year department-wide science education initiative

We compared seven unrelated data-sets to evaluate a major education improvement initiative. Perceptions of students in 54 course sections were surveyed regarding the helpfulness of 39 specific teaching or learning strategies, and relative workloads and enthusiasm were compared to their other courses. Classes were observed using an established protocol, instructors completed a teaching practices inventory, and their experience with evidence-based pedagogies was established. A graduation exit survey provided longitudinal indications of changes prior to the study, and institutional student ratings of instruction were obtained. This study sought to determine whether improvements were consistently revealed by these data, how perceptions depended upon class size, course improvement model and instructor experience, and whether student ratings captured consistent perceptions about effectiveness. Overall, results compared favourably. Student perceptions and observed effectiveness depended mainly upon class size and improvement strategy. Students found experiences more effective in courses taught by experienced instructors and in classes observed to be more active. Relative workloads were not correlated with any measure of effectiveness while relative enthusiasm was higher in courses perceived to be more effective. Student ratings were consistent with other data-sets, although they did not provide information specific enough for informing further improvements.     

Interfaculty differences in classroom teaching behaviors and their relationship to student instructional ratings

This study tested for differences between instructors in three college faculties in the frequency with which they exhibited various classroom teaching behaviors, and in the correlation of these behaviors with perceived teaching effectiveness. Trained observers assessed the frequency of 95 classroom teaching behaviors shown by 124 teachers in the arts and humanities, the social science, and the natural science faculties. Teaching effectiveness was measured by formal end-of-term student ratings averaged over a three-year period. Behaviors reflecting interpersonal orientation occurred more frequently in arts and social science teachers than in natural science teachers, whereas behaviors reflecting task orientation occurred more frequently in natural and social science teachers than in arts teachers. However, the pattern of correlations between teaching behaviors and overall effectiveness ratings was quite similar in all three faculties. Results are discussed in terms of understanding, evaluating, and improving college teaching.     

Ratings of university teacher instruction: how much do student and course characteristics really matter?

Several student and course characteristics were examined in relation to student ratings of instruction. Students at a major Canadian university completed the Universal Student Ratings of Instruction instrument at the end of every course over a three‐year period, providing 371,131 student ratings. Analyses of between‐group differences indicate that students who attend class often and expect high grades provide high ratings of their instructors (p < .001). In addition, lab‐type courses receive higher ratings than lectures or tutorials, and courses in the social sciences receive higher ratings than courses in the natural sciences (p < .001). Regression analyses indicated, however, that student and course characteristics explain little variance in student ratings of their instructors (<7%). It is concluded that student ratings are more related to teaching instruction and behavior of the instructor than to these variables.     

REFLECTIONS OF COMMUNITY-COLLEGE STUDENTS REGARDING MENTEE/INSTRUCTOR TEACHING AND LEARNING EFFECTIVENESS

This investigation used data collected from students who assessed their instructors' teaching and learning effectiveness. Instructors were community-college career and technical-education faculty enrolled in the Community College Induction Mentoring Program (CCIM), a jointly sponsored program between Iowa State University and the instructors' respective community colleges. These new faculty were involved in a structured mentor/mentee program in which the mentor was involved in a 1-day mentor training program. The mentor/mentee relationship was designed around annual goals with an action plan developed, executed, and assessed for each goal. One component of the mentor/mentee program involved documentation of an effectiveness plan, including students' perception of their mentored-instructors' teaching and, as a consequence, their own learning effectiveness. Students were asked to complete an evaluation instrument comparing their “reactions” and “learning” in classes taught by mentored instructors enrolled in the CCIM program relative to other nonmentored instructors. A total of 9 hypotheses provided the direction of the research. Student ratings were typically higher for new instructors who received peer mentoring. Mentees and mentors consistently reported a high level of satisfaction about their partnership. Supervisors voiced strong support for the program. This paper shares student survey results of mentee/instructor teaching and student learning effectiveness.     

Student knowledgeability,student sex,class size,and class level: Their interactions and influences on student ratings of instruction

Student knowledgeability, class size, and class level were found to significantly influence students' ratings of instruction. In general, the more knowledgeable the student in an area, the higher his ratings of courses and instructors in that area. Also, large courses and advanced courses were most highly rated by students. The effect of student sex on student ratings of instruction varied as a function of the particular aspect of instruction being evaluated. Significant interactions among the four main effects were also found across the judgmental dimensions students utilized in evaluating instruction, as assessed by factor analysis. Student knowledgeability and class size were found to be the main predictors of student ratings on these dimensions.     

Effects of a Theory-Based Feedback and Consultation Process on Instruction and Learning in College Classrooms

This study examined how midterm student ratings feedback provided to teaching assistants via a theory-based ratings instrument, combined with consultation on instructional practices, would affect teaching practices, ratings of teaching effectiveness, and student learning and motivation. The student ratings instrument that was employed focused on a series of instructional activities derived from Gagné's theory of instruction and Reiser and Dick's instructional model. Thirty-seven teaching assistants in undergraduate computer science and chemistry courses were randomly assigned to either a feedback + consultation group or a no-feedback group. Results of this study indicated that the feedback and consultation process had a significant impact on instructional practices and ratings of teaching effectiveness. Student learning and student motivation were positively correlated with the frequency with which the various instructional activities examined in this study were utilized. Implications of these findings and suggestions for future research are discussed.     

Students' evaluation and instructors' self-evaluation of university instruction

The purpose of the study was to investigate the relationship between students' evaluations of university instruction and self-ratings of instructors. The sample consisted of 52 instructors, from the School of Education at Tel-Aviv University, who taught 93 classes. The instructors, as well as their students, responded to a 20-item instructional-practices questionnaire. Instructor self-ratings had only a modest relationship with the ratings given by students (a median correlation of .28). Discrepancies between instructor ratings and ratings given by the students were further analyzed for (1) varying training in teaching - no difference was found; and (2) number of years of teaching experience - differences were noted; the self-ratings of less experienced instructors were closer to student ratings.