Student Ratings and Professor Self-Ratings of College Teaching: Effects of Gender and Divisional Affiliation

Twenty female and 23 male professors at a liberal arts college participated along with their 803 undergraduate students in a questionnaire study of the effects of professor gender, student gender, and divisional affiliation on student ratings of professors and professor self-ratings. Students rated their professors on 26 questions tapping five teaching factors as well as overall teaching effectiveness. Professors rated themselves on the same questions as well as on nine exploratory ones. On student ratings, there were main effects for both professor gender (female professors were rated higher than male professors on the two interpersonal factors) and division (natural science courses were rated lowest on most factors). These patterns were qualified by significant interactions between professor gender and division. Although professor self-ratings varied by division, there were few significant correlations between professor self-ratings and students' ratings. Implications for future research are discussed.Appreciation goes to Laura Capotosto and Julie Phelan for their research assistance.Suzanne Montgomery is now at Widener Law School, Philadelphia, PA, USA.     

Behavioral dimensions associated with students' global ratings of college professors

Several studies suggest that competence in one's field is the principal determinant of students' global ratings of college professors. Other studies find the professor's empathy toward students and considerate and concerned treatment of students to be the principal determinants of overall ratings. This research finds the consideration-concern dimension to be the best single predictor of global ratings of professors. However, interactions of organization-competence and consideration-concern dimensions of performance were more highly related to overall ratings than either variable analyzed by itself.     

LEISURE AND THE RETIRED PROFESSOR: OCCUPATION MATTERS

ABSTRACT

Little attention has been given to the leisure activities of retired professors, whose activity patterns in retirement may be different from those of other occupational groups because of their lifetime commitment to work. This interview study uses both quantitative and qualitative data to investigate: (a) the leisure and professional activities of retired professors; (b) the anticipated leisure activities of older employed professors; and (c) the relationship between sociodemographic factors and leisure activities of professors in retirement. Respondents were 54 retired (response rate 83%) and 17 employed (response rate 94%) professors aged 70–74 from a major research university. Content analysis of the tape-recorded open-ended questions indicated that volunteer activity, travel, exercise or sports, and work around the house or garden were the most commonly described leisure activities of retirees. A large majority of retirees (70%) also continued professional activities. Travel and exercise or sports were the most frequently planned activity for employed respondents. Correlational analysis revealed little relationship between sociodemographic factors and leisure activities in retirement. Implications for retirement education and leisure programming are discussed.     

Meta-analysis of faculty's teaching effectiveness: Student evaluation of teaching ratings and student learning are not related

Student evaluation of teaching (SET) ratings are used to evaluate faculty's teaching effectiveness based on a widespread belief that students learn more from highly rated professors. The key evidence cited in support of this belief are meta-analyses of multisection studies showing small-to-moderate correlations between SET ratings and student achievement (e.g., Cohen, 1980, Cohen, 1981; Feldman, 1989). We re-analyzed previously published meta-analyses of the multisection studies and found that their findings were an artifact of small sample sized studies and publication bias. Whereas the small sample sized studies showed large and moderate correlation, the large sample sized studies showed no or only minimal correlation between SET ratings and learning. Our up-to-date meta-analysis of all multisection studies revealed no significant correlations between the SET ratings and learning. These findings suggest that institutions focused on student learning and career success may want to abandon SET ratings as a measure of faculty's teaching effectiveness.     

福建教会大学出版活动探析——以福建协和大学为例

1916年创办的福建协和大学始终重视出版发行专著、小册子和报刊等各类文献。协大教授所撰写的学术专著是其主要出版物,这些专著不仅是协大学术研究成果,而且还代表着中国某一学术领域的最高水平。此外,协大出版了大量的报刊,其中,约占总数30%的报刊为学术期刊,因而“颇受国内教育界的欢迎”。协大出版物的著述者不再是一心传播福音的神职人员,而是以郑作新等为代表的大学教授与接受现代知识教育的学生。由于教会大学出版物的世俗化,所以,其影响范围较之其他教会出版物更为广泛。     

An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com

The present article examined the validity of public web‐based teaching evaluations by comparing the ratings on RateMyProfessors.com for 126 professors at Lander University to the institutionally administered student evaluations of teaching and actual average assigned GPAs for these same professors. Easiness website ratings were significantly positively correlated with actual assigned grades. Further, clarity and helpfulness website ratings were significantly positively correlated with student ratings of overall instructor excellence and overall course excellence on the institutionally administered IDEA forms. The results of this study offer preliminary support for the validity of the evaluations on RateMyProfessors.com.     

The impact of individual consultation on student ratings of teaching

Abstract

The present study addressed the impact of individual consultation on teaching improvement as measured by changes in student ratings. Subjects included 91 professors who presented naturally for individual consultation services over a seven‐year period at the teaching centre of a Canadian university. Interventions by the consultant fell into three categories: 1) Feedback‐Consultation, 2) Feedback‐Consultation‐Class Observation, and 3) Feedback‐Consultation‐Class Observation and Student Consultation. End of term student ratings for the course that was the subject of the consultation were compared with student ratings for the same course taught between one and three years prior to the consultation service, and for the same course taught between one to three years following consultation. The results showed that, overall, consultation was effective in improving the quality of the consultees’ teaching, as evidenced by an increase in mean student ratings of instruction. This effect persisted post consultation. Not all intervention groups, however, showed the same pattern of results. Change was evident immediately after the intervention except in the case of brief consultation, although follow‐up data showed improved teaching for the latter group. Control data provided evidence that the change in student ratings post consultation could reasonably be attributed to consultation effects.     

Single comments or average ratings: which elements of RateMyProfessors.com™ shape university students’ judgments and course choice intentions?

The use and abuse of course and lecturer rating websites such as RateMyProfessors.com? is a highly relevant topic for universities’ evaluation and assessment policies and practice. However, only a few studies have paid attention to the actual influence of teaching evaluation websites on the students themselves—that is, their perceptions of a certain course and their course choice intention at university. Findings point to the fact that positive comments on the website about professors improve students’ evaluations. However, professor evaluation websites contain two types of information: single student comments and average ratings. Research on exemplification effects has shown that single cases often have a stronger influence on recipients than more valid base rate information. We test this assumption in an experiment (n?=?126) using a professor evaluation website stimulus. Results show that single comments strongly influence opinions and course choice intentions but that they are moderated by the valence of the average rating.     

Student evaluation: The faculty responds

Results are presented of a survey of faculty members concerning their observations and opinions about the effects of student evaluation of instruction in a university where this practice had been a mandatory requirement for personnel evaluation purposes for several years. The respondents reported a definite reduction in morale and job satisfaction, changes in various instructional practices—mainly reduced course work demands on students and the occurrence of counterproductive actions as a result of this policy. Only limited expectations of improved ratings were indicated. There was also a clear division of opinion about the use of SEI ratings for personnel decisions that corresponded mainly with judgments about the validity of the ratings students provide.     

Improving instruction of veteran physics professors

In spite of the abundance of publications describing university faculty development programs and activities, little is known about the effectiveness of such programs on specific disciplines or subject areas. The fact that differences have been identified in the dimensions on which students of different university departments rate their teachers suggests that instructors of different departments need different types of programs for teaching improvement. This article describes a study that has looked into methods for improving instruction of university physics full professors with many years of teaching experience. Two methods for this aim were examined for effectiveness: a workshop and individualized consultation, both augmenting students' midterm ratings of their instructors. Analysis of pre- and postworkshop questionnaires reveals impressive improvement on the majority of items, particularly those of specific teaching techniques discussed in the workshop, but not on the global ratings of the teacher. The special consultation procedure has been shown to bring about substantial increase on overall teaching performance. We conclude that veteran teachers are often unable to improve significantly their overall teaching performance when provided with midterm feedback from students' questionnaires or when participating in a workshop for teaching improvement. Improving their instruction requires substantial and continuous expert consultation as well as investing substantial time and efforts of their own.     

Correlations,trends and potential biases among publicly accessible web-based student evaluations of teaching: a large-scale study of RateMyProfessors.com data

Student evaluations of teaching are widely adopted across academic institutions, but there are many underlying trends and biases that can influence their interpretation. Publicly accessible web-based student evaluations of teaching are of particular relevance, due to their widespread use by students in the course selection process and the quantity of data available for analysis. In this study, data from the most popular of these websites, RateMyProfessors.com, is analysed for correlations between measures of instruction quality, easiness, physical attractiveness, discipline and gender. This study of 7,882,980 RateMyProfessors ratings (from 190,006 US professors with at least 20 student ratings) provides further insight into student perceptions of academic instruction and possible variables in student evaluations. Positive correlations were observed between ratings of instruction quality and easiness, as well as between instruction quality and attractiveness. On average, professors in science and engineering disciplines have lower ratings than in the humanities and arts. When looking at RateMyProfessors as a whole, the effect of a professor’s gender on rating criteria is small but statistically significant. When analysing the data as a function of discipline, however, the effects of gender are significantly more pronounced, albeit more complex. The potential implications are discussed.     

Relationships between colleague ratings and faculty compensation

Rankings of graduate and professional programs have become commonplace since Cartter's study for the American Council on Education was published in 1966. Much of the research up to the present has focused on discovering proxy variables, such as departmental size, which correspond to departmental ratings, as well as observing how the ratings of departments change over time. This study examines the relationship between the peer ratings reported by Roose and Andersen in 1970 and resource allocation patterns, represented by average salary figures, among fifty major American universities. It also shows the relationship of these ratings and other resource allocation measures within one of the fifty institutions. Results indicate that among the fifty universities, average salaries are higher at the highly rated institutions than at the lower rated ones, with senior professors being the chief beneficiaries of the higher wage scales. Similarly, within one institution the senior professors of higher ranked departments are better paid, compared to their junior colleagues, than those of lower rated departments. The higher rated departments share commonalities as to proportion of senior professors and teaching load assignments as well. Both across and within universities, departments found to be prestigious by Roose and Andersen do tend to exhibit common characteristics concerning resource allocation procedures.Presented at the Annual Forum of the Association for Institutional Research, Houston, Texas, May 1978.     

The Effects of Different Instructions on Student Ratings of University Courses and Teachers

Abstract

The purposes of the present study were to investigate the influence of three sets of instructions, class level, and academic rank on teacher/course evaluation by student raters. Students did not differ in their teacher/course evaluation ratings when the instructions specified the evaluation results would be used: (a) only by the instructor, (b) by the administration, or (c) by students for course selection purposes. The evaluation of graduate courses did not differ from that of undergraduate courses. A statistical difference was found between the academic ranks examined. Specifically, graduate teaching assistants received higher ratings than did either assistant or full professors.     

The Educational Achievement of Pupils in Differentiated and Undifferentiated Groups

Responses on a Likert-type instrument, the Eight College Professors (Form B), from 664 education juniors and seniors in five small colleges were analyzed to examine the preferential rankings given four types of social science professors as an instructor. While some suggestive variations were observed, the overall order of preference was Teacher—Socialite—Researcher—Administrator (the least preferred) . This was in contrast to earlier findings on university students who placed Researcher ahead of Socialite. Female professors were consistently less preferred to male professors by college students of both sexes.     

Jesuit promotion of social justice. Social justice action at Jesuit universities in Spain,as assessed by teaching and research staff

A substantive and differentiating element of the Jesuits’ university paradigm is the promotion of social justice. The results of a telephone poll conducted amongst professors and researchers convey the initiatives to further social justice that Jesuit universities in Spain have been carrying out primarily since the 1990s. Although still a limited presence, respondents largely favour continuing said initiatives.     

Authority,The Autonomy of The University,and Neoliberal Politics

Zdenko Kodelja's purpose in this essay is not to give a comprehensive explanation of the impact of neoliberal ideas and politics on authority (in all of its forms) of universities and their professors. His aims are much more modest: to sketch a theoretical framework for better understanding what the essence of authority is; to show that the relation between authority and trust is the key to explaining the effect of neoliberal politics on the authority of the university and university professors; to discuss professors' autonomy as deriving primarily from epistemic authority and to point out that what makes professors epistemic authorities is not the truth of what they say, but rather the students' belief that it is true; and to disclose some problems related to authority, university autonomy, and neoliberal politics.     

Horizons,not Boundaries,are the Language of Retirement: Sense of Fulfillment,Fears, and Life Trajectories of Faculty Extendees in the Philippines

This qualitative study probed into (a) the sense of fulfillment, (b) fears and anxieties, and (c) life trajectories of aged working professors recruited from one comprehensive university in the Philippines. Interestingly, findings of the study reveal that respondents were fulfilled and felt successful through the life outputs of their students; their self-worth was witnessed through continued employment and communication to students of ideas, work ethic, and values. Fears and anxieties were rarely felt because of religious commitments and prayers to God. Sense of delight was manifested through the satisfactory academic environment; the possession of supportive systems, including family, friends and community, and their plans of spending their remaining years with the family in leisure activities; and in joining religious organizations.     

Inequity as a Source of the Cultural Gap in an Urban School-University Collaborative

Based on a 5-year naturalistic evaluation of an urban university-school collaborative that focused on preparing teachers for urban schools, this analysis was initiated to determine to what extent inequalities between the university and school personnel mitigated the attainment of intended outcomes. Results indicated that some positive change occurred, such as professors and teachers learning to speak the same language on instructional teams, which led to improved field experiences for students. However, cultural differences with concomitant inequities between school and university personnel prevented more permanent change. Inequities of power were inadvertently written into the proposal and were exacerbated at two levels: (1) the collaborative policy board, in which districts, due to larger representation, wielded greater power over budget and hiring in the collaborative; and (2) instructional teams where professors wielded power over several teachers with resistance from teachers. By the end of 5 years, the funded portion of the urban teacher education program that included a collaborative policy board and instructional teams had fallen mostly by the wayside. Cooperation between professors and teachers reverted to precollaborative levels with only loose coupling remaining. Preservice students continue to do field experiences in the professional development schools under supervision. The university education unit recognized the benefits, but continues to struggle with how to revive the level of cooperation that began with the urban program and to create long term partnerships that go beyond mere placement of students into the field.     

Does the relationship between student ratings of course easiness and course quality vary across schools? The role of school academic rankings

Student ratings of teaching effectiveness are widely used to make judgments of faculty teaching performance. Research, however, has found that such ratings may not be accurate indicators of teaching performance because they are contaminated by course easiness. Using student ratings of 9855 professors employed at 79 different colleges and universities, the author hypothesized and found that the relationship between perceived course easiness and perceived course quality was moderated by school academic rankings. More specifically, easiness ratings were more strongly correlated with quality ratings among low‐ranked schools than among high‐ranked schools. Furthermore, the easiness–quality relationship was slightly stronger among public schools than among private schools. The article concludes by discussing the practical implications of these findings.