Does the relationship between student ratings of course easiness and course quality vary across schools? The role of school academic rankings

Student ratings of teaching effectiveness are widely used to make judgments of faculty teaching performance. Research, however, has found that such ratings may not be accurate indicators of teaching performance because they are contaminated by course easiness. Using student ratings of 9855 professors employed at 79 different colleges and universities, the author hypothesized and found that the relationship between perceived course easiness and perceived course quality was moderated by school academic rankings. More specifically, easiness ratings were more strongly correlated with quality ratings among low‐ranked schools than among high‐ranked schools. Furthermore, the easiness–quality relationship was slightly stronger among public schools than among private schools. The article concludes by discussing the practical implications of these findings.     

Correlations,trends and potential biases among publicly accessible web-based student evaluations of teaching: a large-scale study of RateMyProfessors.com data

Student evaluations of teaching are widely adopted across academic institutions, but there are many underlying trends and biases that can influence their interpretation. Publicly accessible web-based student evaluations of teaching are of particular relevance, due to their widespread use by students in the course selection process and the quantity of data available for analysis. In this study, data from the most popular of these websites, RateMyProfessors.com, is analysed for correlations between measures of instruction quality, easiness, physical attractiveness, discipline and gender. This study of 7,882,980 RateMyProfessors ratings (from 190,006 US professors with at least 20 student ratings) provides further insight into student perceptions of academic instruction and possible variables in student evaluations. Positive correlations were observed between ratings of instruction quality and easiness, as well as between instruction quality and attractiveness. On average, professors in science and engineering disciplines have lower ratings than in the humanities and arts. When looking at RateMyProfessors as a whole, the effect of a professor’s gender on rating criteria is small but statistically significant. When analysing the data as a function of discipline, however, the effects of gender are significantly more pronounced, albeit more complex. The potential implications are discussed.     

学生视角的教学质量评价:一个量表开发

学生究竟应从哪些方面评价课堂教学质量,这是高校教师和教学管理部门都比较关心的问题。通过对学生进行开放式调查,采集了49个评价指标,然后进行大样本量问卷调查,经过对调查数据进行统计分析,并结合专家判断,提出了一个学生视角的课堂教学质量评价量表。该量表包括教学内容、教学态度、教学效果、教学方式4个维度,共18个指标。经过分析表明,该量表具有较好的内容效度、内部一致性信度、聚合效度、区分效度和预测效度,其4个维度也较好地收敛于课堂教学质量这一构念。最后对该量表与现有文献中提出的评价指标体系进行比较,并指出该量表的可能应用之处。     

Teaching Quality After the Massification of Higher Education in Taiwan

To explore whether teaching quality was improved by the Taiwan Ministry of Education's implementation of the Teaching Excellence Program after the massification of higher education, the authors used data from a 2007 student survey to build a Teaching Quality Assessment Model to analyze university students' views of the Teaching Excellence Program's improvements in teaching, identify problems with teaching quality, and compare differences between the viewpoints of students from different backgrounds regarding teaching quality. This research from the student perspective indicates that universities receiving Teaching Excellence Program grants failed to meet the expectations of students in terms of teaching equipment, training and internships, teaching evaluation systems, graduate employment and career counseling, fair evaluation of instructors' teaching, and building a learning culture. Once universities received the teaching improvement funding, they made immediate improvements in teaching yet failed to fully meet the expectations of students. After universities expand in size, we recommend that the leadership of such universities deeply examine and establish a more comprehensive teaching quality mechanism to continuously improve teaching quality.     

Team teach with a student: A pilot study in criminal justice

In this study, criminal justice classes were team taught by six pairs of one faculty member and one student teacher. The professor-student teaching teams met together before class to plan and after class to problem solve. The student teachers were charged with helping the professors introduce active learning exercises into their classes. This article reports on survey data from these professors, student teachers and the students they taught, including their views on both the benefits and problems. The article shows professors how to team teach with a student and helps professors who want to try the approach to anticipate and minimize the problems while capitalizing on the benefits.     

Evaluating teacher performance in language learning classes: the gap between students and department administrators

ABSTRACT

Using data from multiple evaluation instruments to evaluate university teachers’ teaching quality has been popular in practice; however, the inconsistency of these evaluation results has not received sufficient attention. This study intended to fill the gap by investigating the main reasons for the discrepancy in teaching performance that resulted from student evaluation surveys and classroom observations of two administrators from the English department in one of the largest universities in Vietnam. Student evaluation surveys (n = 604) suggested that teachers performed better in activities that focused on instructional techniques than when promoting classroom interaction and student engagement. Structural equation models further showed that activities that engaged them in learning and promoted classroom interaction had a strong positive effect on their overall satisfaction with their teachers’ performances. However, interviews with administrators from the department revealed the conflicting finding that they felt that teachers whose teaching performance was less satisfactory should focus primarily on instructional techniques.     

How MOOC instructors view the pedagogy and purposes of massive open online courses

Massive open online courses (MOOCs) have proliferated in recent years despite disagreement about the role of MOOCs in higher education and whether student outcomes are satisfactory. Taking a mixed-methods approach, the current study surveys professors who have taught MOOCs (n = 162) in order to better understand how MOOCs are perceived by instructors. Professors’ backgrounds and beliefs about the role of MOOCs in higher education and their perceptions of the experiences of students are discussed. In addition, professors’ satisfaction in teaching MOOCs is reported. The study finds that most MOOC professors are experienced faculty members with relatively little prior experience teaching online, and that they are divided about the purpose of MOOCs in the institutional landscape of higher education.     

University students’ conceptions of the good teacher: A Hong Kong perspective

One way that universities assess teaching effectiveness is by eliciting student feedback. However, what standards do students themselves use to judge whether a lecturer is a ‘good’ teacher? As part of a study carried out at a Hong Kong university, students were interviewed about their first-year learning experience and asked what they felt constituted ‘good’ and “bad’ teaching. Unlike when asked to complete teacher effectiveness surveys, no criteria or characteristics were given. Responses focused primarily on teaching skills that supported student learning and encouraged critical thinking, particularly the teacher’s ability to give clear explanations supported by relevant, practical examples.     

Partners in Learning: A Grounded Theory Study of Relational Practice between Master’s Students and Professors

Meaningful academic relationships between adult master’s students and their professors can both deepen students’ learning and serve as a regenerating force for professors. This study employed grounded theory methods to explore the question, “What goes on in relational practice between master’s students and professors?” I interviewed 10 matched pairs of recent alumni and professors who identified as having “a meaningful academic relationship”. Dimensional analysis surfaced two core dimensions: reconstructing and regenerating. In reconstructing, the students’ core dimension reveals the student experience of reconstructing, or understanding more deeply, theory or one’s self. In the case of regenerating, the professor’s core dimension identifies the professors’ experience of “giving back” through their teaching and extending their professional reach by training others. These experiences serve to reinvigorate professors over the course of their careers. In addition, findings in this study resonate with sensitizing concepts including relational cultural theory and relational practice. Finally, the analysis surfaced evidence supporting authentic teaching concepts and connected these concepts to faculty and student learning partnerships.     

Student Ratings and Professor Self-Ratings of College Teaching: Effects of Gender and Divisional Affiliation

Twenty female and 23 male professors at a liberal arts college participated along with their 803 undergraduate students in a questionnaire study of the effects of professor gender, student gender, and divisional affiliation on student ratings of professors and professor self-ratings. Students rated their professors on 26 questions tapping five teaching factors as well as overall teaching effectiveness. Professors rated themselves on the same questions as well as on nine exploratory ones. On student ratings, there were main effects for both professor gender (female professors were rated higher than male professors on the two interpersonal factors) and division (natural science courses were rated lowest on most factors). These patterns were qualified by significant interactions between professor gender and division. Although professor self-ratings varied by division, there were few significant correlations between professor self-ratings and students' ratings. Implications for future research are discussed.Appreciation goes to Laura Capotosto and Julie Phelan for their research assistance.Suzanne Montgomery is now at Widener Law School, Philadelphia, PA, USA.     

‘Some people might say I'm thriving but … ’: non-traditional students' experiences of university

The expansion of neo-liberal policies' framing higher education has contributed to an increase in participation rates of students from non-traditional backgrounds. While an increase of a wider range of students might be seen as contributing to a more just and equitable higher education system, research has shown that broadening entry points does not necessarily ensure inclusion or positive experience for these students. This research investigated the experiences of first in family, rural and international students as they transitioned into their first year of university. Focus group interviews and surveys were used to collect data. Using Bourdieu's theory of field, habitus and capital as well as Weiss's dimensions of loneliness findings illuminate a number of poignant experiences for non-traditional students. We suggest that facilitating the transition for non-traditional students might require a cultural change by universities and a move away from the notion that the students need to ‘adapt’ to university. Rather, the evolving university might provide for increasingly diverse student cohorts by embracing their habitus and unique features.     

Traditional versus open university teaching methods: A cost comparison

The paper attempts to throw light on the direct (instructional) cost of OU teaching methods as against conventional “live” instruction. The variable cost per student-course is with one exception lower in the OU than elsewhere. This constitutes a strong case for the use of existing OU packages in campus universities, especially as campus universities might feel able to dispense with the costs of the summer schools. It also constitutes a case for expansion of existing courses at the OU. As regards the development of new OU packages, the paper shows the Foundation courses to be much cheaper than equivalent provision de novo at the same scale in campus universities. Measured by the breakeven number of students, second-level courses in a given faculty are cheaper than foundation level courses. But they also have fewer students and some are operating at levels which, if there were no interdependence between courses, might be considered expensive. If however they were used by more students either at the OU or at campus universities they could be economic, even when taken on their own. The paper does not cost student time but, if this is cheaper when OU teaching methods are used, this is a further argument in their favour.

     

Once good teaching,always good teaching? The differential stability of student perceptions of teaching quality

In many countries, students are asked about their perceptions of teaching in order to make decisions about the further development of teaching practices on the basis of this feedback. The stability of this measurement of teaching quality is a prerequisite for the ability to generalize the results to other teaching situations. The present study aims to expand the extant empirical body of knowledge on the effects of situational factors on the stability of students’ perceptions of teaching quality. Therefore, we investigate whether the degree of stability is moderated by three situational factors: time between assessments, subjects taught by teachers, and students’ grade levels. To this end, we analyzed data from a web-based student feedback system. The study involved 497 teachers, each of whom conducted two student surveys. We examined the differential stability of student perceptions of 16 teaching constructs that were operationalized as latent correlations between aggregated student perceptions of the same teacher’s teaching. Testing metric invariance indicated that student ratings provided measures of teaching constructs that were invariant across time, subjects, and grade levels. Stability was moderated to some extent by grade level but not by subjects taught nor time spacing between surveys. The results provide evidence of the extent to which situational factors may affect the stability of student perceptions of teaching constructs. The generalizability of the students’ feedback results to other teaching situations is discussed.     

Student plagiarism and faculty responsibility in undergraduate engineering labs

In undergraduate engineering labs, lab reports are routinely copied. By ignoring this form of plagiarism, teaching assistants and lab technicians neglect their role responsibility. By designing courses that facilitate it, however inadvertently, professors neglect their causal responsibility. Using the case of one university, we show via interviews and observation that such routine copying and faculty negligence are rampant. We suggest the latter be explicitly recognized as a cause of student dishonesty, and argue that it must be rectified before faculty earn the right to reform students. We also suggest that these findings are representative of, and therefore generalizable to, many universities’ undergraduate engineering and science labs.     

Assessing antecedents and consequences of student satisfaction in higher education: evidence from Malaysia

This paper explores the interrelationships of the key influences on student satisfaction via multivariate analysis from three groups of university students in two popular private universities in Malaysia. The correlation coefficient and structural model indicated that student satisfaction is influenced not only by academic quality, but also by the university core services, information technology services, and skill building. These dimensions are linked to one another. The strong interrelationships between these dimensions are indicative that holistic approach needs to be adopted rather than dealing with each dimension in isolation in creating a valued education. Significant performance gaps of key influences indicated that the satisfaction levels are below students’ expectation despite the satisfaction scores being above average. Academic assessment, teaching quality, and IT are areas where a university management needs to prioritize resources in order to increase student satisfaction. Students who perceived higher value are more likely to have higher repurchase intention.     

A recipe for effective participation rates for web‐based surveys

One way many universities have approached the process of better understanding and meeting the needs of their students is through student evaluations. The evaluation data provide not only diagnostic feedback but also useful information in terms of the quality of learning and teaching experiences. In an effective quality cycle, the data gathered are analysed and used to make improvements. This is often referred to as ‘closing the loop’. However, for any evaluation data to be of value an important prerequisite for ‘closing the loop’ is that response rates should be sufficiently high to be representative of the student cohort. This paper describes how a faculty within Monash University utilising only web based surveys developed a successful communication strategy to elicit staff and student participation in the unit (subject) evaluation process which achieved a response rate as high as 83.2%.     

“慕课”对地方普通本科院校的影响与教师应对

"慕课"是指"大规模在线开放课程",从兴起到现在才几年的时间就在全球快速发展起来,照此发展速度,将来地方普通本科院校可能受到较大的影响。文章从为教师提供继续学习的平台和为学生提供聆听世界级高水平教授讲课的机会两个角度分析"慕课"教学模式对于地方普通本科院校的有利之处;还从地方普通本科院校的招生数量和地方普通本科院校教师岗位的稳定性两个方面分析"慕课"教学模式可能带来的不利影响;探讨地方普通本科院校的教师应如何积极借助"慕课"平台提升和重塑自己,从而应对"慕课"教学模式可能带来的影响等问题。     

Closing the loop on student feedback: the case of Australian and Scottish universities

Universities have a long history of collecting student feedback using surveys and other mechanisms. The last decade has witnessed a significant shift in how student feedback is systematically collected, analysed, reported, and used by governments and institutions. This shift is due to a number of factors, including changes in government policy related to quality assurance, and the increased use of the results by various stakeholders such as governments, institutions, and potential students and employers. The collection, analysis, and reporting of results are systematically carried out in many institutions worldwide. However, how to use student feedback to effectively improve student learning experience remains an issue to be addressed. This paper will contribute to this debate by comparing how Australian and Scottish universities use student feedback results to inform improvements. Based on thematic analysis of external quality audit reports of all Australian and Scottish universities, this paper suggests that universities have systematic processes to collect student feedback using a range of mechanisms, but limited work is done to use the data to inform improvements. This paper argues the need for universities to genuinely listen to student voice by facilitating partnership between students and institutions to act on their feedback as part of quality assurance.     

浅谈电大发展的若干"子"课题

通过电大办学中的位子、路子、牌子、学子、班子等问题的探讨，提出“科学定位、扩大开放、彰显特色、发挥优势、保证质量、打造品牌、优质服务、名师兴校”的推进电大发展新路子。     

So how big is big? Investigating the impact of class size on ratings in student evaluation

Australian universities have a long history of use of student satisfaction surveys. Their use has expanded and purpose changed over time. The surveys are often viewed as distorted by external influences such as discipline context, class size and year level of participants. This paper reports on the results of a large-scale investigation interrogating the influence of class size on student satisfaction ratings. The investigation was conducted at a large, comprehensive, research-intensive Australian university. It drew on the data from a survey administered to all students in all units of undergraduate and postgraduate study conducted across the university over four semesters. Data were collated into four class size categories. This categorised data were subjected to statistical analyses. This paper discusses the approach taken, the results of the analysis and their implications for student evaluation of teaching and learning.