The meaning of student engagement and disengagement in the classroom context: lessons from organisational behaviour

Despite the popularity of student engagement and, by association, student disengagement, the academic literature is unclear about the meaning of these terms. This review extends existing conceptual studies of student engagement by offering clear definitions and conceptualisations of both student engagement and disengagement in the classroom context. To develop these conceptualisations, the present review draws upon organisational behaviour theory on work engagement and disengagement because the literature in this discipline is notably more refined than in educational research. Using an organisational behaviour backdrop, student engagement and disengagement are defined by the degree of students’ activation and pleasure. In order to operationalise student engagement, measures that are aligned with the proposed conceptualisation are recommended. Recommendations are also suggested for the development of a measure of student disengagement. The proposed measurement of student engagement and disengagement should provide a unified direction for future empirical research on these topics.     

Student perception of instructors: the effect of age,gender and political leaning

Abstract

Students were asked to rank instructors, who differed by age, gender and political leaning, by their expected helpfulness, and how much a student expected to learn. Students selected older instructors as those from whom they would learn the most, but chose young instructors as the most helpful. Overall, male instructors were preferred over female instructors, especially when emphasis was placed on learning. The political leaning of the instructor was a discriminating factor in humanities classes, with liberal instructors preferred over conservatives. The preferred age, gender and political leaning patterns were distinctly different for instructors who were helpful, and from those from whom students thought they would learn the most, indicating a dichotomy between perceived helpfulness and learning. The stereotypic images of instructors did not differ significantly by the students’ own gender and academic major, except for male students ranking conservative instructors higher than females. Students do have stereotypical images of instructors based on the instructor’s age, gender and political leaning.     

Comparing student,instructor, classroom and institutional data to evaluate a seven-year department-wide science education initiative

We compared seven unrelated data-sets to evaluate a major education improvement initiative. Perceptions of students in 54 course sections were surveyed regarding the helpfulness of 39 specific teaching or learning strategies, and relative workloads and enthusiasm were compared to their other courses. Classes were observed using an established protocol, instructors completed a teaching practices inventory, and their experience with evidence-based pedagogies was established. A graduation exit survey provided longitudinal indications of changes prior to the study, and institutional student ratings of instruction were obtained. This study sought to determine whether improvements were consistently revealed by these data, how perceptions depended upon class size, course improvement model and instructor experience, and whether student ratings captured consistent perceptions about effectiveness. Overall, results compared favourably. Student perceptions and observed effectiveness depended mainly upon class size and improvement strategy. Students found experiences more effective in courses taught by experienced instructors and in classes observed to be more active. Relative workloads were not correlated with any measure of effectiveness while relative enthusiasm was higher in courses perceived to be more effective. Student ratings were consistent with other data-sets, although they did not provide information specific enough for informing further improvements.     

新建本科院校学生网上评教活动影响因素研究

运用问卷调查法,对影响新建本科院校学生网上评教活动的评教态度、评教心理等因素进行了调查。结果表明:学生评教态度对网上评教活动的影响各年级之间差异较大,而学生评教心理对网上评教活动的影响各年级之间没有明显差异。     

高校公共体育课学生评教若干问题及对策研究

随着高校教学民主化的发展,通过学生评教来确保公共体育课教学质量的提高已成为高校体育教学管理的重要措施。本研究对高校公共体育课中学生评教现象进行反思,在肯定学生评教积极作用的同时,分析了开展学生评教后随之而来消极影响,提出了规范学生评教的若干建议。     

Long-term stability of students' evaluations: A note on Feldman's “consistency and variability among college students in rating their teachers and courses”

Feldman (1977), reviewing research about the reliability of student evaluations, reported that while class average responses were quite reliable (.80s and .90s), single rater reliabilities were typically low (.20s). However, studies he reviewed determined single rater reliability with internal consistency measures which assumed that differences among students in the same class (within-class variance) were completely random—an assumption which Feldman seriously questioned. In the present study, this assumption was tested by collecting evaluations from the same students at the end of each class and again one year after graduation. Single rater reliability based upon an internal consistency approach (agreement among different students in the same class) was similar to that reported by Feldman. However, single rater reliability based upon a stability approach (agreement between end-of-term and follow-up ratings by the same student) was much higher (medianr=.59). These results indicate that individual student evaluations were remarkably stable over time and more reliable than previously assumed. Most important, there was systematic information in individual student ratings—beyond that implied by the class average response—that internal consistency approaches have ignored or assumed to be nonexistent.     

Academics' resistance to summative peer review of teaching: questionable rewards and the importance of student evaluations

This study draws from 30 semi-structured interviews with tenure-track faculty members in a research-intensive university to examine their lack of engagement in the summative peer review of teaching. Findings indicate that most academics in the study do not think peer review outcomes contribute meaningfully to decisions about career advancement and believe that, in comparison, student evaluation of teaching scores matter more. The findings suggest that faculty member resistance to summative peer reviews will persist unless academics are confident that the results will be seriously considered in decisions about tenure and promotion. This article also contends that senior administrators should provide further clarity about the purpose and use of peer review outcomes in high-stakes career decisions.     

Advancing text-analysis to tap into the student voice: a proof-of-concept study

Abstract

Student evaluations of teaching and courses (SETs) are part of the fabric of tertiary education and quantitative ratings derived from SETs are highly valued by tertiary institutions. However, many staff do not engage meaningfully with SETs, especially if the process of analysing student feedback is cumbersome or time-consuming. To address this issue, we describe a proof-of-concept study to automate aspects of analysing student free text responses to questions. Using Quantext text analysis software, we summarise and categorise student free text responses to two questions posed as part of a larger research project which explored student perceptions of SETs. We compare human analysis of student responses with automated methods and identify some key reasons why students do not complete SETs. We conclude that the text analytic tools in Quantext have an important role in assisting teaching staff with the rigorous analysis and interpretation of SETs and that keeping teachers and students at the centre of the evaluation process is key.     

Meta-analysis of faculty's teaching effectiveness: Student evaluation of teaching ratings and student learning are not related

Student evaluation of teaching (SET) ratings are used to evaluate faculty's teaching effectiveness based on a widespread belief that students learn more from highly rated professors. The key evidence cited in support of this belief are meta-analyses of multisection studies showing small-to-moderate correlations between SET ratings and student achievement (e.g., Cohen, 1980, Cohen, 1981; Feldman, 1989). We re-analyzed previously published meta-analyses of the multisection studies and found that their findings were an artifact of small sample sized studies and publication bias. Whereas the small sample sized studies showed large and moderate correlation, the large sample sized studies showed no or only minimal correlation between SET ratings and learning. Our up-to-date meta-analysis of all multisection studies revealed no significant correlations between the SET ratings and learning. These findings suggest that institutions focused on student learning and career success may want to abandon SET ratings as a measure of faculty's teaching effectiveness.     

The relationship between student understanding,satisfaction and performance in an Australian engineering programme

It has often been suggested that actual or anticipated final grades may influence the ratings given by students in student experience surveys but few studies have been able to test this using actual grades. A study was carried out involving six courses over all four year levels of an undergraduate engineering programme, where students were asked to identify themselves in an experience survey by providing their student ID on the survey form. The aim of the study was to investigate a number of questions related to the readiness of students to identify themselves, and to examine any correlation between final examination grades, ratings of student satisfaction and the students’ perception of their level of understanding of material in their courses. Students were discovered to have a poor idea of how well they understand the concepts presented in their courses. This lack of an accurate idea of their own understanding is particularly important because ‘student understanding’ correlated to the ratings they gave to the course. Ratings were largely unaffected by final marks but students who gave their ID outperformed those who did not in end‐of‐year examinations. Higher year level students were more inclined to identify themselves and ratings tended to increase with year level.     

浅析我国高校目前学生评教存在的问题及对策

学生评教是学生对教师教学效果和教学质量的一种评判,分析高校学生评教存在的一些问题,讨论教学对评教结果的应对以及管理者对评教制度的设计,提出优化和完善学生评教体系,构建科学有效的高校学生评教体系。     

Student perception of teaching effectiveness: development and validation of the Evaluation of Teaching Competencies Scale (ETCS)

A major criticism of student evaluations of teaching is that they do not reflect student perspectives. Using critical incidents job analysis, students identified nine teaching effectiveness competencies: communication, availability, creativity, individual consideration, social awareness, feedback, professionalism, conscientiousness and problem‐solving. The behaviourally anchored Evaluation of Teaching Competencies Scale is a highly reliable (alpha = .94), unidimensional measure that correlated strongly with an instructor‐related composite of the Students’ Evaluation of Educational Quality (SEEQ, r = .72), but not to a SEEQ composite related to instructor assigned work (r = .04, N = 195). The results are discussed in the context of other measures of teaching effectiveness and transformational leadership theory.     

Pre‐twentieth century literature in the Year 9 classroom: Student responses to different teaching approaches

This article arises from an action research investigation that sought to understand the ways in which different approaches to teaching pre‐twentieth century literature in Year 9 English lessons might influence students’ experiences of texts. It examines the proposition that some students need to have a secure understanding of the text before they can benefit from more creative approaches which require them to undertake independent and personal responses. Although creative methods of teaching are often posited as being superior to more teacher‐led approaches, student responses suggest that requiring them to participate in creative activities as a means of exploring an unfamiliar text without first ensuring they have a solid understanding of the overarching narrative and a good grasp of unknown language can lead to resistance and disengagement. In this case study, some students benefited from and appreciated a structured approach that included more ‘traditional’ methods of teaching pre‐twentieth century literature, which they said helped them to learn more effectively.     

Teaching,learning, and evaluating: handwriting in Uruguayan public elementary schools in the 1830s

Abstract

This article examines the Uruguayan state approach to the teaching of writing in public elementary education during the 1830s, and is an attempt to explain why state officials advanced new pedagogical methods aimed at increasing rationalisation and standardisation. While many different handwriting styles existed in the past, the school system simplified and standardised public education under a single cursive style, the English round-hand. Notwithstanding the state’s standardising directives, Uruguayan teachers combined the pedagogical innovations of Lancaster’s monitorial system with the calligraphic traditions of the old writing masters. According to personal preference and necessity, teachers devised a hybrid system, which implemented new dictation exercises and the use of the writing slate, but preserved the writing masters’ imitation of muestras, and the use of quill, ink, and paper. The government arranged an inventive procedure to accurately measure students’ handwriting performance. The planas, or samples of students’ handwriting, were useful tools in the standardisation and evaluation of public education. Elementary schools from all over the country forwarded handwriting samples to the central state, or exhibited them in public examination ceremonies, as teachers publicised pedagogical success, and state officials confirmed the general advancement of public education. This study is also an attempt to show that the teaching of writing was part of a greater pedagogical mission and nation-building project: the intentional departure from colonial corporate identities, and the construction of a national community conceived as the sum of its individual citizens.     

Digital natives and digital media in the college classroom: assignment design and impacts on student learning

The use of multimodal learning techniques is becoming more widespread, however, the pedagogical discourse surrounding its implementation into classroom and course design is complicated as these technologies are either demonized or viewed as the panacea for curriculum ills. Educators are faced with unique challenges when investigating how to experiment with the best ways to produce classroom experiences that use digital media. This case study examines the implementation challenges and learning outcomes related to such an experiment by reviewing and assessing the use of digital media in a health communication course, specifically through the development of documentaries. Creating an effective assignment requires addressing the development of technical skills along with course content and providing guidance and feedback throughout a semester-long project. Creating an effective assignment is pointless without sufficient learning outcomes. Because this assignment engaged students with both the course content and digital media, their learning experiences were enhanced and improved their group collaboration, critical thinking and media literacy skills.     

课堂提问基本模式以及学生提问的研究现状(下)

四、促进学生课堂提问的策略1 .国内研究者促进学生课堂提问的策略1培养问题意识国内的研究者 (欧阳文 ,1 999;姚本先 ,1 995)认为 ,问题意识的培养是促进学生提问的前提。问题意识 (question awareness)是指学生在认知活动中意识到的一些难以解决的、疑虑的实际问题或理论问题时产生的一种怀疑、困惑、焦虑、探究的心理状态。这种心理状态驱使学生积极思维 ,不断提出问题。具有强烈问题意识的思维 ,体现了个体思维品质的活跃性和深刻性。而强烈的问题意识 ,又可作为思维的动力 ,促使人们去发现问题 ,解决问题。培养问题意识的可行性策略有 …     

Quality lies in the eyes of the beholder: A mismatch between student evaluation and peer observation of teaching

Abstract

The study described in this article was prompted by the poor performance of students in an ‘at risk subject’ in a science faculty at a university in South Africa. Teacher performance could contribute to poor performance among students, therefore the performance of one of the science teachers whose students were performing poorly was evaluated by his students and through peer observation of his teaching. The article draws on a merger between Bernstein's ideas on framing as well as deep and surface approaches to learning to form a theoretical framework that underpinned the study. Peer observation showed that the teacher employed predominantly teacher-centred, passive approaches to teaching, and the facilitation of active learning was minimal, that is, framing was strong. Students, however, evaluated their teacher positively, indicating that he was an ‘effective’ teacher. Therefore, the perception of what constitutes ‘quality teaching’ is viewed differently by peers and students. This is most likely due to the incompatibility between peers' conception of teaching and students' conception of learning. Therefore, students' feedback on teaching is not necessarily accurate or useful.     

信息不对称情况下的高校学生评教探析

学生评教是高校教师教学评价的重要组成部分,在国内外高校得到广泛的认可和应用.但现实中却存在着"学校重视、学生漠视、教师敏感"的情况,问题的症结可能就在于学校、教师、学生三者问存在信息不对称,导致了学生评教中出现道德风险和逆向选择.厘清评教中存在的信息不对称,采取措施有效规避显得极为重要.