Applying the scholarship of teaching and learning: student perceptions,behaviours and success online and face-to-face

This study compares student perceptions, learning behaviours and success in online and face-to-face versions of a Principles of Microeconomics course. It follows a Scholarship of Teaching and Learning (SoTL) approach by using a cycle of empirical analysis, reflection and action to improve the learning experience for students. The online course design involves 58 interactive narrated online modules, interactive online quizzes and biweekly online meetings with the instructor via video and voice-over-IP technology. Findings indicate that schedule flexibility motivates students to choose the online course format. Students in both learning environments felt they had high-quality communication with the instructor, while online students indicated limited peer-to-peer communication. Online students report studying more at home than face-to-face students, but not enough to compensate for the time face-to-face students spend in class. Reflecting on the findings, the authors suggest actions to improve the online course experience.     

Another look at college student’s ratings of course quality: data from Penn State student surveys in three settings

This study assessed the relationships of student attributes, course characteristics and course outcomes to college students’ ratings of course quality in three types of settings. The analysis utilised data from online surveys of samples of college students conducted in 2011 and 2012 at the Pennsylvania State University. Included in the analysis were: (1) 1805 students at the main campus; (2) 1453 students at 19 smaller satellite campus locations of the university scattered across the state; and (3) 522 students participating in online degree programmes through Penn State’s World Campus. Students were asked to rate the quality of instruction they received in a randomly selected course in which they had been enrolled during the previous semester, and to respond to a number of questions about the course, the instructor’s behaviour and themselves. The relationships of these factors to how students rated the course were assessed for subjects in the three study settings. In all three settings, student and course characteristics, course difficulty and amount of required work had little effect on course ratings. Grade received was modestly related to course rating. However, instructor’s use of selected recommended pedagogical practices and students’ perceptions of how much they felt they learned were by far the strongest correlates of students’ course evaluations. Implications of these findings are discussed.     

The Relationship Between Instructor Use of Different Types of Humor and Student Interest in Course Material

The goal of this study was to research the frequency of the use of diverse types of humor in the college classroom for a possible association with student interest in course material. This relationship was studied using quantitative methods. Participants answered questions about their interest in course material and the type of humor that their instructor used in the classroom. The study involved 195 undergraduate students ranging in age from 18 to 25. A factor analysis recognized two separate types of humor (relevant/appropriate and non-relevant). The study found that both relevant/appropriate humor and non-relevant humor predicted student interest. The more relevant/appropriate humor used the more student had interest in course materials. As well, the more non-relevant humor used the less students reported interest in course materials. No differences were found between the gender of students in the classroom when examining this question of humor and interest.     

Design lessons about participatory self-directed online learning in a graduate-level instructional technology course

This article reports on a case of participatory self-directed online learning within the context of a graduate-level instructional technology course. The course was about online learning environments and relied on both asynchronous and synchronous technologies. In this case, the instructor and students engaged in collaborative course design through one of the assignments where student teams and the instructor led one week’s worth of course activities and discussions. This article begins with a discussion of the literature on participatory self-directed online learning. Then, the article presents an overview of the course design, detailed discussion of the assignment that framed student participatory self-directed learning and two examples of student assignments. The framing question for organising this case was as follows: What lessons can a team of graduate students and the instructor learn about self-directed participatory online learning from a collaborative design project? The article ends with the overall lessons learned from the case and implications to future design of online activities.     

硕士研究生培养方式的弊端及改革的几点建议

目前，我国硕士研究生教育的培养方式存在着手段异化、课程设置弹性不足、教学形式单一等弊端。为此，我们认为只有注重研究生综合素质的培养，加强课程和课堂教学改革，严格导师资格评审和履职考核制度，才能确保硕士研究生教育质量的提高。     

Validity of student self-reported ratings of learning

This study examined the relationship between individual student self-reported ratings of progress on relevant learning objectives and performance on exams administered during a college course. Across three sections of the same course taught by a single instructor, 188 students rated themselves at the end of the course on two objectives identified by the instructor as either essential or important. They also rated themselves on 10 other objectives the instructor identified as having minor or no importance. Self-ratings on course-relevant objectives correlated significantly and positively with four out of five exams and the course total, whereas ratings on irrelevant objectives did not. Students who rated their progress as either exceptional or substantial generally performed better on course examinations than those who rated their progress as moderate or less. These findings support the validity of student self-reported ratings of learning.     

Sources of variance in end-of-course student evaluations

Abstract

Evaluation of college instructors often centers on course ratings; however, there is little evidence that these ratings only reflect teaching. The purpose of this study was to assess the relative importance of three facets of course ratings: instructor, course and occasion. We sampled 2,459 fully-crossed dyads from a large university where two instructors taught the same two courses at least twice in a 3-year period. Generalizability theory was used to estimate unconfounded variance components for instructor, course and occasion, as well as their interactions. Meta-analysis was used to summarize those estimates. Results indicated that a three-way interaction between instructor, course and occasion that includes measurement error accounted for the most variance in student ratings (24%), with instructor accounting for the second largest amount (22%). While instructor - and presumably teaching - accounted for substantial variance in student course ratings, factors other than instructor quality had a larger influence on student ratings.     

Mentoring partnerships in science education

The authors use an action research (AR) approach in a collegiate studio physics class to investigate the power of partnerships via conferences as they relate to issues of establishing a student/mentor rapport, empowering students to reduce inequity, and the successes and barriers to hearing students’ voices. The graduate teaching assistant (TA, Author 1) conducted one-on-one conferences with 29 students, elicited student opinions about the progress of the course, and talked with faculty, TAs, and an undergraduate supplemental instructor for other sections of the course. At the end of the semester, the students reported increased knowledge of the TA as a person and as an instructor, and vice versa. Sixty-five percent of students reported no interest in changing circumstances to make it easier to talk about personal concerns with the TA. College students reluctantly voiced their opinions about the course, possibly due to the power structure of the classroom. Other TAs in the department expressed mostly disinterest in the project, while faculty members were interested in student learning but skeptical of student empowerment. A case study of one student is presented, wherein his attendance improved in the course and he received additional help outside class, both possibly as a result of the student/TA conferences. Students in this studio physics section were more likely to interact directly with faculty or TAs during lectures, but less likely to do so during lab sessions, than were students in a non-studio physics section.     

Content Familiarity: Differential Impact of Effective Teaching on Student Achievement Outcomes

Improving the quality of higher education for all students requires researchers to focus on factors that potentially influence learning. Of particular interest are student entry characteristics and effective teaching behaviors. Accordingly, structural equation modeling was used to examine the relationships between student differences, prior experience with the subject material, past performances, teaching behaviors, and perceived learning and achievement. A theoretical model containing 8 variables was formulated and tested on students who were either experienced or inexperienced with the course material. The data were gathered at a large midwestern university fitting the Carnegie classification as a research institution. Overall, student achievement is affected by test anxiety and high school GPA. Prior experience with the course content revealed that content-unfamiliar students' perception of learning is more positively influenced by instructor organization than by instructor expressiveness, whereas for content-familiar students, expressiveness is much more influential than organization. Additionally, content-unfamiliar students are more sensitive to both teaching behaviors than content-familiar students. These findings have important implications for administrators, instructors, and researchers.     

Effectiveness of using learner‐centered principles on student retention in distance education courses in rural schools

This article examines the effectiveness of training facilitators in secondary schools to follow APA learner‐centered principles to support learners in distance education. The study was a cluster‐randomized control trial with 36 match pairs of schools and 246 students in the rural USA. The schools were selected at random and assigned at random to treatment condition. Instructors were blind to the treatment condition as were the local facilitators and schools. Data on length of time spent in the course and whether students completed the semester were analyzed. The results indicated that students in the intervention condition completed the first semester at a statistically higher rate than control students where facilitators did not have this training. The number of weeks students remained in the course was likewise statistically different with students in the intervention condition staying in the course more weeks holding instructor constant.     

Expectancy theory outcomes and student evaluations of teaching

As student evaluation of teaching (SET) instruments are increasingly administered online, research has found that the response rates have dropped significantly. Validity concerns have necessitated research that explores student motivation for completing SETs. This study uses Vroom's [(1964). Work and motivation (3rd ed.). New York, NY: John Wiley & Sons] expectancy theory to frame student focus group responses regarding their motivations for completing and not completing paper and online SETs. Results show that students consider the following outcomes when deciding whether to complete SETs: (a) course improvement, (b) appropriate instructor tenure and promotion, (c) accurate instructor ratings are available to students, (d) spending reasonable amount of time on SETs, (e) retaining anonymity, (f) avoiding social scrutiny, (g) earning points and releasing grades, and (h) being a good university citizen. Results show that the lower online response rate is largely due to students’ differing feelings of obligation in the 2 formats. Students also noted that in certain situations, students often answer SETs insincerely.     

Online project based learning via cloud computing: exploring roles of instructor and students

This one semester case study intended to explore the roles of the instructor and students in design activities based on project based learning via cloud computing technology. Participants were 13 pre-service computer teachers enrolled in an internet programming course at faculty of education. Online course records, interviews and questionnaires were used to collect data. The data were analyzed via qualitative techniques. Results suggested that cloud computing facilitates planning, collaboration, and communication and also supports individual learning in online project based design activities. The instructor exhibited the roles of guidance, technical support, administrate and communicate. Students’ roles were found as cooperation, coordination, communication, leadership, practice, effort provide in project based activities. The results are hoped to provide insights about the roles of the instructor and students in online project based design activities. Along with the study findings, some implications were discussed for using cloud computing effectively in project based learning.     

IMPACT OF FULL-TIME VERSUS PART-TIME INSTRUCTOR STATUS ON COLLEGE STUDENT RETENTION AND ACADEMIC PERFORMANCE IN SEQUENTIAL COURSES

The primary purpose of this study was to examine the relation between full - time or part - time instructor status and college student retention and academic performance in sequential courses . Results indicate that for either developmental or regular courses, college students who take the first course in a sequence from a part - time instructor , and who take the second course in the sequence from a full - time instructor seem underprepared for the second course. By contrast to students experiencing other instructor status combinations (part - time / part - time , full - time / part - time , or full - time / full - time), these students are significantly less likely to either complete or achieve a grade of "C" or better in the second course. Sequential course instructor status, therefore, seems to be a predictor of college student success. Implications for practice pertaining to further research, college students, and institutions are discussed.     

Instructor Reputation and Student Ratings of Instruction

The purpose of this study was to examine the association between instructor reputation, as perceived by students, and student evaluations of the instructor and course. A total of 754 students from 39 classes participated in the study. Based on what students claimed to have heard about the instructor prior to enrolling in the course, they were classified into one of three groups: positive reputation, no information, and negative reputation. Using these groupings, two analyses were performed. In the first, mean overall ratings for the instructor and course were calculated and presented by class. In the second, both instructor and course ratings were modeled using multilevel regression. Results show large mean differences in both instructor and course ratings between the positive and negative reputation groups. More specifically, students who heard positive information regarding the instructor's reputation rated both the instructor and course higher than students who heard negative information about the instructor.     

Generalizability of Multidimensional Student Ratings of University Instruction Across Courses and Teachers

Course quality is multifaceted, being determined by instructor, students, and external conditions. Consequently, any attempt at measurement should reflect this diversity, so that stable evaluations can be made that reflect both personal (instructor) and situational (student and external conditions) variables. This study extends previous research by examining the stability of both dimensions across different courses, student populations, and universities. In addition, the sample (N = 692 courses) was drawn from 6 traditional and technical German universities that have a different ethos of student interaction with academic staff than those in many other Western countries. Using the Heidelberg Inventory, it was found that instructor variables were reliable across courses given by the same instructor, but student scales or background variables were less consistent across courses in which the content was identical. It was concluded that the instrument was both reliable and valid for student evaluations of both teaching performance and course quality within a European context.     

‘To go boldly’: teaching science fiction to first-year engineering students in a South African context

This paper reflects on the teaching of science fiction texts to first-year engineering students at the University of the Witwatersrand as part of a Critical Thinking course that uses literature as a vehicle through which to develop competence in critical literacy and communication. This course aims to equip engineering students, as future intermediaries between science and society, with the ability to fulfil this role in both the contemporary global world and South Africa more specifically through the imaginative inhabitation of divergent subject positions afforded by literary texts. Science fiction encourages students to engage imaginatively with various societal ideas, constructs and possibilities. One of the principles of the course is that reading facilitates empathic responses, challenging readers to inhabit unfamiliar subject positions. In this way, the teaching of science fiction aims to develop self-reflective and critical learning practices, wherein engineering students grapple with the ethical ramifications of extrapolated known science in a South African context.     

Assessment & Evaluation in Higher Education Using the margin of error statistic to examine the effects of aggregating student evaluations of teaching

We proposed an extended form of the Govindarajulu and Barnett margin of error (MOE) equation and used it with an analysis of variance experimental design to examine the effects of aggregating student evaluations of teaching (SET) ratings on the MOE statistic. The interpretative validity of SET ratings can be questioned when the number of students enrolled in a course is low or when the response rate is low. A possible method of improving interpretative validity is to aggregate SET ratings data from two or more courses taught by the same instructor. Based on non-parametric comparisons of the generated MOE, we found that aggregating course evaluation data from two courses reduced the MOE in most cases. However, significant improvement was only achieved when combining course evaluation data for the same instructor for the same course. Significance did not hold when combining data from different courses. We discuss the implications of our findings and provide recommendations for practice.     

MULTILEVEL ANALYSIS OF THE EFFECTS OF STUDENT AND INSTRUCTOR/COURSE CHARACTERISTICS ON STUDENT RATINGS

Multilevel SEM was used to examine the extent to which student, instructor, and course characteristics affect student ratings. Data were gathered from 1867 students enrolled in 117 courses at a large teacher training college in Israel. Four alternative two-level models that differ in only the nature of the relationship among interest in the course subject, expected grade, and student ratings were tested. Two of the models were judged as less appropriate, one because it failed to support the spurious relationship assumed between expected grade and student ratings, and the other on grounds of poor model-data fit. The other two models were equally good both in terms of the model-data fit and the amount of variance in student ratings that is accounted for by each of them. Both models supported the mediation effect of expected grade in the relationship between interest in the course subject and student ratings.     

Instructor–Learner Interaction in Online Courses: The relative perceived importance of particular instructor actions on performance and satisfaction

This article examines the relative perceived importance of 19 instructor actions in online courses according to both instructors and students. The instructor actions were culled from guidelines in the online learning literature base and then reviewed and rated by 14 experts. Thirty‐two online instructors and 170 students from their classes at a large public university and a private online university were asked to review and rate these guidelines. Findings show that the instructors believe that learner performance is more likely tied to instructor actions that are focused on course content and provide both proactive (models, expectations) and reactive (feedback) information to learners about their ability to demonstrate knowledge of course material, but learner satisfaction is more likely tied to learners’ feeling that their interpersonal communication needs are met. Learners rated items focused on communication needs and being treated as individuals as most important, aligning their stated preferences with the instructors’ perceptions of what actions are most satisfying to online learners.     

Bringing back sweet (and not so sweet) memories: the cultural politics of memory,hip‐hop,and generational identities

This article examines the salience of collective ‘memory’ and ‘remembering’ among a group of students in Hip‐Hop Lit, a hip‐hop centered English literature course that I co‐taught at ‘Howard High School,’ an urban high school in the Northeastern United States. Specifically, this article examines the memory work that occurred within Hip‐Hop Lit in response to the students’ interactions with one of the course texts, Things Done Changed by rapper Notorious B.I.G. From this and other classroom texts, students were able to construct, contest, and reinscribe memories about the past. Through these memories, students were able to reaffirm and challenge particular social identities that informed and reflected their lived experiences.