Evaluating interactivity and learning in computer conferencing using content analysis techniques

This paper outlines the application of a particular model of content analysis to the evaluation of an online discussion group. A set of online discussion data from a group of students enrolled in an educational management course offered by the Open University of Hong Kong (OUHK) was examined. The provision of the online discussion facility for this group of students was mainly for enrichment purposes and their participation was completely voluntary. Overall, the analysis confirmed the usefulness of Henri’s model in examining the interaction and learning processes in an online forum. It also provided insights towards increased understanding of the complex processes and methodological considerations involved in analysing online conferences.     

Content analysis of computer conferencing transcripts

Within the field of higher education, there are situations where the learner is not well served in a classroom setting. Problematic issues such as scheduling, critical mass, time, pace and location have the potential to be counterbalanced by e-learning. Within this, the asynchronous nature of today's online learning environments and computer conferencing tools have popularly been claimed to offer tremendous benefits for learners who are willing to take responsibility for their own learning, to progress at their own pace, and interact with their online teacher to get immediate feedback on their learning and progress. Indeed, increasingly, educators today are very keen to exploit some of these new technologies for the benefit of their learners. It is argued in this article that there is a need to address the practice and research of asynchronous computer mediated conferencing. As conferencing tools become an increasingly common feature in students' experience, teachers need to have an understanding of how these tools facilitate the formation and maintenance of collaborative learning communities.     

Discrepancy between instructor and student evaluations of instruction: Effect on instructor

To find out whether a discrepancy between the instructor's and the student's evaluations of teaching influence teaching, 13 introductory and educational psychology instructors and their students were given a Student Opinion Questionnaire (SOQ) twice: on the fourth week of a fall term and eight weeks after feedback sessions with the instructors. The instructors received feedback on the direction and amount of initial discrepancy. The results showed that the unfavorable discrepant instructors (instructor rating better than students) changed more on skill, feedback, rapport, general teaching ability, and the overall value of the course than the favorably discrepant instructors (student ratings better than instructor). The unfavorably discrepant instructors improved their teaching significantly more than the favorably discrepant instructors.This article is based on portions of a dissertation submitted in partial fulfillment of the requirements for the Ph. D. degree at the University of Michigan. The author wishes to acknowledge the help given by Wilbert J. McKeachie and Alvin F. Zander and thank them for their suggestions. An earlier version of the paper was presented at the 81st Annual Convention of the American Psychological Association, Montreal, Que., August 1973.     

Computer-mediated communication for teenage students: a content analysis of a student messaging system

This paper documents an exploratory study investigating the patterns of communication and the contents of the messages of an electronic messaging system set up specifically for teenage students in Hong Kong. The results of this investigation suggest that this undirected and unco- ordinated public messaging network was used both for socializing and information exchange. There was in general a lack of in-depth communication and the network users were not keen to involve themselves in serious discussions. It is suggested that a co- ordinator is needed to facilitate in-depth and task-specific discussions in a public messaging system     

A cross-cultural comparison of instructor communication in American and French classrooms

This study addressed patterns and influence of instructor communication in American (US) and in French classrooms. Significant differences were found for instructor use of power bases, affinity-seeking strategies, and nonverbal immediacy. Significant differences were found in student affective learning, cognitive learning, affect toward instructor, and ratings of instruction between the two cultures. In both cultures, however, student affect toward instructor, cognitive learning, and rating of instruction were significantly correlated with instructor affinity-seeking and instructor nonverbal immediacy. Likewise, instructor use of expert power was significantly correlated with student cognitive learning and ratings of instruction in both cultures.     

Identification of student misconceptions in genetics problem solving via computer program

A genetics problem practice program and tutor on microcomputer was used by 135 undergraduate education majors enrolled in an introductory biology course at Purdue University. The program presented four genetics problems, two monohybrid and two dihybrid, and required the users to predict the number and type of each class of offspring. Student responses were recorded on diskette and analyzed for evidence of misconceptions and difficulties in the genetics problem-solving process. Three main areas of difficulty were identified: difficulties with computational skills, difficulties in the determination of gametes, and inappropriate application of previous learning to new problem situations.     

The role of cognitive style in educational computer conferencing

This paper reports an investigation of the impact of students’ cognitive style on their effective use of educational text‐based computer‐mediated conferences. The research centres on an empirical study involving students from three courses run by the British Open University. Statistical analysis of the data does not suggest that cognitive style has a strong influence on student participation in the conference, but does suggest that, contrary to expectations, ‘imagers’ may send more messages to conferences than ‘verbalisers’. The data also suggest a possible link between certain cognitive styles and course completion, and that the interaction of different styles within a group, as described by Riding and Rayner's (1998 ) team roles, may have an indirect influence on task completion.     

Assessment co-creation: an exploratory analysis of opportunities and challenges based on student and instructor perspectives

In recent years, research and practice focused on academics and students working in partnership to co-design learning and teaching in higher education has increased [Deeley and Bovill 2017. ‘Staff student partnership in assessment: enhancing assessment literacy through democratic practices.’ Assessment & Evaluation in Higher Education 42 (3): 463–477. doi:10.1080/02602938.2015.1126551]. Student generation of content has been advocated as a means of fostering deep learning and high levels of students engagement, leading to enhanced conceptual understanding [Draper 2009. ‘Catalytic Assessment: Understanding how MCQs and EVS can Foster Deep Learning.’ British Journal of Educational Technology 40 (2): 285–293.]. However, within the discourse exploring staff-student co-creation, some concerns have been raised about whether students ought to, or indeed can, meaningfully act as partners in assessment [Cook-Sather, Bovill, and Felten 2014. Engaging Students as Partners in Learning and Teaching. San Francisco, CA: Jossey Bass.]. This paper describes the introduction of a co-creation assignment into an undergraduate tax module. Students’ and instructors’ perceptions of several aspects of the assignment were examined, facilitating the cataloguing and elucidation of the tensions involved in assessment co-creation. The paper suggests techniques to manage these challenges effectively, thereby providing a case study for others with an interest in implementing assessment co-creation within their own disciplinary context.     

Relationship with instructor and other variables influencing student evaluations of instruction

This study examined some of the factors which influence college students’ evaluations of their instructors. Data were collected from 557 students enrolled in a basic speech communication course. Overall, a student's relationship with the instructor was the best predictor of the student's evaluation of the instructor. This study lends partial support to the idea that students evaluate male and female instructors differently. The variables examined in this study were better predictors of student evaluation of female than male instructors.     

Assessing college student perceptions of instructor customer service via the Quality of Instructor Service to Students (QISS) Questionnaire

This study presents the results of a three‐step project designed to: (1) identify what students perceive to be quality service as offered by instructors, (2) relate the dimensions identified to an appropriate survey instrument (the QISS) and pilot‐test the instrument, and (3) survey a stratified representative sample of the undergraduate population with the instrument. A stratified sample of students (N=457) were surveyed using the QISS questionnaire in the spring semester of 2004. The QISS is a modified SERVQUAL questionnaire. Results indicate that students consistently identify Reliability and Responsiveness as the most important dimensions of instructor service to students. Female students consistently report that their experiences with instructors do not meet their expectations. The same holds true for males but to a lesser degree. Information provided from this kind of assessment provides a means of identifying areas where student satisfaction is already strong and areas where it can be improved.     

Comparison of performance and attitude in traditional and computer conferencing classes

Abstract

A 1992 survey of the thirty‐five Oklahoma schools that received satellite downlinks as part of the 1988–1990 Midlands Consortium Star Schools grant investigated the extent to which schools were continuing to use the equipment and the impact of satellite access on their educational programs. Four schools did not use their downlinks in 1991–92, and two of the four also did not use the equipment in 1990–91; thirty‐one schools were continuing to use the equipment to receive student and/or staff development programming. Sixty‐one percent of thirty‐three respondents believe satellite access has very significantly or significantly improved the educational program for students at their school; 39% believe it has very significantly or significantly improved their overall staff development program. Forty‐eight percent of respondents reported a decrease in use since the first year of operation; 76% of respondents anticipate an increase in use in the future.     

The role of student academic beliefs in perceptions of instructor ideological bias

A common perception exists in the media that university instructors are a liberal elite who use their positions to instill a biased perspective in their students. Exploring student attitudes in the United States and Australia, the present study examined how students’ academic beliefs are related to their inferences of instructor ideological bias and the degree to which they identify as reacting to these inferences in the college classroom. Results of regression analysis using previously validated survey instruments revealed that students’ academic entitlement and grade orientation (GO) predicted perceptions of instructor bias. In addition, students’ GO predicted students’ reactions to such inferred bias. Institutional differences, pedagogical implications, and areas for future research are discussed.     

A methodology for the analysis of patterns of participation within computer mediated communication courses

In this study we propose a methodology for the analysis of text based interchanges on computer mediated conferences which is based on Speech Act theory and which takes the illocutionary act as its unit of analysis. This methodology is used to compare messages from two different conferences — one based on methods for fostering learner independence and one based around a guest speaker seminar — and to show the differing patterns of interaction provoked by the differing task designs.     

Impacts of directed tutorial activities in computer conferencing: a case study

This paper describes a qualitative study of asynchronous electronic conferencing by three tutorial groups on the same postgraduate course (Teaching English to Speakers of Other Languages Worldwide), forming part of an MA in Applied Linguistics (via Distance Education) at the Open University, UK. The groups varied in the degree to which the tutor participated in the discussion and in whether the tutor's input took the form of responding to student posts or the setting of tasks to scaffold the learners' development of academic skills. It is argued that the least interventionist strategy in terms of tutor response and task-setting resulted in the least productive conference discussion in terms of both communicative interaction and academic development, while a more interventionist role by the tutor depended for its success on characteristics of the tutor input and the task set.     

The juxtaposition of instructor and student perspectives on mathematics courses for elementary teachers

This qualitative study examined perspectives of two key stakeholder groups, instructors and students, on mathematics content courses for prospective elementary teachers (Mathematics for Teachers [MFT] courses). A collective case study approach, which drew from the data of two cases in different but comparable settings, contributed to the robustness of the findings. Cross-case analysis of the interview data revealed several convergent themes: the role of affect in student learning, pedagogy and instructor disposition, connections to the elementary classroom, and mathematics content. The findings included both conflicting and complementary perspectives between the two key stakeholder groups. When juxtaposed, the multiple viewpoints offer insights into some of the central issues related to teaching and learning in MFT courses and suggest potential avenues for improving experiences in these courses.     

The effect of instructor race and gender on student persistence in STEM fields

The objective of this study is to determine if minority and female students are more likely to persist in a science, technology, engineering, and math (STEM) major when they enroll in classes taught by instructors of their own race or gender. Using data from public 4-year universities in the state of Ohio, I analyze first semester STEM courses to see if the race or gender of the instructor effects persistence of initial STEM majors in a STEM field after the first semester and first year. Results indicate that black students are more likely to persist in a STEM major if they have a STEM course taught by a black instructor. Similar to previous findings, female students are less likely to persist when more of their STEM courses are taught by female instructors.     

A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation

An extensive review of the research concerning the effect of different variables on student ratings is presented. A study is then reported comparing the effects of different sets of instructions on student evaluations of the course and instructor. The results indicated that the students who were informed that the results of their ratings would be used for administrative decisions rated the course and instructor more favorably on all aspects than students who were informed that the results of their ratings would only be used by the instructor.The authors are indebted to Professor Robert A. Waller for cooperating in obtaining the data on his two history courses.     

Making adult education accessible to the deaf. A model of direct instructor communication in ASL

The purpose of this study was to develop a model of direct communication in American Sign Language for mainstreamed adult education courses. The model uses an individual instruction format with limited lecture time. Data were collected for 23 students (12 hearing and 11 deaf) newly enrolled in a mainstreamed word processing class. They were compared on average hours required to complete an exercise, average rates of attendance, and weekly drop rate. Attendance and drop rates were compared for new and returning students in the mainstreamed class (34 students) and 25 hearing students from a nonmainstreamed class. In addition, the average number of hours required to complete the exercises was compared for 10 new hearing students from the mainstreamed class and 11 new hearing students from the nonmainstreamed class. No significant differences were found in any of the comparisons. The study recommends further research to compare this Direct Instructor Communication Model with other more traditional deaf education models.