Validity and use of an instrument for assessing classroom psychosocial environment in higher education

A strong tradition in research in primary and secondary schools has involved student and teacher perceptions of psychological characteristics of actual or preferred classroom environment. This paper provides a foundation for the extension of this tradition to the higher education level by describing the development, validation, and use of a new instrument, the College and University Classroom Environment Inventory (CUCEI), suitable for small higher education classes often referred to as seminars. The CUCEI assesses students' or instructors' perceptions of the following seven psychosocial dimensions of actual or preferred classroom environment: personalization, involvement, student cohesiveness, satisfaction, task orientation, innovation, and individualization. Administration of the CUCEI to 372 students in 34 classes and to 20 instructors attested to the internal consistency reliability and discriminant validity of the actual and preferred forms with either the individual or the class mean as the unit of analysis, and supported the ability of the actual form to differentiate between the perceptions of students in different classrooms. A research application of the CUCEI involving associations between student outcomes and classroom environment tentatively suggested that the nature of the classroom environment affects outcomes. Another research application suggested that both students and instructors preferred a more favorable classroom environment than the one actually present, and that instructors viewed classroom environments more positively than did their students in the same classrooms. Desirable future applications of the CUCEI for research purposes and in improving teaching in higher education are considered.The first main aim of this paper is to describe the development and validation of a new instrument to assess perceptions of classroom psychosocial environment in university and college classrooms. The second major purpose is to report the first two research uses of this instrument in, respectively, a study of associations between student outcomes and classroom environment and an investigation of differences between students and instructors in their perceptions of actual and preferred classroom environment. As well, desirable future research directions involving the new instrument are suggested. Before describing the development and use of the new instrument for the higher education level, important background information about analogous work at the primary and secondary school levels is briefly reviewed in an attempt to place the new work into context.     

Development and evaluation of a Chinese version of the Questionnaire on Teacher Interaction (QTI)

Teacher–student interpersonal relationships play an important role in education. The Questionnaire on Teacher Interaction (QTI) was designed to measure students’ interpersonal perceptions of their teachers. There are two Chinese versions of the QTI for student use, and that inherited the weaknesses of the previous English versions, such as items that focus on class behaviour, instead of teacher behaviour, or that include conditionals and negations. The present study aimed to develop an improved Chinese version of the QTI which is conceptually parallel with the original QTI and with the use of optimal item wording. The process contained several steps, including expert panels and student and teacher interviews. New items were also created based on the Chinese secondary classroom context, rather than only using translations of English items. The final version of the Chinese version of the QTI presented in this paper was evaluated with a sample of 2000 students from 4 secondary schools in mainland China who rated a total of 80 teachers. The resulting version of the Chinese QTI had adequate validity and reliability, and it distinguished clearly between teachers. The predictive validity was supported by the relation between the students’ perceptions of their teachers and their academic emotions in class. Although further improvement of the instrument is recommended, it can be used to study interpersonal teacher behaviour in China and to help to improve Chinese teachers’ teaching practices.     

Students’ perceptions of primary teachers’ interpersonal behavior and of cultural dimensions in the classroom environment

Within the domain of learning environments research many studies have investigated students’ perceptions of their teachers’ interpersonal behavior. The present study adds to this line of research by (a) focusing on primary education, rather than secondary education, (b) establishing associations between perceptions of teacher interpersonal behavior and perceptions of cultural elements of the learning environment rather than uniquely focusing on interpersonal behavior, (c) linking perceptions of teacher interpersonal behavior to affective student outcomes taking into account perceptions of cultural elements of the learning environment.Results of correlation analyses and multilevel analyses of variance, conducted on perception and outcome data of a sample of 2178 Australian years 5, 6 and 7 students in 103 primary classrooms are presented. Students’ perceptions of their learning environment were mapped with the Questionnaire on Teacher Interaction (QTI) and a primary version of the Cultural Learning Environment Questionnaire (CLEQ).Results indicate that, after correction for covariates, teacher proximity (QTI) and congruence (CLEQ) are significantly associated with students’ enjoyment in science. Also, strong associations were found between teacher proximity and all of the CLEQ scales.     

Transition from senior secondary to higher education: A learning environment perspective

The purpose of this study was to modify and validate a new form of the College and University Classroom Environment Inventory (CUCEI), and to then use it to compare students' actual and preferred perceptions of their classroom learning environments at the senior secondary and teritary levels of education. The study also examined differences in perceptions according to the student's gender. A sample of 504 students participated in the study. The reliabilities of the scales of the modified CUCEI ranged from .73 to .94. When the two levels were compared, students at the higher education level had a less favourable perception of their learning environment. Previous research was replicated in that females were found generally to perceive their learning environments in a more positive way than did males and that all students generally preferred a more positive learning environment in their classes.     

Teacher–student interpersonal relationships in Indonesian lower secondary education: Teacher and student perceptions

This study investigated firstly the reliability and validity of an Indonesian version of the Questionnaire on Teacher Interaction (QTI). Second, perceptions of Indonesian secondary school teachers?? interpersonal behaviour as perceived by students and teachers were studied with the QTI. Third, differences between students?? and teachers?? perceptions regarding interpersonal teacher behaviour were compared. The QTI itself is based on the Model of Interpersonal Behaviour which maps teacher behaviour in terms of Influence (Dominance?CSubmission) and Proximity (Cooperation?COpposition). In this study, an Indonesian version of the QTI was constructed and distributed to 2,380 students of 69 teachers from 85 classes (grade 7?C9) from 12 public lower secondary schools in Indonesia. The results showed high reliability and validity for the instrument. Students?? and teachers?? average ratings on Influence were similar, while teacher??s ratings of Proximity were higher than those of students.     

Interpersonal Behavior,Laboratory Learning Environments,and Student Outcomes in Senior Biology Classes

The purpose of this study was to investigate associations between students' perceptions of their biology teachers' interpersonal behavior and their laboratory learning environments and their attitudinal, achievement, and performance outcomes. A sample of 489 students from 28 senior biology classes in eight schools in Tasmania, Australia completed the Questionnaire on Teacher Interaction (QTI) and the Science Laboratory Environment Inventory (SLEI). Responses to two attitude questionnaires, achievement on an external written examination, and performance in laboratory practical tests were used as student outcome measures. Statistical analyses supported the reliability and validity of the QTI and the SLEI when used with senior secondary biology students. We investigated associations between students' perceptions of teacher behavior and their laboratory learning environment with student outcomes, including the unique and common contributions of the QTI and SLEI to variance in student outcomes. Associations with students' perceptions of the learning environment were stronger for the attitudinal outcomes than for the cognitive or practical skills outcomes. Some commonality between the QTI and SLEI scales was found in their contributions to the variance in attitudinal outcomes, but not in their contributions to variance in cognitive and practical skill outcomes. © 1999 John Wiley & Sons, Inc. J Res Sci Teach 37: 26–43, 2000     

Teacher-student classroom interactions among science students of different sex and cultural background

The purpose of this study was to determine associations between science students' perceptions of their interactions with their teachers, the cultural background of students and their attitudinal and cognitive achievement outcomes. A sample of 3,215 students from 158 secondary school science classes in 43 schools completed a survey including the Questionnaire on Teacher Interaction (QTI), an attitude to calss scale, an enquiry skills scale and questions relating to cultural background. The sample was chosen in order tobe representative, though only coeducational classes were used in order to permit an unconfounded test of sex differences. Statistical analyses confirmed the reliability and validity of the QTI for secondary school science students. Generally, the dimensions of the QTI were found to besignificantly associated with student attitude scores. In particular, students' attitude scores were higher in classrooms in which students perceived greater leadership, helping/friendly, and understanding behaviours in their teachers. Correlations between cognitive achievement and interpersonal behaviour were not as strong, but there were positive associations with cooperative behaviours and negative associations with oppositional behaviours. Females perceived their teachers in a more positive way than did males and students from an Asian background tended to perceive their teachers more positively than those from the other cultural groups identified in the study.     

THE RELATIONSHIP BETWEEN ACADEMIC DISHONESTY AND COLLEGE CLASSROOM ENVIRONMENT

The present study examined the relationshipbetween college classroom environment, academiccheating, and the neutralization (justification) ofacademic cheating. Two-hundred eighty undergraduatestudents from two liberal arts colleges in the Midwestparticipated in the study. Participants completed theCollege and University Classroom Environment Instrument(CUCEI) and the Survey on Academic Dishonesty (SAD), with instructions to complete thesequestionnaires (anonymously) in a manner that woulddescribe their perceptions, behavior, and attitudes inthe class in which the survey was completed. Three CUCEI scales were identified that discriminatedsignificantly between admitted cheaters and noncheaters.Cheaters described their classes as significantly lesspersonalized, satisfying, and task oriented than did noncheaters. Together, the seven scales ofthe CUCEI explained 4% of the variance in cheatingbehavior. Six CUCEI scales were found to be correlatedsignificantly with a measure of cheating neutralization. Specifically, neutralization increased withdecreases in perceived classroom personalization,involvement, student cohesiveness, satisfaction, taskorientation, and individualization. Together, the seven scales of the CUCEI explained 14% of thevariance in neutralization. It is concluded thatclassroom environment is a significant situationalvariable in academic dishonesty, as both cheatingbehavior and attitudes toward cheating are related toperceptions of classroom environment.     

Measuring the Computer Classroom Environment: Lessons Learned From Using a New Instrument

Research over the last four decades has shown that the classroom learning environment impacts on students' cognitive and affective outcomes. Different approaches have been taken to measure students' perceptions of their learning environment, and this has led to the development of a large number of survey instruments. One such instrument is the College and University Classroom Environment Inventory (CUCEI) which was developed in 1987. The CUCEI was recently modified and both the original and modified versions were validated in a number of studies. This article reports the use of the modified CUCEI in two independent studies in computing classrooms in secondary schools and tertiary institutions in Wellington, New Zealand. The statistical performance of the CUCEI was not completely satisfactory in either study and revealed a number of problems common to these two studies. The difficulties are discussed and recommendations made to increase the validity and reliability of this instrument.     

Identifying Exemplary Science Teachers Through Their Classroom Interactions with Students

The purpose of the study described in this paper was to use the Questionnaire on Teacher Interaction (QTI) to identify and describe exemplary science teachers. With a sample of over 493 science students, the reliability of the QTI scales ranged from 0.69–0.87. The exemplary teachers were identified as those whose students' perceptions were more than one standard deviation above the mean on the scales of Leadership, Helping/Friendly, and Understanding and more than one standard deviation below the mean on the Uncertain, Dissatisfied and Admonishing scales. The construct validity of the QTI to identify these exemplary teachers was confirmed through interviews with students and these views are reported in the article. This revised version was published online in July 2006 with corrections to the Cover Date.     

Research on teacher–student relationships and learning environments: Context,retrospect and prospect

The program of research on teacher–student relationships described in this issue is an important part of the field of classroom learning environments, although it has its own distinctive and significant features. The questionnaire on teacher interaction (QTI), the main instrument used in this research, follows the strong tradition in learning environments research of using the perceptions of the participants in the classroom. Although this research program originated in the Netherlands, it now is truly international and the QTI has been translated into and validated in over a dozen languages. Not only has past research consistently replicated the advantages of positive teacher–student relationships in terms of promoting improved student outcomes, but positive teacher–student relationships also are worthwhile process goals of education. In the future, it would be desirable for the QTI to be used more frequently by teachers as a feedback instrument for guiding improvements in their classroom relationships with their students, and that qualitative data-collection methods are used more often in conjunction with the use of the QTI in research on teacher–student interaction.     

Teacher interpersonal behaviour and student achievement in English as a Foreign Language classrooms in China

We examined the relationship between English as a Foreign Language (EFL) teachers’ interpersonal behaviour and students’ fluency in English in secondary education in China. A total of 160 students from four classes in the southwest part of China were asked to assess their teachers’ interpersonal behaviour using the Questionnaire on Teacher Interaction (QTI). This was the first time that the QTI was successfully translated and used (in EFL classrooms) in China. Cronbach’s α reliability coefficients for the scales were adequate, while confirmatory factor analyses provided support for the theoretical framework behind the questionnaire. Results showed that teacher uncertainty was negatively correlated with student achievement. Furthermore, the degree of teacher cooperation with students was the only significant predictor for student achievement, but its effect disappeared when student background variables were taken into account. Results also indicated a discrepancy between students’ perceptions of preferred and actual teacher interpersonal behaviour. The tolerant-authoritative profile was the most common interpersonal style based on Chinese students’ perceptions.     

A comparison of actual and preferred classroom environments as perceived by science teachers and students

This study of perceptions of classroom environment is distinctive in that, first, it made use of two instruments (the Individualized Classroom Environment Questionnaire and Classroom Environment Scale) which have had very little use in prior science education research and, second, it involved assessment not only of student perceptions of actual environment, but also of student perceptions of preferred environments and teacher perceptions of actual environment. Administration of these instruments to a sample of 2175 junior high school students in 116 classes revealed that the environment scales exhibited satisfactory internal consistency reliability and discriminant validity in each of the three forms (student actual, student preferred, and teacher actual), and that there were some fascinating systematic differences between the profiles of environment scale scores obtained for the different forms. In particular, it was generally found that students preferred a more favorable classroom environment then was perceived as being actually present and that teachers perceived the environment of their classes more favorably than did students in the same classrooms.     

Interpersonal behaviour in senior high school biology classes

This article describes the first use of the Questionnaire on Teacher Interaction in senior biology classes and describes students' perceptions of their interpersonal relationships with their teachers in the classroom environment. The article also describes associations between students' perceptions of interpersonal relationships with their teachers and student outcomes. The study confirmed the reliability and validity of the QTI when used in senior secondary biology classes. Generally, the dimensions of the QTI were found to be significantly associated with student attitude scores. In particular, students' attitude scores were higher in classrooms in which students perceived greater leadership, helpful/friendly, and understanding behaviours in their teachers.     

Student Perceptions of Chemistry Laboratory Learning Environments, Student–Teacher Interactions and Attitudes in Secondary School Gifted Education Classes in Singapore

This study investigated the chemistry laboratory classroom environment, teacher–student interactions and student attitudes towards chemistry among 497 gifted and non-gifted secondary-school students in Singapore. The data were collected using the 35-item Chemistry Laboratory Environment Inventory (CLEI), the 48-item Questionnaire on Teacher Interaction (QTI) and the 30-item Questionnaire on Chemistry-Related Attitudes (QOCRA). Results supported the validity and reliability of the CLEI and QTI for this sample. Stream (gifted versus non-gifted) and gender differences were found in actual and preferred chemistry laboratory classroom environments and teacher–student interactions. Some statistically significant associations of modest magnitude were found between students' attitudes towards chemistry and both the laboratory classroom environment and the interpersonal behaviour of chemistry teachers. Suggestions for improving chemistry laboratory classroom environments and the teacher–student interactions for gifted students are provided.     

Learning from and responding to students' questions: The authoritative and dialogic tension

In this study we present an analysis of classroom interactions initiated by students' wonderment questions. Our interest in such events arises from their potential to stimulate active intellectual engagement in classrooms, which can impact upon the subsequent development of the classroom discourse. In investigating this issue we shall address the following research question: How do student questions impact upon the teaching explanatory structure and modify the form of the ongoing classroom discourse, in selected science lessons? From data collected in a Brazilian secondary school we have selected three classroom episodes, with large differences in both the context in which the student's question emerges and in the communicative approach developed in response to it. The analysis, based on the framework proposed by Mortimer and Scott [Mortimer and Scott (2003). Meaning making in secondary science classrooms. Maidenhead: Open University Press], shows that questions made by students are important in providing feedback from students to the teacher, enabling adjustments to the teaching explanatory structure. These adjustments sometimes occur smoothly, at other times with major changes to the features of the classroom discourse, and elsewhere with misunderstanding and disagreement. The data also suggest the need to consider students' intentions and their active participation in the negotiation of both the content and structure of classroom discourse. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47:174–193, 2010     

Secondary Teachers' Interpersonal Behaviour in Singapore,Brunei and Australia: A cross-national comparison

This study investigates the reliability and validity of the Questionnaire on Teacher Interaction (QTI) in three countries: Singapore, Brunei and Australia. The QTI maps student perceptions of interpersonal teacher behaviour and is based on the circumplex Model for Interpersonal Teacher Behaviour (MITB) that investigates the teacher–student relationship in terms of the two dimensions of influence and proximity. Students' perceptions of their teachers in the three countries are also compared. Results show that the QTI scales are represented by two independent dimensions and that scales can be ordered in terms of a circular structure. However, empirical scale locations differ from their theoretical positions as hypothesised by the circumplex model, and among countries. Differences in teacher influence and proximity are also found among the countries.     

Perception shapes experience: The influence of actual and perceived classroom environment dimensions on girls’ motivations for science

The classroom environment influences students’ academic outcomes, but it is often students’ perceptions that shape their classroom experiences. Our study examined the extent to which observed classroom environment features shaped perceptions of the classroom, and explained levels of, and changes in, girls’ motivation in junior secondary school science classes across two school terms. Girls have been found to feel less capable than boys and to under-participate in science classrooms, even though their achievement levels are similar. Four teachers and five of their classrooms of students (N = 52) reported their perceptions of the classroom environment, and trained observers rated the ‘actual’ classroom environment. Students also completed questions regarding their motivations for science at both time points. Hierarchical linear modelling showed that students’ perceptions of classroom structure were very important and exerted significant influence on science motivations. All of the six observed classroom dimensions affected students’ extrinsic utility value, via perceptions of structure. Other classroom dimensions showed particular patterns of relationship with motivations. Teachers’ perceptions of the classroom environment were often more positive than those of the students, which is congruent with previous research. The findings have implications for retaining girls in science and, thereby, addressing the gender gap in science-related vocations.     

The importance of teacher interpersonal behaviour for student attitudes in Brunei primary science classes

This study investigated relationships between students' perceptions of their teachers' interpersonal behaviour and their subject‐related attitude in primary science classes in Brunei. Teacher–student interpersonal behaviour was mapped with the Questionnaire on Teacher Interaction (QTI) and reported in terms of two independent dimensions called Influence (teacher dominance vs submission) and Proximity (teacher cooperation vs opposition). While prior research using the QTI mainly focused on secondary education, the present study was one of the first in Brunei and in primary education and one of few studies to use multilevel analysis. Data from 1305 students from 64 classes were used in this study. Results indicated strong and positive effects of Influence and Proximity on students' enjoyment of their science class and supported findings of earlier work with the QTI.     

Cultural Background and Students’ Perceptions of Science Classroom Learning Environment and Teacher Interpersonal Behaviour in Jammu,India

This article reports research into associations between students’ cultural background and their perceptions of their teacher’s interpersonal behaviour and classroom learning environment. A sample of 1021 students from 31 classes in seven co-educational private schools completed a survey including the Questionnaire on Teacher Interaction (QTI), the What Is Happening In this Class? (WIHIC) and a question relating to cultural background. Statistical analyses showed that the Kashmiri group of students perceived their classrooms and teacher interaction more positively than those from the other cultural groups identified in the study.