Development and validation of an instrument to assess primary school students’ perceptions of the learning environment

Over the past 40 years, numerous instruments have been developed to assess the learning environment for a variety of purposes. Despite this plethora of available surveys, there are few that have been developed for use at the primary school level, and even fewer that have been comprehensively validated. This article describes the development of a long-overdue learning environment survey that is suited to primary school students. Evidence to support the validity of the survey, in terms of translation and criterion validity, was guided by Trochim and Donnelly’s (2006) construct validity framework. A pilot test involving one class of 30 students and interviews with six students was used to examine the face validity of individual items. Analyses of data collected from 609 students in 31 classes supported the convergent, concurrent, discriminant and predictive validity, the results of which were all satisfactory. This article is significant in that it provides educators and researchers with a valid tool to assess the learning environment. The instrument, named the Classroom Climate Questionnaire—Primary (CCQ-P), is described and its practical advantages and limitations are discussed.     

Development of a questionnaire for assessing students’ perceptions of the teaching and learning environment and its use in quality assurance

There are few available instruments that assess students’ perceptions of university teaching and learning environments and can be used to provide diagnostic feedback, at the degree or program level, on the quality of the environment. This article describes the development, testing and application, for quality assurance purposes, of a suitable instrument. The final version of the questionnaire includes scales seeking students’ feedback on nine facets of the teaching and learning environment. There are also scales seeking students’ perceptions of the influence of the environment on the development of eight generic capabilities. The 17 scales have been shown to be reliable. Validity has been established by the use of faculty panels to select appropriate generic capabilities and by testing, by structural equation modelling, of an underlying model of the nurturing of capabilities by the environment. The questionnaire has proved to be highly diagnostic when used for quality assurance purposes. A case is given showing how the questionnaire identifies strengths and weaknesses, which can lead to action plans for quality improvement.     

Development and validation of an instrument for assessing high-school students’ perceptions of socio-scientific issues-based learning in biology

In this research, we developed and validate an instrument for assessing high-school students’ perceptions of socio-scientific issues (SSI)-based learning in biology. The development of the instrument was carried out using the following four steps: item formulation, content validation, construct validation and reliability calculation. According to an extensive literature review, 28 initial items were formulated for four SSI-based instruction aspects: (1) contextualisation of SSI, (2) student involvement, (3) student attitudes towards SSI-learning and (4) SSI-based learning objectives. Based on the pilot study conducted for construct validation, 24 items were successfully constructed for the four scales and subsequently administered in biology classrooms to 151 students. Factor analysis showed that each of the 24 items had a factor loading at least 0.40 on its own scale and no other scale. Moreover, the four scales accounted for 58.32% of the total variance and the alpha reliability coefficients for the scales ranged from 0.75 to 0.85. According to these findings, the SSI-based Learning Environment Inventory in Biology is valid, reliable and useful.

     

Competition and students’ perceptions in a game-based language learning environment

Although educational games have become quite popular in recent research, only a limited number of studies have focused on the effectiveness of these games. While numerous claims have been made about the effectiveness of games, the studies that examine educational effectiveness often contain flaws resulting in unclear conclusions. One possible solution for these shortcomings is to focus on separate game elements rather than on games as a whole. A second solution is to take into account students’ perceptions of instruction as they are likely to affect students’ interpretations and learning outcomes. This study investigated whether the addition of the gaming element ‘competition’ to a computer-based language learning environment is related to students’ motivation, perceptions and learning outcomes. Additionally, this study probed into the effect of instruction, i.e., the instruction of a gaming or learning environment, on students’ perceptions of the environment, their motivation and learning outcomes. 83 students participated in this study, all working in a game-based learning environment for learning business English conversation skills. The results demonstrate that competition is not significantly related to students’ learning gains and only partly related to students’ motivation. Moreover, the majority of students perceived the environment as a learning environment, even when they were instructed to be playing in a gaming environment. To conclude this paper, the practical and theoretical implications for the fields of instructional design and educational games research are discussed.     

How to measure students’ innovation competences in higher education: Evaluation of an assessment tool in authentic learning environments

In all sectors of the economy, the importance of innovation is underlined. Although education plays a central role in the development of human innovation skills, several studies suggest that higher education institutions cannot fulfill these demands. In such, there is a need to update pedagogical practices and develop assessment tools to measure and develop a person’s innovation capacity. The aim of this study is to test and evaluate the functioning of the earlier developed assessment tool to measure students’ innovation competences in the authentic learning environments of Finnish higher education institutions. The electronic self-assessment questionnaire was distributed to students (n = 495) from four Finnish universities of applied sciences. The results showed that the questionnaire statements formed a functional innovation competence barometer for self-assessment, including creative problem-solving, systems thinking, goal orientation, teamwork, and networking competences. The assessment tool facilitates the development of teaching, assessing, and curriculum design in higher education.     

Assessing collaborative work in a higher education blended learning context: strategies and students’ perceptions

This study examines students' views on a blended learning module developed and offered at the University of Aveiro. The paper presents the module and the strategies, tools, activities and assessment. In order to examine the effectiveness of the module, data were collected from reflections, postings and questionnaires. Findings document students’ opinions concerning the module, the activities and their learning. Students valued the module but expressed concerns in using the wiki tool, assessing collaborative work and in engaging in peer assessment activities. The results have practical implications for the design of collaborative activities and innovative assessment in blended learning environments.

Bewertung kollaborativer Arbeit in einem gemischten Hochschulbildungs‐Lernkontext: Strategien und Wahrnehmungen der Studenten

Diese Studie untersucht die Ansichten von Studenten auf einem gemischten Lern‐Modul, entwickelt und angeboten von der Universität Aveiro. Das Papier stellt das Modul und die Strategien, Tools, Aktivitäten und Bewertung vor. Um die Wirksamkeit des Moduls zu untersuchen, wurden die Daten von Reflexionen, Notizen und Fragebögen gesammelt. Die Ergebnisse dokumentieren die Meinungen über das Modul, ihre Aktivitäten und ihr Lernen. Studenten schätzten das Modul hatten aber Bedenken beim Wiki‐Tool, bezüglich des kooperativen Arbeitens, Bewertungen und Peer‐Bewertungs‐Aktivitäten. Die Ergebnisse haben praktische Folgen für das Design gemeinsamer Aktivitäten und innovative Bewertungen ?gemischter Lernumgebungen”.

L’évaluation du travail collaboratif dans un contexte d’enseignement universitaire mixte: le strategies et les perceptions des étudiants

La présente étude examine les opinions des étudiants sur un module d’apprentissage mixte (blended) mis au point et assuré à l’Université d’Aveiro. Cet article présente le module et les stratégies, les outils, les activités et l’évaluation. Pour déterminer l’efficacité de ce module, on a rassemblé des données à partir des réflexions, des envois et des questionnaires. Les éléments recueillis illustrent les opinions des étudiants à propos du module, des activités et de ce qu’ils ont appris. Les étudiants ont apprécié le module mais exprimé leur inquiétude quant à l’usage de l’outil wiki, de l’évaluation du travail collaboratif et de l’engagement dans des activités d’évaluation de leurs camarades. Ces résultats ont des retombées pratiques pour la conception des activités collaboratives et d’un mode d’évaluation innovant dans des environnements d’apprentissage mixte.

La evaluación del trabajo colaborativo dentro de un entorno de aprendizaje mixto (Blended Learning) en la enseñanza superior: estrategias y percepciones de los estudiantes

El presente estudio examina las opiniones de los estudiantes acerca de un módulo de aprendizaje mixto desarrollado y propuesto por la Universidad de Aveiro. El artículo presenta el módulo y las estrategías, herramientas, actividades y evaluación. Para determinar la eficacia del módulo se hizo una recogida de datos, basandose en reflexiones, mensajes y cuestionarios. Los resultados ilustran las opinones de los estudiantes acerca del módulo, de las actividades y de lo que han aprendido.Los estudiantes valoran el módulo pero expresaron su preocupación acerca del uso de la herramienta wiki, de la evaluación del trabajo cooperativo y de la dedicación a actividades de evaluación mutual. Esos resultados conllevan consecuencias prácticas para el diseño de actividades cooperativas y la evaluación innovadora en entornos de aprendizaje mixto.     

Relationships between Hong Kong students’ perceptions of the learning environment and their learning patterns in post-secondary education

The present study aims to analyse the complex relationships between the relevant constructs of students’ demographic background, perceptions, learning patterns and (proxy measures of) learning outcomes in order to delineate the possible direct, indirect, or spurious effects among them. The analytical methodology is substantively framed against the studies of Richardson (British Journal of Educational Psychology 76:867–893, 2006, Higher Education 54:385–416, 2007) that utilised a regression-based methodology to infer the possible causal relationships among the relevant learning constructs. A composite research instrument, written in Chinese and derived from the Inventory of Learning Styles (ILS) and the Course Experience Questionnaire (CEQ), was used to collect students’ feedback on their perceptions of the learning environment and their learning patterns. Valid responses were obtained from 1,572 students studying at six institutions in the post-secondary education sector in Hong Kong, a new response-context for both the CEQ and the ILS. In adapting the research instruments to a new Chinese response-context, the findings are generally consistent with those reported in other published works (e.g. no relationship between students’ demographic background and their satisfaction with the programme, and a significant relationship between students’ exhibition of undirected learning patterns and low expected performance), but there are also some noteworthy discrepancies. The findings therefore buttress the confidence with which an ILS-based General Theoretical Model of student learning, adapted from Richardson (British Journal of Educational Psychology 76:867–893, 2006, Higher Education 54:385–416, 2007), may be used to conceptualise and interpret the dynamics of variation across different cultural response-contexts. While the CEQ provides some valuable complementary insights, it is an instrument that requires further development in the response-context of the present study.     

Students’ perceptions of the academic environment and approaches to studying in British postgraduate business education

Recent research on student learning in higher education has identified clear associations between variations in students’ perceptions of the academic environment and variations in their study behaviour. This study investigated a general theoretical model linking students’ demographic characteristics, perceptions and study behaviour with measures of outcome, and in particular, compared three accounts of the causal relationship between perceptions and study behaviour. Data were obtained from 469 postgraduate students at six British business schools. Path analysis was used to assess the causal relationships among the students’ age and gender, their scores on the Course Experience Questionnaire, their scores on the Revised Approaches to Studying Inventory and their ratings of general satisfaction with their programmes. This yielded evidence for the causal efficacy of most of the paths identified in the general theoretical model. In particular, as in the case of students taking more traditional academic subjects, there exists a bidirectional causal relationship between variations in students’ perceptions of the academic environment and variations in their study behaviour.     

Learning to write in higher education: students’ perceptions of an intervention in developing understanding of assessment criteria

This paper reports on the second phase of a project designed to improve students’ understanding of assessment demands. In Stage 1, Level 1 students were involved in a range of activities culminating in peer marking. This peer assessment was, itself, marked by the tutors to encourage students to engage positively with the process. Stage 2 of the project investigated whether these various intervention activities had any long-term impact on sports studies students’ approach to writing assignments. Interviews were conducted with six students who participated in Stage 1. For comparison purposes, a matched group of students from another vocationally-related course were also interviewed. The findings suggest that the peer assessment did encourage students to pay attention to assessment information. However, the students placed greater stress on the role of informal support, particularly verbal clarification of written guidance and feedback. The article concludes with a discussion of the implications for practice.     

Self-regulated learning and students’ perceptions of innovative and traditional learning environments: a longitudinal study in secondary education

This study investigated the relationship between the development of students’ self-regulated learning and students’ perceptions of the learning environment in terms of autonomy support, the emphasis on relevance and collaborative learning. In addition, we compared innovative learning environments that aim to enhance self-regulated learning with traditional learning environments. Questionnaires for measuring self-regulated learning and perceptions of the learning environment were administered by 648 students. Self-regulated learning was measured at the start of secondary education and again half way through the first year. The results point to the importance of how students perceive the learning environment for self-regulated learning. There was a positive relationship between autonomy support and relevance and self-regulated learning. Furthermore, students in innovative environments perceived more autonomy support, more emphasis on relevance and more collaborative learning than those in traditional environments. Students in innovative environments, however, reported no more self-regulated learning than students in traditional environments.     

Characteristics of an innovative learning environment according to students’ perceptions: actual versus preferred

An innovative learning environment is the current outcome of the constructivist approach, the essence of which is co-construction of knowledge in an Information and Communication Technology (ICT) environment. We examined how Israeli students perceived 10 characteristics of their classroom learning environment—student cohesiveness, teacher support, involvement, task orientation, investigation, cooperation, equity, differentiation, computer usage and young adult ethos. Particular foci were students’ perceptions of the actual state of their learning environment compared with the preferred state, and which characteristics predicted students’ cooperation. Participants were 1022 students in 33 classes from 12 computerised elementary and middle schools in Israel. Data were collected using the Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI). Results indicated a gap between the actual and the preferred states for all characteristics, although the scope of these gaps differed between elementary-schools students and middle-school students for certain characteristics. Structural equation modelling (SEM) analysis indicated that nine characteristics of the innovative environment in both actual and preferred states were related to cooperation, with these relations being primarily direct with the exception of teacher support and differentiation which had an indirect influence. Teacher support was mediated through student cohesiveness, involvement, equity and young adult ethos, whereas differentiation was mediated through investigation. Evaluation of the innovative learning environment might lead to better insights regarding the behaviours and needs of twenty-first century students in Israel’s education system. These insights could advance constructivist processes and teaching methods and bring the students to effective cooperative learning in an innovative learning environment.     

eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.     

Architecture students’ perceptions of their learning environment and their academic performance

Scholars have agreed that the way in which students perceive their learning environments influences their academic performance. Empirical studies that focus on architecture students, however, have been very scarce. This is the gap that an attempt is filled in this study. A questionnaire survey of 273 students in a school of architecture in Nigeria provided data for this pilot study. The perceptions of the students were best defined by the involvement of the students in their studies, the perceived support, and conduciveness of the learning environment. The students’ perceptions of their learning environment varied with their years of study, age and gender. Their perceptions of inflexibility of schedule, positive assessment, and fairness influenced the overall grades of students. The results suggests which aspects of learning environment that can be manipulated by architectural educators to improve the performance of their students. The study of the learning environment of architecture students still appears to be relatively unexplored. The value of this study therefore lies in its exploration of the perceptions of the learning environment from the point of view of students.     

The role of social capital in students’ perceptions of progress in higher education

This paper aims to analyse the effects of students’ social relationships at university on students’ success. Specifically, whether a student with heterogeneous relationships obtains better academic results than a student whose relationships are mostly with classmates. Further, the research examines whether students’ social relationships make up for their parents’ lack of human capital. A survey was answered by a sample of 867 students from universities in the metropolitan region of Barcelona. The findings suggest that the effects of social relationships are not always positive. The benefits of social networks at university interact with the type of degree studied, the student’s dedication to studies, and the student’s social class. Perceptions of progress for each category of students is different: It is more positive for those with frequent heterogeneous relations, who do not work or do so for a few hours, and for those who are enrolled in “hard” science courses.     

Service user and carer involvement in students’ classroom learning in higher education

The following article presents a small-scale qualitative study in which the student learning experiences from service user and carer (SUAC) involvement in social work, mental health nursing and social welfare courses at an English university were evaluated for any effects on student perceptions, knowledge, skills and practice. Using focus group methodology, student participants reported positive outcomes from exposure to SUAC classroom inputs such as a greater valuing of SUAC knowledge as expert knowledge, help with the development of empathy and an appreciation of constructive challenges to mainstream curricular delivery. Notes of caution were identified, particularly in respect of the sometimes unexpected levels of emotion displayed by SUAC presenters. Recommendations for meaningful SUAC involvement in higher education are made regarding the need to involve SUACs across the whole duration of a course; the need for the preparation of both students and presenters regarding boundaries; the fit of presentations with intended learning outcomes; more partnership delivery in classrooms between academics and SUACs (possibly with a differentiation between theoretical and practice inputs); the opportunities for SUACs to present their own situations as real rather than hypothetical case studies for students and the possibilities that may result from introducing a ‘buddying’ system between students and SUACs throughout their studies. It is suggested that the insights from this small-scale study merit further exploration on a larger scale if policy and practice in the field of service and user involvement in higher education are to move forward in an inclusive manner.     

Korean and foreign students’ perceptions of the teacher’s role in a multicultural online learning environment in Korea

This study investigated Korean and foreign students’ perception of the teacher’s role in multicultural online learning environments in Korea. On the basis of a literature review, a survey questionnaire was developed and piloted with 248 university students in Korea. The questionnaire was subsequently modified on the basis of the results of the pilot study, and a final 20-item questionnaire was constructed. Three hundred and eighty-four university students participated in the main study. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were used for statistical analyses. The results indicated that students have a particular perception of the teacher’s role in a multicultural online learning environment. Five different types of teacher’s roles—pedagogical, managerial, technical, affective, and differentiating—were identified. The teacher’s affective and differentiating roles, which were not identified as crucial in previous research, were found to be significant roles for both Korean and foreign students.     

Development and application of a scale to measure students’ STEM continuing motivation

ABSTRACT

The aim of this study was to develop a scale to measure students’ STEM continuing motivation (CM). In accordance with the conceptualisation of CM by Maehr (1976. Continuing motivation: An analysis of a seldom considered educational outcome. Review of Educational Research, 46(3), 443–462. doi:10.3102/00346543046003443), we define STEM CM as students’ tendencies to actively engage in STEM-related activities. The STEM Continuing Motivation Scale was developed from a literature review and student cognitive interviews, and was validated on a sample of 465 Chinese 7th and 8th graders. The results demonstrated that the developed scale had high reliability (Cronbach’s α?=?0.91) and good validity. Analysis of variance (ANOVA) showed that boys had significantly higher STEM CM than girls and there were significant differences in engineering CM among students from different schools. The implications of the findings of this study are also discussed.     

Staying the distance: students’ perceptions of enablers of transition to higher education

Students’ perceptions during their first semester at university may be critical in the decision to continue or discontinue studies. In this study we consider students’ perceptions of what factors enable successful transition to university. Using qualitative research, students’ perceptions are obtained by in-depth interviews and focus groups that capture the first- and second-order perspectives of existing students at the end of first-year studies. Interview and focus-group themes are used to develop an 80-item questionnaire that is then used to collect data from first-year students (n?=?771) at an Australian university. Key findings from the research are the identification of seven enabling factors that fall into two main groups, student-centred and university-led. Identifying enablers of transition provides universities with the opportunity to assist students in the successful transition to higher education.     

Technology use and learning characteristics of students in higher education: Do generational differences exist?

As digital technologies form an inextricable part of young people's everyday lives, some commentators claim that the current generation of learners think and learn differently from their predecessors. This study investigated the validity of this claim by surveying 799 undergraduate and 81 postgraduate students at a large research‐intensive university in New Zealand to document their use of digital technologies on university and social activities and comparing three age groups of students (under 20, 20–30 and over 30) to see whether there were any differences in their learning characteristics. The findings of the study showed that while students spent a large amount of time on digital technologies, the range of digital technologies they used was rather limited. There were also no practical generational differences in the technology use pattern and learning characteristics found in this study. The results of this study suggest that generation is not a determining factor in students' use of digital technologies for learning nor has generation had a radical impact on learning characteristics of higher education students.