Development and Validation of an Instrument for Assessing Distance Education Learning Environments in Higher Education: The Distance Education Learning Environments Survey (DELES)

The purpose of this study was to develop and validate a new learning environments instrument designed to aid investigators and practitioners in measuring and researching the psychosocial learning environment in post-secondary distance education. Using a three-stage approach, the Distance Education Learning Environments Survey (DELES) was developed, field-tested with 680 distance education students, and then validated. The DELES has 34 items allocated to six scales: (1) Instructor Support; (2) Student Interaction and Collaboration; (3) Personal Relevance; (4) Authentic Learning; (5) Active Learning; and (6) Student Autonomy. An additional scale of Enjoyment was included in this study to explore associations between the psychosocial learning environment and student affective traits. Each learning environment item had a factor loading of at least 0.50 with its own scale, and less than 0.50 with all other scales. The alpha reliability coefficient for each scale ranged from 0.75 to 0.94. Simple correlations between Enjoyment and the DELES scales ranged from 0.12 to 0.31, with the scale of Personal Relevance having the strongest correlation with Enjoyment when all other scales were mutually controlled. The DELES, an online instrument that can be utilized by students at any location, eliminates data transfer errors and does not allow for non-responses, adding to the overall validity of the instrument. The development of DELES relied extensively on literature pertaining to high-quality distance education and expert content validation techniques. It treats distance learning as having a distinct social-psychological climate unlike those found in other post-secondary classroom environments.     

Revisiting Zhang’s scale of transactional distance: refinement and validation using structural equation modeling

Transactional distance has been defined as barriers to students’ engagement with learning in the online environment. This research updates Zhang’s (2003) scale of transactional distance, which quantified the extent of the barriers, in light of the massive changes in today’s web-based learning environment. The resulting revised scale of transactional distance (RSTD) is a parsimonious version with 12 elements (compared to 31 original) that measure the transactional distance between student and teacher, student and student, and student and content. The RSTD has excellent factorial validity and reliability, yields better fit statistics, and is easier and less time-consuming to apply. The transactional distance values are unique predictors of student satisfaction, which is correlated to learning and persistence (a major concern with massive open online courses). This information can form the basis for a systematic approach to improving the design of today’s contemporary open, flexible, distance education courses and thus serve as a valuable tool for researchers and educators alike.     

Validation of the Career Adapt-Abilities Scale–Short Form across different age groups in the Turkish context

A short 12-item version of the Career Adapt-Abilities Scale–Short Form (CAAS-SF) was validated across three different age groups in the Turkish context. Scale scores demonstrated adequate to high internal consistency and 4-week test–retest reliability, good fit with the original four-factor model, factorial invariance across gender and age groups, strong convergence with the 24-item version, negative associations with trait anxiety and work stress, and positive associations with career decision self-efficacy. It was concluded that the Turkish version of the CAAS-SF appears to be a valid and reliable measure for assessing career adaptability and using it in career education and counseling process.     

Learning Environment and its Association with Student Satisfaction Among Mathematics Students in Brunei Darussalam

This article reports a study of lower secondary mathematics classroom learning environment in Brunei Darussalam and its association with students' satisfaction with learning mathematics among a sample of 1565 students from 81 classes in 15 government secondary schools. Students' perceptions of the classroom learning environments were assessed with a version of the My Class Inventory (MCI) that had been modified for the Brunei context. The study revealed a satisfactory factor structure for a refined three-scale version of the MCI assessing cohesiveness, difficulty and competition. This finding is noteworthy because the factorial validity of the MCI has not previously been established in past research in other countries. Also each scale displayed satisfactory internal consistency reliability and discriminant validity and was able to differentiate between the perceptions of students in different classes. A one-way MANOVA revealed that students generally perceived a positive learning environment in mathematics classes. Also the study supported earlier research suggesting that boys and girls hold different perceptions of the same classroom learning environments. Relationships between student satisfaction and classroom environment were investigated using simple and multiple correlation analyses, using both the individual student and class mean as units of analysis. Associations between satisfaction and the learning environment were statistically significant both at student and class levels for most MCI scales. This revised version was published online in August 2006 with corrections to the Cover Date.     

A questionnaire on mathematics learning strategies (CEAMA): measurement and properties of an adaptation into Spanish / Cuestionario de Estrategias de Aprendizaje para las Matemáticas (CEAMA): medida y propiedades de una adaptación en lengua castellana

Learning strategies are an essential tool to enable the autonomous and active learning of mathematics and it is therefore necessary to identify these strategies correctly. The objective of this research is to analyse the factorial structure of the Spanish version of a questionnaire that measures the use of these strategies in the subject of mathematics (Cuestionario de Estrategias de Aprendizaje para las Matemáticas [CEAMA]). We adapt a questionnaire based on the MSLQ (Motivated Strategy for Learning Questionnaire), since it is focused on the context of mathematics learning. The study has been conducted in different schools located in the Basque Country and collects data from 631 students of the second, third and fourth years of compulsory secondary education (ESO). The results show a hepta-scale structure compared to the six-scale structure proposed by the original English version. The difference is detected in the division of metacognitive strategies into two factors: planning and monitoring/regulation. This finding improves data on metacognition in mathematics teaching and learning, making it richer and more exhaustive. The suitability of certain items is discussed.     

Development and validation of a modified Turkish version of the Teacher Constructivist Learning Environment Survey (TCLES)

The Constructivist Learning Environment Survey is an instrument used for assessing students’ and teachers’ perceptions of their learning environments. The Teacher Constructivist Learning Environment Survey (TCLES) was created to better enable teachers and researchers to determine teachers’ perception of their use of constructivist approaches in their classrooms. This article reports the development and validation of a modified Turkish version of the TCLES with 449 teachers chosen randomly from primary schools in Turkey. The validity of the TCLES was investigated by means of explanatory and the confirmatory factor analyses, whereas the Cronbach alpha coefficient was used to assess the internal consistency of the scales. The factor analyses were carried out to check the factor structure of the Turkish adaptation of TCLES. The factor analysis revealed that the Turkish adaptation of the original survey consisted of 30 items with the same six-scale structure as the original survey.     

A Revision of the Biggs' Study Process Questionnaire (R-SPQ)

The Biggs' Study Process Questionnaire (SPQ), an instrument for the evaluation of student learning in higher education, was revised over a three-year period with over 2500 tertiary students. The original instrument structure of 42 items in 6 sub-scales was maintained with each item being subject to revision and assessed for internal consistency and appropriateness through a sequence of trial and retrial. The final version consists of 8 original items and 34 revised items. This version was evaluated with 996 students, at first-year and third-year level, through the use of confirmatory factor analysis using AMOS. The two models having the best fit to the data are represented by the original six sub-scale model which loads onto two higher order factors, a deep approach and a surface approach to learning, or a seven sub-scale version which loads on the same two higher order factors. Evidence is presented as to the preference of the latter model.     

The Turkish standardization of the Meadow-Kendall Social-Emotional Assessment Inventory for Deaf and Hearing-Impaired Students

THE ARTICLE present results of standardization of the Meadow-Kendall Social-Emotional Assessment Inventory for Deaf and Hearing-Impaired Students (Meadow, 1983), school-age version, for use in Turkey. The SEAI is a 59-item measure for assessing socioemotional adjustment of school-age deaf and hearing impaired students. A sample of 1,097 deaf students (609 boys, 488 girls), age range 7-19 years, was rated by their teachers (275 teachers: 149 female, 126 male) using the SEAI. Data were drawn from four types of educational settings: residential, day, special class, mainstream schools. Exploratory factor analysis of the data revealed three main factors of interest, which corresponded to the hypothesized constructs in the original American standardization: Social Adjustment, Self-Image, Emotional Adjustment. The data suggest high reliability and validity of the Turkish version of the SEAI relative to the original American version. Implications of adapting the SEAI for use in Turkey are discussed.     

A Multidimensional Approach to Understanding College Writing Processes

The aims of this study were to confirm the factor structure of college writing processes as measured by the Inventory of College Composition, and to test for a second-order, deep and surface structure, as suggested in the literature on college learning and writing. Confirmatory factor analysis was used to examine the dimensionality of the model based on the responses of 517 undergraduate students enrolled in general education courses. Results support the construct validity of the original model, as well as binary second-order factors, reflective of the deep and surface processes. Conclusions address the nature of the interrelationships of writing processes, and suggestions for instruction.     

Examining research on the impact of distance and online learning: A second-order meta-analysis study

Distance learning has evolved over many generations into its newest form of what we commonly label as online learning. In this second-order meta-analysis, we analyze 19 first-order meta-analyses to examine the impact of distance learning and the special case of online learning on students’ cognitive, affective and behavioral outcomes. We examine to what extent distance learning generation level, and instructional setting moderate the influences of distance learning on cognitive, affective and behavioral outcomes. This second-order meta-analyses also analyzes the first-order meta-analyses for methodological quality and robustness. The findings revealed a statistically significant overall average effect size (g = 0.156, p < .001 with a 95% confidence interval of 0.087–0.224) of distance learning impacting cognitive, affective and behavioral outcomes in comparison to face-to-face learning. Meta-analyses on higher education had a statistically significant larger effect size than K-12 education. Limitations, implications, and directions for future research are discussed.     

Learning environments associated with technology-based science classrooms for gifted Singaporean females

Because there has been very little past research into gifted students’ science learning environments, especially in Singapore, we selected from four established questionnaires six learning environment scales that are consistent with Van Tassel-Baska and Stambaugh’s guidelines for gifted education. These scales were modified slightly to enhance suitability for the target population and refined further based on feedback from teachers and students in a pilot study. Data from administration of the questionnaires to 722 gifted science students in grades 9 and 10 were analysed to provide support for the questionnaire’s factorial validity, internal consistency reliability, ability to differentiate between classrooms, and predictive validity (in terms of associations with self-efficacy). To evaluate a new one-student one-laptop program being implemented for the first time, we compared the learning environments of this program with regular classrooms and found higher levels of perceived investigation, task orientation, collaboration, computer usage and formative assessment in technology-based classrooms.

     

Assessment of the psychosocial environment of university science laboratory classrooms: a cross-national study

A strong tradition in educational research has involved several widely-used instruments assessing student or teacher perceptions of characteristics of actual or preferred classroom psychosocial environment. Existing instruments, however, are unsuitable for one of the most important settings in science teaching, namely, the science laboratory class. Consequently, the present research aimed to develop and validate a new instrument, the Science Laboratory Environment Inventory (SLEI), which is specifically suited to science laboratory environments at the higher education level. The SLEI assesses students' or teachers' perceptions of five dimensions of actual or preferred classroom environment, namely, Student Cohesiveness, Open-Endedness, Integration, Rule Clarity, and Material Environment. A distinctive feature of the design of the study was that the instrument was field tested and validated cross-nationally in six different countries, namely, the USA, Canada, Australia, England, Israel, and Nigeria. The total sample consisted of 1720 students in 71 university laboratory classes. Various item and factor analyses guided the evolution of a refined version, and attested to each SLEI scale's internal consistency reliability, discriminant validity, factorial validity, predictive validity (i.e., ability to predict student outcomes), and ability to differentiate between the perceptions of students in different classes. An important finding was that the SLEI is equally valid for use in its actual and preferred versions, and for the individual or the class mean as the unit of analysis. As well, separate within-country analyses confirmed the validity and usefulness of the SLEI in each of the six countries involved in the field testing. Overall, the study attested to the general advantages of employing cross-national designs in learning environment research.     

The Expectancy-Value Questionnaire in Physical Education: A Validation Study Among Norwegian Adolescents

One of the main aims of the school subject physical education (PE) is to promote a lifelong healthy lifestyle. The expectancy-value theory represents an essential theoretical perspective to examine and understand adolescents’ learning and motivation in PE. Based on this theory, the Expectancy-Value Questionnaire (EVQ) measures students’ expectancy-related beliefs and perceived task values related to a subject like PE. The aim of the present study was to examine the dimensionality, reliability, and construct validity of the Norwegian version of the EVQ among adolescents in PE. In total, 338 students from six schools completed the EVQ in their PE classes during the spring of 2016. Explorative and confirmatory factor analyses were conducted, suggesting the four-dimensional construct of the EVQ to be superior the two-factor-model. The EVQ measurement model of adolescents’ expectancy-related believes and subjective task values in PE demonstrated satisfying reliability and construct validity.     

Approaches to teaching in higher education: Validation of a Dutch version of the Approaches to Teaching Inventory

The Approaches to Teaching Inventory (ATI) is used to examine teachers’ teaching approaches in higher education. Analyses into the validity and reliability of the original English ATI yielded positive results. In this study, we examined the degree to which these positive results can also be found for the Dutch version that we developed. Data were gathered from 377 teachers at the University of Antwerp (Flanders, Belgium) and three Antwerp university colleges. Confirmatory factor analyses and principal factor analyses with oblique rotation support a model with sub-factors belonging to two main factors. Our research supports the reliability and validity of our current Dutch version of the ATI. Consequently, the instrument can be used in educational research or practice to obtain insights into the teaching approach of teachers. Further research into differences in the structure of the ATI when used in different cultures would be valuable.     

Evaluating the perception of disability and the inclusive education of teachers: the Italian validation of the Sacie-R (Sentiments,Attitudes, and Concerns about Inclusive Education – Revised Scale)

This study aimed to verify the factorial structure, internal validity, reliability, and criterion validity of The Sentiments, Attitudes and Concerns about Inclusive Education Revised Scale (SACIE-R) in an Italian sample. The SACIE-R is a useful tool to measure three aspects of teachers’ perceptions about inclusion, which are Sentiments, Attitudes and Concerns, providing valuable information to address the needs of teachers working with special students. A measure of this construct is currently not available in Italian, and a validation process is required. In order to provide an initial psychometric evaluation of the Italian adaptation, the SACIE-R was translated for use in Italian-speaking populations. Four hundred Italian teachers enrolled in educational teaching courses completed the SACIE-R. Confirmatory factor analyses demonstrated a good fit to the hypothesised 3-factor model, and adequate internal consistency for the scale was evidenced. A confirmatory factor analysis showed the same factor structural validity as the original instrument (although some items in the original version were deleted). Furthermore, taken together, the results showed a good level of reliability, and convergent and discriminant validity. Finally, the Italian version of the SACIE-R has good psychometric characteristics that can make it a useful measure of teacher attitude toward inclusion in the Italian educational context.     

Results of use of Machines for Testing and for Drill,upon Learning in Educational Psychology

The Work Components Study (WCS) questionnaire is a measure of work motivation with predictive powers as a selection device on a probabilistic basis for industrial managers. This study established the factorial validity and reliability of a modified WCS-the Educational Work Components Study (EWCS) questionnaire. The sample of 745 included 153 senior and forty-two graduate students and 118 administrators and 432 teachers randomly selected from three school districts. The data analyses consisted of varimax orthogonal and maxplane oblique R-factor analysis procedures and Cronbach’s estimate of internal consistency. Instead of sixty-six items and seven prevalent factors in the WCS, fifty-six items and six unidimensional factors paralleling the original instrument were found in the EWCS. The reliabilities of the six factors ranged from .73 to .83. These findings coupled with the strong theoretical foundation of the EWCS indicate a high potential for probing many provocative relationships based on work motivation.     

An Assessment of the Quantitative Literacy of Undergraduate Students

Quantitative literacy (QLT) represents an underlying higher-order construct that accounts for a person's willingness to engage in quantitative situations in everyday life. The purpose of this study is to retest the construct validity of a model of quantitative literacy (Wilkins, 2010). In this model, QLT represents a second-order factor that accounts for the interrelationship among three first-order factors: mathematical beliefs, mathematical disposition, and mathematical cognition. Using data from two samples of undergraduate students (n = 186 and n = 184), a series of confirmatory factor analyses were conducted. Results supported the hierarchical three-factor structure and confirmed its factorial invariance across multiple groups of students. Latent QLT scores from the model were used to compare and rank student QLT by gender and class standing.     

An international validation of the engaged teacher scale

The purpose of this study was to test and validate the Engaged Teacher Scale (ETS) in a Turkish context (ETS-TR). In order to test the construct validity of the ETS, data were collected from 388 teachers in two northeast cities of Turkey. First-order confirmatory factor analysis results supported the 16-item and four-factor model of ETS while second-order confirmatory factor analysis suggested that a single factor was also appropriate for representing teacher engagement. Additionally, four multiple linear regression analyses were conducted to provide further validation evidence. Results showed that subscales of the ETS-TR were found to be positively correlated with teacher self-efficacy. Given our evidence of validity and reliability, we recommend researchers interested in measuring the engagement of Turkish teachers to consider using the ETS-TR. The adaptation of ETS into Turkish also provides a measure for use when conducting research examining cultural comparisons between english-speaking and Turkish teachers.     

Development and validation of the Place-Based Learning and Constructivist Environment Survey (PLACES)

Learning environment studies acknowledge that learning takes place within the social realm and that social conditions contribute to the quality of both learning and experience. This can be said to be especially true for environmental learning programs. To access information about students?? perceptions of their learning environment, a robust instrument for describing and measuring student perceptions of environmental education in place-based educational settings was developed and validated. Focus groups with environmental educators were formed to explore (from teachers?? perspective) the factors viewed as most important to environmental learning and as most likely to influence the unique type of learning environments fostered in place-based or community-based environmental education programs. Analysis of qualitative work resulted in the inclusion of eight scales developed/adapted from previous learning environment surveys for use in the new Place-Based Learning and Constructivist Environment Survey for use in secondary settings. In this article, validity and reliability data for this instrument are presented and the implications of these data for future research within environmental education, place-based education and teacher education programs are discussed.     

Development and Validation of the College Campus Environment Scale (CCES): Promoting Positive College Experiences

One of the essential factors related to student success and satisfaction with a higher education experience is the college environment in which learning takes place. The purpose of this study was to develop a scale, the College Campus Environment Scale (CCES), to measure characteristics of college campus environments valued by students. A model emerged with the following six factors: Academic and Career Expectations, Athletics, Health, Role Models and Mentors, Safety, and Social and Extracurricular Activities. The CCES demonstrates good evidence of reliability and validity and can be utilized by researchers and college personnel to promote positive college experiences for students.