Checking the underlying structure of R-SPQ-2F using covariance structure analysis / Comprobación de la estructura subyacente del R-SPQ-2F mediante análisis de estructura de covarianza

The R-SPQ-2F is an instrument used in many studies to measure learning approaches. However, its internal structure is still a matter of debate. It is important to confirm its underlying structure in order to find out which variables are being measured with it. A survey method is used with 279 students of the Faculty of Education at the University of León, and alternative models found in the literature are compared using covariance structure analysis, specifically, Confirmatory Factor Analysis (CFA). We conclude that the structure that best fits the data is a two-factor structure in line with the results obtained in other studies. Future research should take these two primary factors into account when interpreting their findings. Solutions are also offered for improving the scale with the original 20 items.     

University students’ learning approaches: An adaptation of the revised two-factor study process questionnaire to Norwegian

This paper reports a Norwegian validation study of a widely used instrument to measure students’ approaches to learning, namely, Bigg’s revised two-factor study process questionnaire (R-SPQ-2F). Its cultural sensitivity and psychometry evaluations have provoked rigorous discussion among educators in different languages. A survey design was adopted involving 253 undergraduate engineering students across two universities. Confirmatory factor analyses were used to test six models hypothesized to reflect the factor structures of R-SPQ-2F and unidimensionality of its subscales. The results showed appropriate fits of a two-factor first-order model with 10 items measuring deep approach and 9 items measuring surface approach subscales. The reliability was found to be high with coefficients of .81, .72 and .63 on deep subscale, surface subscale and the whole instrument respectively. Findings may be interpreted as evidence of cultural sensitivity of the instrument and more validation studies were recommended.     

Consensus-based course design and implementation of constructive alignment theory in a power system analysis course

This article presents the implementation of the constructive alignment theory (CAT) in a power system analysis course through a consensus-based course design process. The consensus-based design process involves both the instructor and graduate-level students and it aims to develop the CAT framework in a holistic manner with the goal of including different perceptions. The considerations required to implement this approach are described in detail. To examine the effect of this approach, three different course evaluations were conducted by querying the students during different stages of the course. These evaluations show that most of the students find a benefit for their learning in the implementation of CAT within the new course design. These observations are supported by a comparison of the students’ performance in the new course and the previous one. Finally, the revised two-factor study process questionnaire (R-SPQ-2F) is utilised to identify the students’ learning approach towards the course. The aim is to correlate the students’ approach with their final grade to assess if students adopting a deep learning approach are rewarded with higher marks and vice versa, that is, to check if the CAT implementation was successful. Meanwhile, some of the R-SPQ-2F limitations, which affect the quality of the results, are identified and discussed. Additionally, to facilitate the practical usage of R-SPQ-2F, an algorithm was developed by the authors to rank the students’ approach towards the course. The results of the new ranking algorithm demonstrate positive correlation with the students’ final grade, which is an indication of the effective CAT implementation.     

Self-regulation in three types of online interaction: a scale development

The purpose of this study was to develop a scale with which to examine students’ self-regulation (SR) in three types of online interaction. Using scale development steps, we constructed the online self-regulation questionnaire (OSRQ), a self-report survey. A total of 799 online students participated in the study. Data from 400 randomly selected participants were used for exploratory factor analysis (EFA), and data of the remaining 399 participants were used for confirmatory factor analysis (CFA). The EFA yielded three factors as hypothesized: SR in interaction between student and content, SR in interaction between student and student and SR in interaction between student and teacher. The CFA demonstrated that the factor structures appearing in the EFA were also observed with different participants. In addition, we found convergent validity in the OSRQ. The study contributes to understanding SR in online learning settings.     

Exploring the underlying factor structure of the home literacy environment (HLE) in the English and Spanish versions of the Familia Inventory: A cautionary tale

Few research-based measures of the family literacy environment are commercially available, especially in Spanish. One exception is the Familia Inventory (Taylor, 1995). The present study investigated the 10 subscales of this instrument and the factor structure they imply, using data from a low-socioeconomic (SES), largely Hispanic population. Confirmatory factor analysis (CFA) was used to test the structure of the instrument as well as whether it is invariant across English and Spanish language versions. The scale was administered to 232 parents of preschoolers. Results of the CFA revealed that the a priori dimensions of the Familia Inventory were not supported for this sample. Follow-up analyses suggested poor fit both within and between subscales. The scale fit poorly within both English and Spanish, precluding testing of invariance across language. Supplemental analyses using exploratory factor analysis (EFA) on a subset of the items that had adequate variance suggested that a four-factor solution accounting for 53% of the variance best represented the English data and that a two-factor solution accounting for 43% of the variance best represented the Spanish data. Implications are discussed.     

Student learning approaches in the UAE: the case for the achieving domain

The deep versus surface learning approach dichotomy has dominated recent research in student learning approach dimensions. However, the achievement dimension may differ in importance in non-Western and vocational tertiary settings. The aim was to assess how Emirati tertiary students could be characterized in terms of their learning approaches. The study looked into emergent learning factors that may be important in Emirati students. The students were Emirati men in a first-year English for academic purposes programme at a tertiary college (N?=?252). The students completed the Revised Two-Factor Study Process Questionnaire (R-SPQ-2F) to determine learning orientation along the deep and surface approach dimensions. A factor analysis was carried out to assess emergent dimensions in the data. The results on the deep and surface dimensions were inconclusive. However, the factor analysis suggested a disposition towards a construct that we characterize as ‘attainment of satisfaction from learning’. In addition, the factor analysis suggested the possibility of the achieving domain emerging as a separate construct from the surface domain in this context, contrasting with previous research employing the R-SPQ-2F. The results suggest that the deep versus surface learning approach model may not sufficiently represent the complexity of student motivations and strategies in the current context. In addition, student affect tied to outcomes is discussed as an important though perhaps overlooked dimension in non-Western contexts. The implications of the results to future research are considered.     

The relationship between students’ approaches to learning and the assessment of learning outcomes

The purpose of the present study is to gain more insight into the relationship between students’ approaches to learning and students’ quantitative learning outcomes, as a function of the different components of problem-solving that are measured within the assessment. Data were obtained from two sources: the revised two factor study process questionnaire (R-SPQ-2F) and students’ scores in their final multiple-choice exam. Using a model of cognitive components of problem-solving translated into specifications for assessment, the multiple-choice questions were divided into three categories. Three aspects of the knowledge structure that can be targeted by assessment of problem-solving were used as the distinguishing categories. These were: understanding of concepts; understanding of the principles that link concepts; and linking of concepts and principles to application conditions and procedures. The 133 second year law school students in our sample had slightly higher scores for the deep approach than for the surface approach to learning. Plotting students’ approaches to learning indicated that many students had low scores for both deep and surface approaches to learning. Correlational analysis showed no relationship between students’ approaches to learning and the components of problem-solving being measured within the multiple choice assessment. Several explanations are discussed.     

Conceptualisation and development of the physics related personal epistemology questionnaire (PPEQ)

This study was designed to develop an assessment tool to measure high school students’ personal epistemology (PE) in the physics domain by using validation processes. Based on theoretical foundations of PE, the PPEQ was conceptualised on six hypothetical dimensions: structure of knowledge [SK], justification of knowledge and knowing [JK], changeability of knowledge [CK], equations in physics [EQ], quick learning [QL], and source of knowledge [source]. In total, 42-items were developed deductively for these dimensions, and a panel of experts assessed the content validity of the instrument. Subsequently, factor analyses were performed to obtain construct-related evidence. First, exploratory factor analysis (EFA) was performed on the data collected from 362 ninth graders. EFA yielded a six-factor solution which excluded the EQ and divided SK into two dimensions: coherent SK and hierarchical SK. Second, confirmatory factor analysis (CFA) was conducted with the remaining 27-items on data collected from a new sample of 350 ninth graders. The CFA results confirmed that the PPEQ assesses six factors emerged from EFA. Internal consistency of the PPEQ was also found to be very high with Cronbach’s α reliability coefficient of .92, and the coefficients of dimensions ranged from .71 to .83.     

To assess or not to assess holistic competencies – Student perspectives in Hong Kong

Despite the importance of holistic competencies, universities have not yet been able to successfully embrace holistic competencies (HC) as part of students’ assessment in their curricula. HC are often part of a hidden curriculum – they tend to be assessed together with academic knowledge, and not assessed explicitly. Based in Hong Kong, this research developed a questionnaire to study university students' perceptions of the formal assessment of HC and how students’ perceptions could be bound to the sociocultural context. Through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), two dimensions of perceptions were derived from the responses of 300 respondents: (a) students’ acceptance of formal HC assessment, and (b) their preference for quantitative scoring in the formal assessment of holistic competencies. Findings reveal that students’ perceptions of formal HC assessment were generally considered positive. However, the majority of students appeared to favour pass/fail grading compared to quantitative assessment. As assessment drives learning, this study reinforces the need for universities to incorporate students’ perspectives in policies regarding HC assessment and highlights the role of culture in influencing student perceptions.     

中学生班级集体效能感量表的初步编制

根据研究和访谈结果,编制中学生班级集体效能感初测问卷,对194名中学生进行测试,结果用于探索性分析。对1773名中学生的测试结果用于验证性因素分析。159人完成重测,359人同时完成校标检验。探索性因素分析获得获得四个因素：合作、能力、预期和努力,解释了总变异的52．62％;验证性因素分析显示,四因素模型的各项参数达到可接受的水平;量表的内在一致性α系数和分半信度分别为0．878和0．859,重测信度为0．703,采用高峰强等人的集体效能信念量表作为班级集体效能感测量的效标,结果相关系数为0．541。因此,该量表具有较好的信效度,可应用于中学生群体。     

大学生求职资源动员行为的结构与测量——基于北京高校毕业生的实证研究

本文依据北京13所不同层级高校1341名毕业生的实证调研数据,运用主成分分析法与结构方程模型比较,从资源动员视角分析了大学生求职行为的结构特征.研究发现,大学生求职行为的结构由四因素构成;中国大学生动员所属高校就业资源,是其重要的求职行为特征.     

‘I can do it,and how!’ Student experience in access and equity pathways to higher education

Alternative pathways and enabling courses such as foundation programmes are well-established in some tertiary institutions and are likely to be broadened and enhanced across the sector. If such a course is designed along the lines of Biggs’ constructive alignment, it would be hoped that students would be likely to adopt a ‘deep approach’ to learning through their course of study. In addition, it is often assumed (but rarely properly demonstrated) that such courses promote the confidence of students to achieve well in their academic studies. This study explored changes in approaches to learning and academic self-efficacy in the first topic of a Foundation Course, using Biggs’ R-SPQ-2F and a newly developed academic self-efficacy scale. While the findings on approaches to learning were inconclusive, analysis showed a substantial and statistically significant increase in academic self-efficacy.     

Measuring learning: discrepancies between conceptions of and approaches to learning

This study is framed under the student approaches to learning tradition. The aim was to identify convergence in quantitative and qualitative responses of individuals when measuring their conceptions of and approaches to learning with a mixed methods design. A sample of 1110 Spanish Master’s level teacher education students completed a scale on approaches to learning (R-SPQ-2F), and a randomly selected subsample of 111 answered an open-ended question on how they learned. Overall, the qualitative and quantitative data did not support each other, as inventory responses showed a clear predominance of a deep, non-surface approach to learning, whereas qualitative answers reflected a tendency towards lower-order conceptions of learning. Inconsistencies in the results suggest future research ought to use a combination of techniques when exploring constructs such as learning should they wish to draw valid conclusions.     

Understanding learning behaviour of Malaysian adult learners: a cross-cultural sensitive framework

The link between learning and the knowledge-economy is so crucial that the Organisation for Economic Co-Operation and Development has reconceptualised the term knowledge-economy to call it “learning economy”. Ultimately, one of the main challenges of learning and development in the 21st century is to evaluate the significant learning attributes of the adult learners. Literature on Students’ Approaches to Learning (SAL), were used to conceptualise the study. However, researchers have reported the weakness of the SAL for cross-cultural studies. This study acknowledges the importance of cultural issues in the study of learning approaches. The adapted version of SPQ, i.e. R-SPQ-2FM (Revised-Study Process Questionnaire-2 Factors Malaysia) which considers both etic (universal) and emic (culturally specific) characteristics was administered on 532 Malay and 326 Chinese Malaysian adult learners. Results show that there are significant cross-cultural insights between Malay and Chinese adult learners, particularly in the Understanding and Memorising Approach, Career/Achieve Motives constructs, the effects of “work experience” and “time spent on study” have on approaches to learning. Findings above would strengthen “evidence-informed” policy making for Malaysian authorities or regional policy makers in the Asia Pacific.     

Academic achievement among first semester undergraduate psychology students: the role of course experience, effort, motives and learning strategies

This study investigated the relationship between multiple predictors of academic achievement, including course experience, students’ approaches to learning (SAL), effort (amount of time spent on studying) and prior academic performance (high school grade point average—HSGPA) among 442 first semester undergraduate psychology students. Correlation analysis showed that all of these factors were related to first semester examination grade in psychology. Profile analyses showed significant mean level differences between subgroups of students. A structural equation model showed that surface and strategic approaches to learning were mediators between course experience and exam performance. This model also showed that SAL, effort and HSGPA were independent predictors of exam performance, also when controlling for the effect of the other predictors. Hence, academic performance is both indirectly affected by the learning context as experienced by the students and directly affected by the students’ effort, prior performance and approaches to learning.     

On the Exploratory Road to Unraveling Factor Loading Non-invariance: A New Multigroup Rotation Approach

Multigroup exploratory factor analysis (EFA) has gained popularity to address measurement invariance for two reasons. Firstly, repeatedly respecifying confirmatory factor analysis (CFA) models strongly capitalizes on chance and using EFA as a precursor works better. Secondly, the fixed zero loadings of CFA are often too restrictive. In multigroup EFA, factor loading invariance is rejected if the fit decreases significantly when fixing the loadings to be equal across groups. To locate the precise factor loading non-invariances by means of hypothesis testing, the factors’ rotational freedom needs to be resolved per group. In the literature, a solution exists for identifying optimal rotations for one group or invariant loadings across groups. Building on this, we present multigroup factor rotation (MGFR) for identifying loading non-invariances. Specifically, MGFR rotates group-specific loadings both to simple structure and between-group agreement, while disentangling loading differences from differences in the structural model (i.e., factor (co)variances).     

Future time orientation and learning conceptions: effects on metacognitive strategies,self-efficacy beliefs,study effort and academic achievement

During the past decade, research on the constructive learning process has been conducted mainly from two perspectives: student approaches to learning (SAL) and self-regulated learning (SRL). The SAL perspective has highlighted the role of learning conceptions with respect to other topics involved in constructive learning processes, whereas recently the SAL perspective has emphasised the effects of the future time perspective (FTP) and self-efficacy beliefs about these topics. Based on these two lines of research (SRL and SAL), using path analysis, we explored the direct and indirect effects of FTP and learning conceptions on self-efficacy, metacognitive strategies, effort and academic performance. Likewise, we identified some patterns that combine specific factors related to these variables. Participants in the present study were 100 (84% females, 16% males) Spanish fourth year university students enrolled in the Social Sciences Degree Programme. The ages of the students ranged from 18 to 49 (M = 22.02; SD = 3.68) and their participation was voluntary and anonymous. Likert-scale inventories were used to obtain data from students: FTP; learning conceptions; metacognitive strategies scale; and self-efficacy beliefs for SAL. On the one hand, the path analysis showed interesting indirect and direct relationships between topics with regard to key constructs of each of these research perspectives (SRL/SAL). However, these results do not coincide with the body of knowledge about FTP. On the other hand, results obtained using cluster and discriminant analysis revealed three specific patterns: a meaning orientation to learning and the future, a reproductive orientation to learning and the present, and an unusual pattern explained by the influence of historical-cultural characteristics on learning practices in educational contexts. We consider that this last pattern presents relevant implications for educational practice.     

The content and construct development of the PACT survey

The authors created a psychometrically sound instrument that could be used to examine K-12 teachers’ perceptions of arts integration. Ten content experts reviewed the initial survey items for construct-fit and readability. Scores from 354 K-12 teachers were examined for the survey’s initial factor structure through exploratory factor analysis (EFA). Then, scores from 1,072 K-12 teachers were analyzed to complete a confirmatory factor analysis (CFA) of the Putting the Arts and the Classroom Together (PACT) data. EFA results indicated a three-factor structure (i.e., value, willingness, and barriers), and CFA results produced model indices showing good fit of the three-factor model. For purposes of examining teachers’ practices in integrating the arts, establishing teacher receptiveness to arts integrated curriculum is important in designing and implementing any professional development program. This survey could be used to establish baseline participant perceptions for staging targeted professional development to support educators in creating appropriate arts integrated curricula.     

Cultural,social, and economic capital constructs in international assessments: an evaluation using exploratory structural equation modeling

The article employs exploratory structural equation modeling (ESEM) to evaluate constructs of economic, cultural, and social capital in international large-scale assessment (LSA) data from the Progress in International Reading Literacy Study (PIRLS) 2006 and the Programme for International Student Assessment (PISA) 2009. ESEM integrates the theory-generating approach of exploratory factor analysis (EFA) and theory-testing approach of confirmatory factor analysis (CFA). It relaxes the zero-loading restriction in CFA, allowing items to load on different factors simultaneously, and it provides measurement invariance tests across countries not available in EFA. A main criticism of international LSA studies is the extended use of indicators poorly grounded in theory, like socioeconomic status, that prevent the study of mechanisms underlying associations with student outcomes. This article contributes to addressing this criticism by providing statistical criteria to evaluate the fit of well-defined sociological constructs with the empirical data.     

Validation of a Norwegian Version of the Approaches and Study Skills Inventory for Students (ASSIST): Application of structural equation modelling

The Approaches and Study Skills Inventory for Students (ASSIST) were administered to 573 under-graduate students in order to analyse a Norwegian version of this inventory. To cross-validate the factor structure, the subjects were divided into two equal samples. Principal axis factor analysis of sample 1 reproduced the three main factors of deep, surface and strategic approaches to learning. However, two of the subscales failed to load appropriately on the 'strategic approach'. When omitting these subscales, the principle of simple structure was better supported by the results. A subsequent CFA with comparison of samples 1 and 2 supported the existence of the expected three-factor model. It is concluded that this Norwegian version of ASSIST is valuable as a research tool for the assessment of approaches to learning among Norwegian students, but that caution should be taken with respect to the interpretation of particular subscales and possible sample effects.