Self-regulated learning in Singaporean context: a congeneric approach of confirmatory factor analysis

The motivated strategies for learning questionnaire (MSLQ) is widely used as a self-report instrument to assess students’ motivation and self-regulation. This study utilized the MSLQ Junior High to examine the motivational beliefs and self-regulation of secondary school students (Grades 8 and 9) from Singapore. The instrument was slightly modified and administered to students (N?=?610) in mathematics and science classes. In the first sample, 314 students completed the MSLQ Junior High while a second sample of 296 students completed the revised MSLQ Junior High. Using a congeneric approach of confirmatory factor analysis (CFA), the five-factor measurement model was determined with the first sample. This measurement model was further supported using a second sample and its goodness-of-fit indices were compared with other CFA models. Statistical findings showed that the five-factor structure of the revised MSLQ Junior High had a good model fit. The present study contributes a novel methodological approach by investigating the parsimony confirmatory factor structure of the revised MSLQ Junior High in local academic contexts.     

Socioeconomic and gender group differences in early literacy skills: a multiple-group confirmatory factor analysis approach

Socioeconomic status and gender are important demographic variables that strongly relate to academic achievement. This study examined the early literacy skills differences between 4 sociodemographic groups, namely, boys ineligible for free or reduced-price lunch (FRL), girls ineligible for FRL, boys eligible for FRL, and girls eligible for FRL. Data on kindergarteners (N = 462) were analysed using multiple-group confirmatory factory analysis. Early literacy skill differences between boys and girls are more nuanced than previously reported; subsidy status and gender interact. Both boys and girls from high-poverty households performed significantly lower than the girls from low-poverty households in alphabet knowledge, phonological awareness, and spelling. There were gender gaps, with a female advantage, among children from high-poverty households in alphabet knowledge and spelling and among children from low-poverty households in alphabet knowledge. These results highlight the importance of employing methodologically sound techniques to ascertain group differences in componential early literacy skills.     

Validation of the child sex abuse attitude scale through confirmatory factor analysis

A validation study was conducted on the Child Sex Abuse Attitude Scale (CSAAS) using confirmatory factor analysis (CFA) to examine factor structure. The CSAAS was developed based on Festinger's (1957) theory of attitude development resulting in a 4‐factor first‐order structure (cognition, value, affect, and behavior) and a single‐factor 2nd‐order structure (attitude). A sample of 215 school psychologists, members of the National Association of School Psychologists, responded to the CSAAS survey. CFA results supported the hypothesized factor structure of the CSAAS, thus indicating the plausibility of a 4‐factor 1st‐order and a single‐factor higher order structure of the CSAAS.     

Model Misspecification and Invariance Testing Using Confirmatory Factor Analytic Procedures

Confirmatory factor analytic procedures are routinely implemented to provide evidence of measurement invariance. Current lines of research focus on the accuracy of common analytic steps used in confirmatory factor analysis for invariance testing. However, the few studies that have examined this procedure have done so with perfectly or near perfectly fitting models. In the present study, the authors examined procedures for detecting simulated test structure differences across groups under model misspecification conditions. In particular, they manipulated sample size, number of factors, number of indicators per factor, percentage of a lack of invariance, and model misspecification. Model misspecification was introduced at the factor loading level. They evaluated three criteria for detection of invariance, including the chi-square difference test, the difference in comparative fit index values, and the combination of the two. Results indicate that misspecification was associated with elevated Type I error rates in measurement invariance testing.     

Two-Step Approach to Partial Factorial Invariance: Selecting a Reference Variable and Identifying the Source of Noninvariance

To date, no effective empirical method has been available to identify a truly invariant reference variable (RV) in testing measurement invariance under a multiple-group confirmatory factor analysis. This study proposes a method that, in selecting an RV, uses the smallest modification index (min-mod). The method’s performance is evaluated using 2 models: (a) a full invariance model, and (b) a partial invariance model. Results indicate that for both models the min-mod successfully identifies a truly invariant RV (Study 1). In Study 2, we use the RV found in Study 1 to further evaluate the performance of item-by-item Wald tests at locating a noninvariant variable. The results indicate that Wald tests overall performed better with an RV selected in a partial invariance model than an RV selected in a full invariance model, although in certain conditions their performances were rather similar. Implications and limitations of the study are also discussed.     

The effect of high-stakes examination systems on teacher beliefs: Egyptian teachers’ conceptions of assessment

Egypt is currently attempting to introduce a greater formative use of assessment while maintaining a public examination system. This study investigates teacher beliefs about the purposes of assessment in Egypt, using the Teachers’ Conceptions of Assessment (TCoA) inventory. The TCoA inventory elicits responses about four main factors: Improvement, School Accountability, Student Accountability and Irrelevance. A large sample of (n?=?507) Egyptian pre-service and in-service teachers completed an Arabic version of the TCoA inventory. Confirmatory factor analysis was used to test the Egyptian teachers’ responses against the pre-existing New Zealand model, which was found to be inadmissible. Consequently, an ecologically rational three-factor model was found. The model yielded a strong positive relationship between Improvement and Student Accountability, consistent with previous studies. It is argued that greater changes to the examination system are required if teacher beliefs are expected to be more positive about the priority of formative, improvement-oriented uses of assessment.     

Confirmatory factor analysis of achieving the beginning teacher standards inventory

The purpose of this study was to examine the factorial validity and reliability of the Achieving the NASPE Standards Inventory (ANSI) that assesses pre-service physical education teachers' perceptions of achieving the National Association for Sport and Physical Education (NASPE) beginning teacher standards (2003). Four hundred fifty-two pre-service teachers from 15 Physical Education Teacher Education (PETE) programs voluntarily and anonymously completed the inventory. The hypothesized measurement models were analyzed by means of a confirmatory factor analysis. The Goodness-of-fit statistics indicated that the modified 3-factor model with 38 items represented a best fitting model with the data. The scores generated by the total and the 3 subscales of the 38-item ANSI demonstrated a high level of internal consistency.     

The potential of anchoring vignettes to increase intercultural comparability of non-cognitive factors

ABSTRACT

We investigate whether Anchoring Vignettes (AV) improve intercultural comparability of non-cognitive student-directed factors (e.g., procrastination). So far, correlation analyses for anchored and non-anchored scores with a criterion have been used to demonstrate the effectiveness of AV in improving data quality. However, correlation analyses are often used to investigate external validity of a scale. Nonetheless, before testing for validity, the reliability of the measurement of a construct should be examined. In the present study, we tested for measurement invariance across countries and languages and compared anchored and non-anchored student-directed self-reports that are highly relevant for the students’ self and their behaviour and performance. In addition, we apply further criteria for testing reliability. The results indicate that the data quality for some of the constructs can – in fact – be improved slightly by anchoring; whereas, for other self-reports, anchoring is less successful than was hoped. We discuss with regard to possible consequences for research methodology.     

Video-stimulated recall in cross-cultural research in education: a case study in Vietnam

This paper examines incorporating video-stimulated recall (VSR) as a data collection technique in cross-cultural research. With VSR, participants are invited to watch video-recordings of particular events that they are involved in; they then recall their thoughts in relation to their observations of their behaviour in relation to the event. The research draws on a larger Ph.D. project completed at an Australian university that explored Vietnamese lecturers’ beliefs about learner autonomy. In cross-cultural research, using the VSR technique provided significant challenges including time constraints of participants, misunderstandings of the VSR protocol and the possibility of participants’ losing face when reflecting on their teaching episodes. Adaptations to the VSR technique were required to meet the cultural challenges specific to this population, indicating a need for flexibility and awareness of the cultural context for research.     

Assessment policy and practice effects on New Zealand and Queensland teachers' conceptions of teaching

Teachers' thinking about four conceptions of teaching (i.e., apprenticeship‐developmental, nurturing, social reform, and transmission) were captured using the Teaching Perspectives Inventory (TPI). New Zealand and Queensland have very similar teaching‐related policies and practices but differences around assessment policies and practices are expected to influence teachers' conceptions of teaching. Results from two surveys (New Zealand primary (n = 241) and Queensland primary (n = 784) and secondary (n = 614) teachers) found acceptably fitting models. TPI models were not invariant between primary and secondary teachers in Queensland while the models for primary teachers in Queensland and New Zealand were partially invariant. There were only small differences in mean perspectives scores, except for transmission, which elicited large differences.     

因子分析和聚类分析在市场研究中的应用

随着我国经济的快速稳健发展,人们对市场问题的研究与探索也逐渐加深,消费者的购买习惯和态度、品牌形象和特性、产品服务质量和市场细分等问题都是重点关注的趋向。由于一些市场问题在研究过程中存在变量个数多、分析机理复杂和数据含量大等问题,因此,因子分析和聚类分析作为两种比较科学和实用的技术就应运而生了,并且在市场研究中得到了广泛的关注和利用。本文叙述了因子分析和聚类分析的概念以及它们在市场研究中的意义,并且详细介绍了因子分析和聚类分析在市场细分中的应用。     

Evaluating Interventions with Multimethod Data: A Structural Equation Modeling Approach

In many intervention and evaluation studies, outcome variables are assessed using a multimethod approach comparing multiple groups over time. In this article, we show how evaluation data obtained from a complex multitrait–multimethod–multioccasion–multigroup design can be analyzed with structural equation models. In particular, we show how the structural equation modeling approach can be used to (a) handle ordinal items as indicators, (b) test measurement invariance, and (c) test the means of the latent variables to examine treatment effects. We present an application to data from an evaluation study of an early childhood prevention program. A total of 659 children in intervention and control groups were rated by their parents and teachers on prosocial behavior and relational aggression before and after the program implementation. No mean change in relational aggression was found in either group, whereas an increase in prosocial behavior was found in both groups. Advantages and limitations of the proposed approach are highlighted.     

Using action research in middle level teacher education to evaluate and deepen reflective practice

The study examined the role of action research in promoting critical reflective thinking among twenty preservice teachers engaged in a year-long middle level program. Data from collaborative discussions, final written documents, presentations, and follow-up surveys revealed that conducting action research (a) engaged them in inquiry into their own practice, (b) was a means to reflect upon and determine ways to change their teaching practices, and (c) promoted critical reflection in a collaborative learning environment. Results underscore the importance of preservice teachers critically reflecting to gain insights into teaching and student learning as they are engaged in action research.     

A cross-cultural validity of the E-learning Acceptance Measure (ElAM) in Lebanon and England: A confirmatory factor analysis

Despite the prevalence and significance of e-learning in education, there is a dearth of published instruments for educational researchers and practitioners that measure users’ acceptance of e-learning. To meet this need, Teo (2010) developed the E-learning Acceptance Measure (ElAM). The main objective of this paper is to validate the ElAM (Teo, 2010) across two cultures, one is from a European country: England, and the other from Asia: Lebanon. A total sample of 461 university students from two private universities in Lebanon (n?=?209) and one university in England (n?=?252) participated in this study. Using confirmatory factor analyses, our findings revealed that the original 3-factor solution for ElAM (Teo, 2010) was supported and found to be adequate for the British sample, whereas the results revealed a bad fit for the Lebanese sample. Despite the differences, the ElAM was found to possess an acceptable level of internal consistency and item reliability for the pooled sample. Theoretical and practical implications are discussed at the end of the paper.     

Challenging the Universality of Achievement Goal Models: A Comparison of Two Culturally Distinct Countries

ABSTRACT

Achievement goal theory is one of the most widespread motivation models within education research. Strong empirical support exists for the trichotomous model, comprising mastery-approach, performance-approach, and performance-avoidance goals. However, research also indicates problems with model transferability between contexts. In this study, based on questionnaire data from 4201 students, we use confirmatory factor analysis to compare the factor structures of students’ achievement goals in two culturally distinct countries. Factor structures for Grades 5–11 within the two countries were also compared. Results show that the separation between performance-approach and performance-avoidance goals differs between the two countries, and that this difference is consistent over the grades. Hence, results indicate that the model is not freely transferable between countries. The results are discussed in relation to differences in national culture and other proposed explanations such as age, perceived competence, and questionnaire characteristics.     

On the Exploratory Road to Unraveling Factor Loading Non-invariance: A New Multigroup Rotation Approach

Multigroup exploratory factor analysis (EFA) has gained popularity to address measurement invariance for two reasons. Firstly, repeatedly respecifying confirmatory factor analysis (CFA) models strongly capitalizes on chance and using EFA as a precursor works better. Secondly, the fixed zero loadings of CFA are often too restrictive. In multigroup EFA, factor loading invariance is rejected if the fit decreases significantly when fixing the loadings to be equal across groups. To locate the precise factor loading non-invariances by means of hypothesis testing, the factors’ rotational freedom needs to be resolved per group. In the literature, a solution exists for identifying optimal rotations for one group or invariant loadings across groups. Building on this, we present multigroup factor rotation (MGFR) for identifying loading non-invariances. Specifically, MGFR rotates group-specific loadings both to simple structure and between-group agreement, while disentangling loading differences from differences in the structural model (i.e., factor (co)variances).     

Development and validation of the Self-Regulated Translation Learning Strategy Scale (SRTLSS)

Self-regulated learning (SRL) has been highlighted as a critical aspect of translation learning. However, past work in translation learning has rarely sought to synthesize translation learning strategies under a self-regulated learning paradigm. Further research would be confined by the paucity of a psychometrically sound instrument to measure learners' self-regulated translation learning strategies. This study aimed to develop a reliable and valid self-regulated translation learning strategy scale (SRTLSS). Based on relevant literature, we hypothesized a hierarchical model and generated items for the SRTLSS. Drawing on the response from 873 Chinese English majors, the validated SRTLSS had 25 items addressing five dimensions: self-control, meaning fulfillment, value and interest, text processing, and retrieving strategies. Results demonstrated the SRTLSS has good measurement validity and reliability with strong invariance across undergraduate and graduate students. The SRTLSS can be used as a complementary tool to diagnose learners' weaknesses and strengths in translation teaching and learning.