Reliability and Validity Evidence for Achievement Goal Models in High School Physical Education Settings

Although empirical research in academic areas provides support for both a 3-factor as well as a 4-factor achievement goal model, both models were proposed and tested with a collegiate sample. Little is known about the generalizability of either model with high school level samples. This study was designed to examine whether the 3-factor model (Mastery Goals, Performance-Approach Goals, and Performance-Avoidance Goals) or the 4-factor model (Mastery-Approach Goals, Mastery-Avoidance Goals, Performance-Approach Goals, and Performance-Avoidance Goals) is appropriate in high school physical education settings. The factorial validity of the models and internal consistency reliability were tested with confirmatory factor analysis, invariance testing, and tests of internal consistency across 2 samples. The results reveal that the items from the 4-factor achievement goal model can produce internally consistent and valid scores for high school students in physical education settings; the 4-factor model provides a better fit to the data than the 3-factor model. The multistep invariance analysis, however, reveals only metric invariance across 2 school samples.     

Measuring athlete imagery ability: the sport imagery ability questionnaire

This research aimed to develop and provide initial validation of the Sport Imagery Ability Questionnaire (SIAQ). The SIAQ assesses athletes' ease of imaging different types of imagery content. Following an extensive pilot study, 375 athletes completed a 20-item SIAQ in Study 1. Exploratory factor analysis revealed a 4-factor model assessing skill, strategy, goal, and affect imagery ability. Confirmatory factor analysis (CFA) established this 4-factor structure in Study 2 (N = 363 athletes). In Study 3 (N = 438 athletes), additional items were added to create a fifth mastery imagery subscale that was confirmed through CFA. Study 4 (N = 220 athletes) compared the SIAQ to the Movement Imagery Questionnaire-3. Significant bivariate correlations (p < .05) confirmed the SIAQ's concurrent validity but demonstrated differences in imagery ability of different content. Overall, the SIAQ demonstrates good factorial validity, internal and temporal reliability, invariance across gender, and an ability to distinguish among athletes of different competitive levels. Findings highlight the importance of separately assessing imagery ability of different content.     

Development and Initial Validation of the Psychological Needs Satisfaction Scale in Physical Education

The current study presents the development process and initial validation of a measure designed for assessing psychological needs satisfaction in a secondary school physical education context (Psychological Needs Satisfaction Scale in Physical Education, PNSSPE). Junior secondary school (grades 7 to 9) students (N?=?1,258) were invited to participate in three studies. In Study 1, item generation (34 items) and initial content validity of the PNSSPE were achieved. In Study 2, the factorial structure of the PNSSPE was tested using exploratory and confirmatory factor analyses. Internal consistency reliabilities of the subscales were also examined. In Study 3, the reliability and validity of the scores derived from the PNSSPE were further examined in an independent sample. Overall, the PNSSPE demonstrated good content, factorial, discriminant, and nomological validities. It also demonstrated acceptable internal consistency and test–retest reliability. The measurement model was proven invariant across gender and samples. Psychometric evidence from a series of studies suggests that the PNSSPE could be used as a reliable and valid measure to assess Hong Kong secondary school students’ satisfaction of psychological needs in physical education.     

Factorial Validity and Psychometric Examination of the Exercise Dependence Scale-Revised

The research purposes were to examine the factorial and convergent validity, internal consistency, and test-retest reliability of the Exercise Dependence Scale (EDS). Two separate studies, containing a total of 1,263 college students, were undertaken to accomplish these purposes. Participants completed the EDS and measures of exercise behavior and perfectionism. Confirmatory factor analysis in Study 1 reduced the scale from 28 to 21 items (i.e., 3 items per subscale) and it supported a correlated seven-factor model in Study 2 (Tucker-Lewis Index = .96, comparative fit index = .97, root mean square error of approximation = .05, average absolute standardized residual = .02). Adequate internal consistency and test-rest reliability for the scale was evidenced. Consistent with the hypotheses and the EDS classifications for exercise dependence symptoms, individuals at risk for exercise dependence reported more exercise behavior and perfectionistic tendencies, compared to the nondependent-symptomatic and nondependent-asymptomatic groups. These studies provide evidence for the reliability and validity of the EDS. Research in more diverse populations is needed to further examine the general applicability of the EDS-Revised.     

Cross-cultural adaptation of the Organizational Stressor Indicator for Sport Performers (OSI-SP) in Taiwan

The purpose of this study was to translate Arnold and her colleagues’ (Arnold, Fletcher, & Daniels, 2013) Organizational Stressor Indicator for Sport Performers (OSI-SP) into Chinese and examine its psychometric properties with Taiwanese athletes. In study 1, the psychometric properties of the items and the underlying structure of the translated Chinese OSI-SP were examined. In study 2, we used confirmatory factor analysis to examine the factorial structure and examined measurement invariance across genders. In study 3, we examined concurrent and discriminant validity via correlations among the Chinese OSI-SP, coping self-efficacy, perceived stress, and burnout to provide further evidence of criterion validity. Study 4 examined the test-retest reliability of the Chinese OSI-SP. Across these phases, results showed the 5-factor, 16-item Chinese OSI-SP had adequate factor structure, measurement invariance, criterion validity, and reliabilities. We suggest future studies may use this revised Chinese OSI-SP in Taiwan and other Chinese athletic settings.     

Movement imagery ability: development and assessment of a revised version of the vividness of movement imagery questionnaire

The purpose of this research was to amend the Vividness of Movement Imagery Questionnaire (VMIQ; Isaac, Marks, & Russell, 1986) in line with contemporary imagery modality and perspective conceptualizations, and to test the validity of the amended questionnaire (i.e., the VMIQ-2). Study 1 had 351 athletes complete the 3-factor (internal visual imagery, external visual imagery, and kinesthetic imagery) 24-item VMIQ-2. Following single-factor confirmatory factor analyses and item deletion, a 12-item version was subject to correlated traits / correlated uniqueness (CTCU) analysis. An acceptable fit was revealed. Study 2 used a different sample of 355 athletes. The CTCU analysis confirmed the factorial validity of the 12-item VMIQ-2. In Study 3, the concurrent and construct validity of the VMIQ-2 was supported. Taken together, the results of the 3 studies provide preliminary support for the revised VMIQ-2 as a psychometrically valid questionnaire.     

Factorial Validity and Invariance Testing of the Exercise Dependence Scale-Revised in Swedish and Portuguese Exercisers

The present study investigated the factorial validity and factorial invariance of the 21-item Exercise Dependence Scale-Revised using 162 Swedish and 269 Portuguese exercisers. In addition, the prevalence of exercise dependence symptoms and links to exercise behavior, gender, and age in the two samples was also studied. Confirmatory factor analyses demonstrated that the hypothesized 7-factor model made a good fit to data in both samples. Multi-sample analyses supported partial measurement invariance across the samples; only factor loadings involving items 3 and 19 were noninvariant. The “Reduction in Other Activities” and “Lack of Control” factors were the most problematic scales in terms of average variance explained and reliability measures of weighted omega and Cronbach's alpha. In total, 9.2% of the Swedish sample and 5.2% of the Portuguese sample were classified as at risk for exercise dependence. Overall, the results support the factorial validity of the translated Exercise Dependence Scale-Revised in samples outside North-America, although more research is needed.     

Development and validation of the moral disengagement in sport scale

A sport-specific measure of moral disengagement was developed in 2 studies. In Study 1, a 59-item questionnaire was developed and tested with 308 athletes from 5 team sports. A series of confirmatory factor analyses (CFA) testing different models suggested the model that best fitted the data had 6 first-order factors that could be represented by 1 second-order factor. Study 2 involved 305 athletes from the same 5 sports. CFA confirmed the 6-factor, second-order structure for the final 32-item measure. Results from Study 2 supported the construct validity of the scale, providing evidence for the factorial, concurrent, convergent, and discriminant validity. The Moral Disengagement in Sport Scale (MDSS) is proposed as a valid and reliable measure of moral disengagement for use in the sport context.     

Reliability and Validity of Outcome Expectancy-Related Measures in Physical Education

The purpose of this study was to examine the reliability and validity of outcome likelihood, outcome value, and outcome expectancy using data collected from students in secondary school physical education classes. Dependent measures were examined for construct, concurrent, and predictive validity, as well as internal and temporal reliability. The results of the investigation indicated the following. First, confirmatory factor analyses for the dependent variables (outcome likelihood, outcome value, outcome expectancy) revealed a suitable fit of the data with a hypothesized factor structure. Second, significant associations between these variables and other personal beliefs and values provided sound evidence for the concurrent validity of outcome likelihood, outcome value, and outcome expectancy. Third, results of regression analyses revealed that outcome likelihood and outcome value had strong predictive validity in predicting physical activity behaviors. Finally, the internal reliabilities of self-report scales for the outcome likelihood, outcome value, and outcome expectancy over a three-semester period were satisfactory. The temporal reliabilities were also acceptable.     

ABSTRACTS

The factorial and construct validity of the Exercise Imagery Inventory (EII) were assessed with 3 separate samples of participants. In Phase 1, a 41-item measure was administered to 504 undergraduate students. Exploratory factor analysis supported a 4-factor model that explained 65% of the variance. In Phase 2, a 19-item measure was administered to a sample of 509 individuals to assess 4- and 5-factor models. During Phase 3, 724 participants completed the EII, the Leisure Time Exercise Questionnaire (Godin &; Shephard, 1985), and the Barriers Self-Efficacy Scale (McAuley, 1992) to further test the factor structure of the EII and correlations with exercise-related constructs. Our results supported a 4-factor model to explain the latent structure of the 19-item scale. The 4 exercise imagery factors were labeled Appearance- Health imagery, Exercise Technique, Exercise Self-efficacy, and Exercise Feelings. The EII subscales were positively correlated with exercise behavior and exercise self-efficacy.     

Development and validation of an inventory to assess conflict in sport teams: the Group Conflict Questionnaire

Abstract

The purpose of the study was to develop and validate a conceptually and psychometrically sound conflict questionnaire for sport. The development process involved 3 phases: (a) a qualitative phase, (b) a content and factorial validity phase and (c) a construct validity phase. A total of 50 items were generated and sent to 6 experts to determine content validity. Through this process, 25 items were retained and administered to a sample of athletes (n = 437) to determine factorial validity. Based on these results, a second sample (n = 305) was administered the 14-item version of the Group Conflict Questionnaire along with the Group Environment Questionnaire, the Athlete Satisfaction Questionnaire and the Passion Scale to test convergent, discriminant and known-group difference validity. Cross-validation from both samples via confirmatory factor analysis yielded moderate-to-acceptable model fit, thus supporting factorial validity for the 14-item version. Additionally, initial support for convergent validity and known-group difference validity and partial support for discriminant validity were found. A sport-specific conflict questionnaire is now available for researchers to utilise. Results and research implications are discussed.     

Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults

Abstract

Building on the work of Terry and colleagues (Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861–872; Terry, P. C., Lane, A. M., & Fogarty, G. J. (2003). Construct validity of the Profile of Mood States-Adolescents for use with adults. Psychology of Sport & Exercise, 4, 125–139.), the present study examined the validity and internal consistency reliability of the Chinese version of the Brunel Mood Scale (BRUMS-C) among 2,548 participants, comprising adolescent athletes (n = 520), adult athletes (n = 434), adolescent students (n = 673), and adult students (n = 921). Both adolescent and adult athletes completed the BRUMS-C before, during, or after regular training and both adolescent and adult students completed the BRUMS-C in a classroom setting. Confirmatory factor analyses (CFAs) provided support for the factorial validity of a 23-item six-factor model, with one item removed from the hypothesised measurement model. Internal consistency reliabilities were satisfactory for all subscales across each of the four samples. Criterion validity was supported with strong relationships between the BRUMS-C, abbreviated POMS, and Chinese Affect Scale consistent with theoretical predictions. Multi-sample CFAs showed the BRUMS-C to be invariant at the configural, metric, strong, and structural levels for all samples. Furthermore, latent mean difference analyses showed that athletes reported significantly higher levels of fatigue than students while maintaining almost the same levels of vigour, and adolescent students reported significantly higher levels of depressed mood than the other three samples.     

Hierarchical confirmatory factor analysis of the Flow State Scale in exercise

In this study, we examined the factor structure and internal consistency of the Flow State Scale using responses of exercise participants.This self-report questionnaire consists of nine subscales designed to assess flow in sport and physical activity. It was administered to 1231 aerobic dance exercise participants. Confirmatory factor analyses were used to test three competing measurement models of the flow construct: a single-factor model, a nine-factor model and a hierarchical model positing a higher-order flow factor to explain the intercorrelations between the nine first-order factors. The single-factor model showed a poor fit to the data. The nine-factor model and the hierarchical model did not show an adequate fit to the data. All subscales of the Flow State Scale displayed acceptable internal consistency ( f > 0.70), with the exception of transformation of time ( f = 0.65). Collectively, the present results do not provide support for the tenability of the single-factor, nine-factor or hierarchical measurement models in an exercise setting.     

Cross-cultural adaptation and psychometric properties of the Portuguese version of the youth experience survey for sport (P-YES-S)

This study investigated adaptation and the psychometric properties of the Portuguese version of the Youth Experience Survey for Sport (P-YES-S). Translators, professors, and athletes participated. Athletes between 14 and 18 years were recruited. The instrument was the P-YES-S. Content validity was assessed by coefficients of content and kappa, while Cronbach’s alpha was used for internal consistency analysis and intraclass correlation for temporal stability. Exploratory and confirmatory factorial analyses were conducted to test the construct validity of the instrument. Discriminant validity was assessed by comparing the Average Variance Extracted (AVE) with the squared correlation between factors. Results showed acceptable levels for content validity, internal consistency, temporal stability, concurrent validity, and construct validity. The acceptable model was: X²/df = 1.54, GFI = 0.93, CFI = 0.92; AGFI = 0.92, TLI = 0.91, AIC = 414.63, BIC = 610.93, MECVI = 1.41 and RMSEA = 0.0.04, p = 0.03. The adaptation process produced an instrument with 22 items and the dimensions of Personal and Social Skills, Cognitive Skills, Initiative Experiences, and Negative Experiences.     

Hierarchical confirmatory factor analysis of the Flow State Scale in exercise

In this study, we examined the factor structure and internal consistency of the Flow State Scale using responses of exercise participants. This self-report questionnaire consists of nine subscales designed to assess flow in sport and physical activity. It was administered to 1231 aerobic dance exercise participants. Confirmatory factor analyses were used to test three competing measurement models of the flow construct: a single-factor model, a nine-factor model and a hierarchical model positing a higher-order flow factor to explain the intercorrelations between the nine first-order factors. The single-factor model showed a poor fit to the data. The nine-factor model and the hierarchical model did not show an adequate fit to the data. All subscales of the Flow State Scale displayed acceptable internal consistency (alpha > 0.70), with the exception of transformation of time (alpha = 0.65). Collectively, the present results do not provide support for the tenability of the single-factor, nine-factor or hierarchical measurement models in an exercise setting.     

Further development of the talent development environment questionnaire for sport

Given the significance of monitoring the critical environmental factors that facilitate athlete performance, this two-phase research aimed to validate and refine the revised talent development environment questionnaire (TDEQ). The TDEQ is a multidimensional self-report scale that assesses talented athletes’ environmental experiences. Study 1 (the first phase) involved the examination of the revised TDEQ through an exploratory factor analysis (n = 363). This exploratory investigation identified a 28-item five-factor structure (i.e., TDEQ-5) with adequate internal consistency. Study 2 (the second phase) examined the factorial structure of the TDEQ-5, including convergent validity, discriminant validity, and group invariance (i.e., gender and sports type). The second phase was carried out with 496 talented athletes through the application of confirmatory factor analyses and multigroup invariance tests. The results supported the convergent validity, discriminant validity, and group invariance of the TDEQ-5. In conclusion, the TDEQ-5 with 25 items appears to be a reliable and valid scale for use in talent development environments.     

Reliability of the International Physical Activity Questionnaire in Research Settings: Last 7-Day Self-Administered Long Form

This study examined the validity and reliability of decisional balance scales for exercise (i.e., pros and cons) in a large longitudinal population-based randomized sample of Canadian adults ages 18 to 65 years (N = 703). Assessments were taken over 3 time points with 6-month intervals between testing. Content, factorial, concurrent, and construct validity along with internal consistency and test-retest reliability were established for the decisional balance scales. The developed measures have utility for researchers and practitioners who test and apply the exercise decisional balance constructs of the Transtheoretical Model.     

The behavioral regulation in sport questionnaire (BRSQ): instrument development and initial validity evidence

The purpose of the four studies described in this article was to develop and test a new measure of competitive sport participants' intrinsic motivation, extrinsic motivation, and amotivation (self-determination theory; Deci & Ryan, 1985). The items for the new measure, named the Behavioral Regulation in Sport Questionnaire (BRSQ), were constructed using interviews, expert review, and pilot testing. Analyses supported the internal consistency, test-retest reliability, and factorial validity of the BRSQ scores. Nomological validity evidence was also supportive, as BRSQ subscale scores were correlated in the expected pattern with scores derived from measures of motivational consequences. When directly compared with scores derived from the Sport Motivation Scale (SMS; Pelletier, Fortier, Vallerand, Tuson, & Blais, 1995) and a revised version of that questionnaire (SMS-6; Mallett, Kawabata, Newcombe, Otero-Forero, & Jackson, 2007), BRSQ scores demonstrated equal or superior reliability and factorial validity as well as better nomological validity.     

An examination of athletic alumni giving behavior: Development of the Former Student-Athlete Donor Constraint Scale

The purpose of this investigation was to develop a scale to measure the degree to which college athletic donation barriers exist for former student-athletes. The Former Student-Athlete Donor Constraint Scale (FSADCS) was created to further examine donor constraint themes found in a previous qualitative investigation. An analysis of the construct validity of the FSADCS was conducted with 243 former student-athletes from a NCAA Division I institution. The FSADCS was developed through thematic content analysis, item generation, expert review, confirmatory factor analysis (CFA), and additional validity and reliability testing. CFA supported a 5-factor, 27-item structure (Lack of Importance, Disconnect, Communication Issues, Experience Issues, and Dissatisfaction). Additional validity and reliability tests also supported the FSADCS. The findings of this study illustrate the importance of developing a framework for understanding potential barriers which influence charitable contribution behavior for a unique population within the prospective donor market.     

Using an Online Survey Tool to Enhance Teaching

This study examines the factorial validity, factorial invariance across gender, and construct validity of a Swedish version of the Self-Presentation in Exercise Questionnaire (SPEQ; Conroy, Motl, &; Hall, 2000). The a priori two-factor 14-item, 11-item, and 9-item models fail to reach acceptable levels of fit in a calibration sample. A modified 8-item model demonstrates acceptable fit and loose and partial cross-validity on a second independent sample. The factorial structure is invariant across gender. Men depict higher latent mean scores on both SPEQ factors of Impression Motivation and Impression Construction. Different patterns for men and women in the relation between SPEQ factors and exercise identity, social physique anxiety, and exercise participation are detected. Psychometric weaknesses in reliability and content validity from a cultural equivalence perspective are discussed.