Validity and reliability evidence for motor competence assessments in children and adolescents: A systematic review

ABSTRACT

Valid and reliable tests of motor competence are necessary to allow researchers and practitioners to quantify levels of motor competence, identify skill deficiencies, and determine the effectiveness of motor skill interventions. The primary study aim was to systematically review the validity and reliability of scores derived from gross motor competence tests for typically developing child and adolescent populations. The secondary aim of this review was to identify the most prevalent motor skills assessed across all instruments. A search of seven electronic databases identified 57 different skill assessment tools from 107 studies. Construct validity was the most common measurement property examined (60 studies; 56%). Content validity (21 studies; 20%) was the least commonly explored measurement property. Scores derived from the Test of Gross Motor Development – second and third edition had the most support for validity and reliability. The most common skills included in these skill batteries were the overhand throw (n = 33), catch (n = 32), jump (n = 31) and hop (n = 26). Research efforts should focus on: (1) further investigation of measurement properties of existing tools rather than developing new assessments and (2) further investigation of existing tools and their measurement properties in adolescent populations.     

The feasibility of fundamental movement skill assessments for pre-school aged children

Fundamental movement skill (FMS) assessment in preschools allows for early intervention; however it is unclear what assessments are feasible. The purpose of this review is to systematically review the feasibility of FMS assessments for pre-school aged children. The search was conducted across four databases, MEDLINE, Scopus, ERIC and SportsDiscus. Search terms included synonyms of “fundamental movement skills” and “pre-school children”. Inclusion criteria were: (i) FMS assessment; (ii) feasibility data; (iii) assessment of children aged three to six years; (iv) assessment of typically developing children; and (v) peer reviewed full text publications in English. Feasibility concepts (administration time, equipment, space, assessment type, item, training, qualification) were each coded as ‘poor = 1?, ‘average = 2? and ‘good = 3?; potential total of 21. A total of 330 full text articles were considered but a quarter (n = 86) were excluded due to no feasibility data. Sixty-five studies using 13 different FMS assessments were included. The Athletic Skills Track and DEMOST-PRE assessments were most feasible (18/21) and the Test of Gross Motor Development and Movement Assessment Battery for Children were common but among the least feasible (12–14/21). This review allows pre-school staff to choose a FMS assessment based on feasibility. Future studies need to present feasibility of assessments.     

The effect of attentional focus cues on object control performance in elementary children

Background and purpose: Attentional focus cues have been shown to impact motor performance of adults and children. Specifically, an external focus of attention results in improved motor learning and performance as compared to adopting an internal focus of attention. The purpose of this study was to determine the effects of an internal and external attentional focus cue on children’s object control skill performance during a commonly used motor skill assessment.

Methods: Using a within-participant design, a total of 44 children (M_age?=?7.7 years, 20 boys and 24 girls) completed all three attentional focus conditions. The object control subscale of the Test of Gross Motor Development-2nd Edition (TGMD-2; Ulrich, 2000. Test of Gross Motor Development-2. Austin: Pro-Ed.) served as the motor skill assessment in present study. The TGMD-2 is a normed and criteria-referenced assessment frequently used to assess fundamental motor skill competence in children. The object control subtest of the TGMD-2 assesses a child’s ability to complete six fundamental motor skills – striking a stationary ball, stationary dribble, catch, kick, overhand throw, and underhand roll. All participants completed the object control subtest of the TGMD-2 under three different attentional focus conditions: baseline (i.e. neutral focus), internal, and external. The internal cue focused on movement performance and the external cue focused on movement outcome. In all three conditions, a video demonstration of proper skill performance was used to ensure no difference in visual demonstration, but the overlaying audio was changed to encompass each attentional focus condition. Children’s motor performance was recorded and later coded by a single researcher blinded to the study. A repeated-measures analysis of variance was used to determine if children’s motor scores changed among the three conditions.

Results: Findings demonstrated that children’s performance differed among the three conditions (F_(2,43)?=?3.5, p?Post hoc analysis revealed that children scored significantly better in the external cue condition compared to the baseline (difference?=?1.98, p?Conclusion: Children performed better when given a verbal instruction to focus their attention externally rather than a verbal instruction with no attentional focus cue. No significant differences exist between the internal and external focus condition or between the neutral and internal condition. Our findings align with the literature and support that external attentional focus cues have a positive effect on motor performance. From a teaching and learning standpoint, using consistent instructions appears to be essential for young learners. Slight changes in verbal cues can have a significant effect on how well children execute fundamental motor skills.     

Construct validity of the resistance training skills battery in children aged 7-10 years

The current study sought to examine the construct validity of the Resistance Training Skills Battery for Children (RTSBc), a movement screen purported to assess resistance training skill in children. Children aged 7–10 years (n = 27, 21 males, 6 females) undertook measures of resistance training skill via the RTSBc, motor competence and muscular fitness. Using a median split for RTSBc scores, children were categorised as high or low resistance training competence. Univariate ANCOVAs, controlling for maturation, were used to examine whether measures of muscular fitness and motor competence scores differed as a function of RTSBc competence. Children who were classified as high for resistance training competence had significantly better motor competence (P = .001) and significantly faster 10 m sprint speed (P = .001). However, medicine ball throw and standing long jump scores as well as peak and average isokinetic muscle strength did not differ as a function of RTSBc (P > 0.05). In all cases maturation was significant as a covariate. This study is the first to demonstrate construct validity of the RTSBc as a measure of general motor competence and sprint speed, but not strength, in children aged 7–10 years.     

Resting Electromyographic Triceps Surae Activity and Tonic Vibration Reflexes in Subjects with High and Average-Low Maximum Oxygen Uptake Capacities

Abstract

This study was designed to investigate the effect of an interactive videodisc motor skill assessment training program on the development of preservice and inservice teachers' qualitative assessment proficiency on two motor skills: the overhand throw and catch. Twenty-seven preservice and 27 inservice physical education teachers were randomly assigned to one of three treatment conditions: interactive videodisc (IVD), teacher-directed (TD), or self-directed (SD). Motor skill qualitative assessment accuracy was evaluated on a pre- and post-test basis using a 50-item motor skill assessment accuracy test (10 performances rated on 5 components) for each skill. Analysis of covariance results indicated significant main effects for treatment for both skills. Post hoc tests revealed that for the over hand throw, the IVD and TD groups were superior to the SD group but not different from each other. For the catch, the IVD group was found to be superior to both the TD and SD groups. These findings are discussed in relation to the advantages of interactive videodisc in terms of efficiency and user independence and with comparable findings in other educational applications.     

Who SKIPS? Using Temperament to Explain Differential Outcomes of a Motor Competence Intervention for Preschoolers

Purpose: Although motor skill interventions often improve fundamental motor skills (FMS) during preschool, the extent of individual children’s success in development of FMS still varies among children receiving the same intervention. Temperament is multifaceted and includes negative affect (high levels of frustration or anger), effortful control (focus, self-regulation, and concentration), and surgency (energy and activity level). Temperament often influences cognitive, social, and behavioral outcomes and may be a significant factor in the development of FMS. The purpose of this study was to examine the influence of temperament on children’s improvement in FMS within a gross motor intervention. Method: Participants (N = 80; M_age = 55.36 months, SD = 6.99 months) completed the Test of Gross Motor Development-Second Edition prior to and after intervention. Teachers completed the Child Behavior Questionnaire-Very Short Form to examine each child’s temperament. To account for possibility of a Type 1 error, we conducted 6 separate 2 (temperament variable: high, low) × 2 (treatment: intervention, control) analyses of covariance and examined posttest scores for locomotor and object-control skills with pretest scores as covariates among participants with high and low surgency, negative affect, and effortful control. Results: Results revealed children with low levels of negative affect and surgency and high levels of effortful control demonstrated greater gains (η_p² = .05–.34) in both locomotor and object-control skills during motor skill intervention compared with their peers. Conclusion: Providing interventions tailored to temperamental profiles could maximize gains in FMS through intervention.     

Individual Differences Influencing Immediate Effects of Internal and External Focus Instructions on Children’s Motor Performance

Purpose: A large pool of evidence supports the beneficial effect of an external focus of attention on motor skill performance in adults. In children, this effect has been studied less and results are inconclusive. Importantly, individual differences are often not taken into account. We investigated the role of working memory, conscious motor control, and task-specific focus preferences on performance with an internal and external focus of attention in children. Methods: Twenty-five children practiced a golf putting task in both an internal focus condition and external focus condition. Performance was defined as the average distance toward the hole in 3 blocks of 10 trials. Task-specific focus preference was determined by asking how much effort it took to apply the instruction in each condition. In addition, working memory capacity and conscious motor control were assessed. Results: Children improved performance in both the internal focus condition and external focus condition (?_p² = .47), with no difference between conditions (?_p² = .01). Task-specific focus preference was the only factor moderately related to the difference between performance with an internal focus and performance with an external focus (r = .56), indicating better performance for the preferred instruction in Block 3. Conclusion: Children can benefit from instruction with both an internal and external focus of attention to improve short-term motor performance. Individual, task-specific focus preference influenced the effect of the instructions, with children performing better with their preferred focus. The results highlight that individual differences are a key factor in the effectiveness in children’s motor performance. The precise mechanisms underpinning this effect warrant further research.     

Children's self-perceived bodily competencies and associations with motor skills,body mass index,teachers' evaluations,and parents' concerns

Abstract

The associations between physical competence, self-perceived bodily competence, parental concern for their children's motor skill development, and teachers' evaluation of their bodily competence were assessed in 646 six- to seven-year-olds. Physical competence was assessed by the German motor ability test “Körperkoordinationstest für Kinder”, while the children's, their parents', and their teachers' evaluations were obtained through questionnaires. Parental concern, teacher evaluation, and a high body mass index were the strongest predictors of low physical competence (motor skill quotient <85). Teachers' evaluation of bodily competence was associated with low self-perceived bodily competence in the children even after adjustment for motor skill quotient, with an odds ratio of 2.3 (P < 0.05) between the lowest and highest of the three levels after correction for motor skill competence. Results indicate that teachers' evaluation of children's motor skills should be considered a key factor when tracking and assessing physical competencies among youth.     

Mastery and exercise play interventions: motor skill development and verbal recall of children with and without disabilities

Background: Fundamental motor skill proficiency is essential for engagement in sports and physical play and in the development of a healthy lifestyle. Children with motor delays (with and without disabilities) lack the motor skills necessary to participate in games and physical activity, and tend to spend more time as onlookers than do their peers. As such, intervention programs are crucial in promoting motor skill development of children with motor delays. While mastery climate (MC) interventions have shown to positively impact children’s motor performance, what is unknown is the impact of cognitive strategies used by children within these climates. Furthermore, although vigorous play seems to be related to the development of gross motor skills, it is still unknown if children with and without disabilities would benefit from exercise play (EP) interventions.

Purpose: This study examined the effects of MC and EP interventions on the motor skill development and verbal recall (VR) of children with motor delays. The sample included children with and without disabilities.

Research designs: One hundred and thirty-eight children from 27 urban public schools were referred to the present study. Children were assessed using the Test of Gross Motor Development second edition (TGMD-2) and a VR checklist. Sixty-four children (18 with disabilities and 46 without) met the inclusion criteria, which was a score less than the fifth percentile on the TGMD-2. Participants were randomly assigned to the MC or EP 14-week interventions emphasizing gross motor skill practice.

Data collection and analysis: Children were assessed at pre- and post-intervention. A 2 (groups)?×?2 (disability) × 2 (time) analyses of variance with repeated measures on the last factor was conducted. Change scores, t-test comparisons on the delta scores and Cohen’s D were also calculated.

Results: The MC group demonstrated significant and positive changes over the intervention period. Further, the MC group showed superior locomotor and object control performance and higher recall of verbal cues (p?≤?.05) at post-intervention compared to the EP group. Children with and without disabilities within the MC showed similar patterns of improvement. The EP intervention did not demonstrate significant improvements.

Conclusion: Children with and without disabilities showed improvements in motor skills and VR when exposed to an MC, incorporating the six TARGET structures. These structures included (a) providing feedback and encouragement, providing opportunities for decision-making and establishing personal goals, (b) including parents in the recognition of children’s achievements, (c) creating opportunities to experience leadership and self-pacing, (d) guiding children to use verbal cues and modeling when practicing gross motor skills, and (e) providing demonstrations and teaching children to self-monitor their performance. Instruction is therefore seen as critical to learning gross motor skills, as demonstrated from the findings. Although there were opportunities for vigorous play within the EP intervention, the children did not show improvements in motor performance or VR. These findings suggest that new trends in teacher education physical education to prioritize physical activity over good motor skill instruction may not be advantageous for children in the early years, and should be reconsidered.     

Inter-rater and test–retest (between-sessions) reliability of the 4-Skills Scan for dutch elementary school children

In The Netherlands, the 4-Skills Scan is an instrument for physical education teachers to assess gross motor skills of elementary school children. Little is known about its reliability. Therefore, in this study the test–retest and inter-rater reliability was determined. Respectively, 624 and 557 Dutch 6- to 12-year-old children were analyzed for test re-test and inter-rater reliability. All tests took place within the school setting. The outcome measure was age-expected motor performance (in years). Results showed a small practice effect of .24 years for re-test sessions and assessment of motor skills was possible with acceptable precision (standard error of measurement = .67 years). Overall, intraclass correlation coefficient (ICC) was .93 (95% confidence interval: .92–.95) for test–retest reliability and .97 for inter-rater reliability. For the repeated measures, the smallest detectable change (SDC) was 1.84 and limits of agreement were –1.60 and 2.08 years. It can be concluded that the 4-Skills Scan is a reliable instrument to assess gross motor skills in elementary school children.     

Development,content validity and test-retest reliability of the Lifelong Physical Activity Skills Battery in adolescents

Numerous skill batteries assess fundamental motor skill (e.g., kick, hop) competence. Few skill batteries examine lifelong physical activity skill competence (e.g., resistance training). This study aimed to develop and assess the content validity, test-retest and inter-rater reliability of the “Lifelong Physical Activity Skills Battery”. Development of the skill battery occurred in three stages: i) systematic reviews of lifelong physical activity participation rates and existing motor skill assessment tools, ii) practitioner consultation and iii) research expert consultation. The final battery included eight skills: grapevine, golf swing, jog, push-up, squat, tennis forehand, upward dog and warrior I. Adolescents (28 boys, 29 girls; M = 15.8 years, SD = 0.4 years) completed the Lifelong Physical Activity Skills Battery on two occasions two weeks apart. The skill battery was highly reliable (ICC = 0.84, 95% CI = 0.72–0.90) with individual skill reliability scores ranging from moderate (warrior I; ICC = 0.56) to high (tennis forehand; ICC = 0.82). Typical error (4.0; 95% CI 3.4–5.0) and proportional bias (r = ?0.21, p = .323) were low. This study has provided preliminary evidence for the content validity and reliability of the Lifelong Physical Activity Skills Battery in an adolescent population.     

Improving Functional Movement Proficiency in Middle School Physical Education

Purpose: The purpose of this study was to examine whether functional movement proficiency could be improved as measured via the Functional Movement Screen using a standardized warm-up protocol in middle school physical education. A secondary purpose was to determine whether such improvement, if it occurred, would positively influence the technical performance of 4 fundamental motor skills: overhand throw, vertical jump, kicking, and running. Method: Participants were 120 7th- and 8th-grade physical education student volunteers. Two classes from each grade level were assigned to the functional group (N = 54) while the remaining 2 classes of each grade were assigned to the control group (N = 66). Baseline measures were obtained using the Functional Movement Screen and the Get Skilled: Get Active (2000) process-oriented motor skill assessment. For 6 weeks, the functional group warmed up by performing functional stretching, stability, and mobility exercises while the control group completed a traditional dynamic warm-up. Results: According to gain score analysis, those in the functional group significantly reduced dysfunctional movements (scores of 1) compared with those in the control group. Further, boys in the functional group significantly improved their Functional Movement Screen composite score as compared with their male counterparts in the control group whose scores declined. No differences were found for fundamental motor skill performance. Conclusion: Replacing the traditional dynamic warm-up with one that emphasizes functional movement in preparation for activity in physical education appears effective for correcting movement dysfunctions in young adolescents.     

The effectiveness of an interactive videodisc qualitative assessment training program

This study was designed to investigate the effect of an interactive videodisc motor skill assessment training program on the development of preservice and inservice teachers' qualitative assessment proficiency on two motor skills: the overhand throw and catch. Twenty-seven preservice and 27 inservice physical education teachers were randomly assigned to one of three treatment conditions: interactive videodisc (IVD), teacher-directed (TD), or self-directed (SD). Motor skill qualitative assessment accuracy was evaluated on a pre- and post-test basis using a 50-item motor skill assessment accuracy test (10 performances rated on 5 components) for each skill. Analysis of covariance results indicated significant main effects for treatment for both skills. Post hoc tests revealed that for the overhand throw, the IVD and TD groups were superior to the SD group but not different from each other. For the catch, the IVD group was found to be superior to both the TD and SD groups. These findings are discussed in relation to the advantages of interactive videodisc in terms of efficiency and user independence and with comparable findings in other educational applications.     

Gross Motor Skills and Sports Participation of Children With Visual Impairments

Gross motor skill performance of children with visual impairments and its association with the degree of visual impairment and sports participation was examined. Twenty children with visual impairments (M age = 9.2 years, SD =1.5) and 100 sighted children (M age = 9.1 years, SD = 1.5) from mainstream schools participated. The results showed that children with visual impairments had significantly lower object control but not locomotor skill scores than the sighted children. No significant differences were found between children with a moderate and severe visual impairment. Children with visual impairments who participated in sports had significantly higher object control skill scores than those who did not. No significant associations between motor skills and sports participation were found in the sighted children.     

Modifying Equipment in Early Skill Development: A Tennis Perspective

Purpose: The International Tennis Federation recently launched a worldwide campaign advocating the use of equipment scaling for children learning to play tennis. The aim of this study was to investigate the influence that varying racquet sizes and ball compressions had on children's ability to play a forehand groundstroke. Method: This was a quantitative repeated-measures design experiment. Children were required to perform a forehand hitting task using each of 9 combinations of tennis racquets and balls (i.e., 3 racquet sizes × 3 ball compressions). Children's hitting performance was measured using a points system. The aim for the children was to score as many points as possible. Hitting technique was measured via video replay. Results: Hitting performance was best when the smallest racquet combined with the ball with the least compression was used. The ball with the least compression also promoted 2 technique benefits: swinging the racquet from low to high and striking the ball in front and to the side of the body. Conclusions: This study demonstrated the benefits for young children playing with scaled racquets and low-compression balls. The findings are discussed with regards to their relevance to theories of skill acquisition.     

Validity and feasibility of an obstacle course to assess fundamental movement skills in a pre-school setting

Failure to master age-appropriate fundamental movement skills (FMS) at a young age can limit motor skill competence affecting health. Assessments often have issues with feasibility and implementation in a field setting. As such, the purpose of this study was to investigate the validity and feasibility of the Athletic Skills Track (AST), in a pre-school setting. For the validation study sixty-five 3–6 year old children (25 boys and 40 girls) from five pre-schools across Adelaide, Australia participated. Correlations and linear regression analysis (adjusted for age and gender) were used to investigate the association between the time to complete the AST and the raw score of the Test of Gross Motor Development 2 (TGMD-2). For the feasibility study pre-school staff completed a semi-structured interview regarding the feasibility of the AST. The AST took less than a minute per child and the TGMD-2 around 20 minutes for two children. There was a strong negative correlation (r = ?0.63, p < 0.01) between the AST scores and the TGMD-2 scores. All five staff reported strengths of the AST to be its short administration time, setup and appropriateness. These results suggest that the AST could be a feasible and valid method of FMS assessment in Australian pre-schools.     

The Validity of Academic Learning Time–Physical Education (ALT–PE) as a Process Measure of Achievement

Abstract

The purpose of this study was to determine whether the ALT–PE system (Version 2) is valid as a process approach to estimate student achievement. Students (N = 60) were randomly selected from a data base that includes pretest and posttest scores for two volleyball skills and seven sessions of videotaped instruction. Videotapes were collected using two cameras with a split-screen generator so most instruction and practice could be seen. ALT–PE data were coded from the videotapes. In addition to normal ALT–PE coding conventions, coders recorded the skill that was the focus of instruction. Combinations of context and learner involvement categories were summed for each skill across the seven class sessions and to form other logical categories (e.g., total motor appropriate intervals). Achievement scores were calculated by posttest on pretest regression for each skill with the residual score used for subsequent analysis. Residual achievement scores were correlated with summed ALT–PE categories. The results indicate for the serve both total motor appropriate and practice–motor appropriate intervals were related to student achievement. For the pass, practice–motor appropriate intervals were related to achievement and the total motor appropriate–achievement correlation failed significance. These results demonstrate the validity of the ALT–PE system as a process measure of achievement can be partially substantiated.