Measuring the complexity of upper primary school children’s self-regulated learning: A multi-component approach

Balancing theoretical and practical issues in the measurement of SRL remains a challenge. This is especially the case for large-scale studies among primary school children’s SRL. In this respect, the present study describes the development and validation of the Children’s Perceived use of Self-Regulated Learning Inventory (CP-SRLI) consisting of nine components. A multistep process was used to develop the questionnaire, including reviews by a teacher and expert panel, cognitive interviews with upper primary school children, and a large-scale administration. The original 109-item questionnaire was then presented to 504 fifth and 463 sixth graders (sample 1). Subsequent to exploratory factor analyses on each component, the factor structure of each component was confirmed by confirmatory factor analyses using an independent second sample (409 fifth and 314 sixth graders), leading to a questionnaire of 75 items. Further, the factor structure of the different components is found to be invariant across boys and girls. The implications of the results and potential avenues for future research are presented and discussed.     

The Implications of Research on Expertise for Curriculum and Pedagogy

Instruction on problem solving in particular domains typically relies on explanations from experts about their strategies. However, research indicates that such self-reports often are incomplete or inaccurate (e.g., Chao & Salvendy, 1994; Cooke & Breedin, 1994). This article evaluates research on experts’ cognition, the accuracy of experts’ self-reports, and the efficacy of instruction based on experts’ self-reports. Analysis of this evidence indicates that experts’ free recall of strategies introduces errors and omissions into instructional materials that hinder student success. In contrast, when experts engage in structured knowledge elicitation techniques (e.g., cognitive task analysis), the resultant instruction is more effective. Based on these findings, the article provides a theoretical explanation of experts’ self-report errors and discusses implications for the continued improvement of instructional design processes.

Emotional and behavioural difficulties among middle school students in Oman: an examination of prevalence rate and gender differences

Children with emotional and behavioural difficulties (EBDs) began to receive considerable attention in several countries in the Middle East and North Africa region including Oman. In the Omani context, there is lack of valid assessment instruments which can be used to obtain information on EBDs in schools. The current study used the Arabic self-report version of the Strengths and Difficulties Questionnaire (A-SDQ) to examine EBDs in a sample of middle school students. 816 middle school students from both genders, who were randomly selected from different schools in two big cities in Oman, filled out the A-SDQ. Results provided initial evidence of good psychometric properties of the A-SDQ reflecting that it can be a valid tool for use in schools in Oman. Further, the participants reported moderate to high rates of EBDs as measured by the different subscales of the A-SDQ. Significant gender differences were found in students self-report of EBDs. Compared to boys, girls reported more emotional symptoms, less conduct and peer problems. Implications of the study findings for the identification of students with EBDs in schools in Oman are presented.     

The prevalence of child maltreatment in the Netherlands across a 5-year period

The prevalence of child maltreatment in the Netherlands was in 2005 first systematically examined in the Netherlands’ Prevalence study on Maltreatment of children and youth (NPM-2005), using sentinel reports and substantiated CPS cases, and in the Pupils on Abuse study (PoA-2005), using high school students’ self-report. In this second National Prevalence study on Maltreatment (NPM-2010), we used the same three methods to examine the prevalence of child maltreatment in 2010, enabling a cross-time comparison of the prevalence of child maltreatment in the Netherlands. First, 1,127 professionals from various occupational branches (sentinels) reported each child for whom they suspected child maltreatment during a period of three months. Second, we included 22,661 substantiated cases reported in 2010 to the Dutch Child Protective Services. Third, 1,920 high school students aged 12–17 years filled out a questionnaire on their experiences of maltreatment in 2010. The overall prevalence of child maltreatment in the Netherlands in 2010 was 33.8 per 1,000 children based on the combined sentinel and CPS reports and 99.4 per 1,000 adolescents based on self-report. Major risk factors for child maltreatment were parental low education, immigrant status, unemployment, and single parenthood. We found a large increase in CPS-reports, whereas prevalence rates based on sentinel and self-report did not change between 2005 and 2010. Based on these findings a likely conclusion is that the actual number of maltreated children has not increased from 2005 to 2010, but that professionals have become more aware of child maltreatment, and more likely to report cases to CPS.     

Intercultural competence in tourism and hospitality: Self-efficacy beliefs and the Dunning Kruger effect

This study aims to measure intercultural competence (awareness) of tourism and hospitality employees who tend to be in continuous interaction with intercultural customers. By comparing the results of a self-report awareness test/scale with the results of a knowledge-based test, the study shows that employees not only have extremely low intercultural competence, they also exaggerate their intercultural awareness/competence. Hence, in addition to the implications for intercultural competence/awareness of tourism and hospitality employees and for the businesses for which they work, the study has also implications regarding the measurement ability of self-report scales/tests.     

Self-report of reading comprehension strategies: What are we measuring?

Proficient readers engage in a wide range of cognitive and metacognitive strategies, and both developmental and classroom intervention researchers are in need of high-quality measures of strategy use. Several researchers have recently called into question the validity of the most common type of measures of strategy use in reading, self-report or introspective measures (i.e., the participant must report on his or her cognitive activity while not actually engaged in the activity). We administered three parallel strategy use measures to a sample of 30 ninth-grade students: a prospective self-report measure, a concurrent multiple-choice measure which required students to apply the strategies to specific passages, and a text on which we asked students to think aloud. We also collected two measures of reading comprehension—a standardized measure and free recall scores. Consistent with Veenman’s (2005) conclusions based on a literature review, the concurrent multiple-choice and think-aloud data were both significantly correlated with both of the comprehension scores and with each other, whereas the prospective self-report data had non-significant correlations with all of the other measures. We conclude by recommending concurrent measures for researchers who wish to study strategy use in reading comprehension.     

Reliability and criterion validity of the Self-Administered Physical Activity Checklist in Greek children

Abstract

The purpose of this study was to assess the test–retest reliability and criterion validity the Self-Administered Physical Activity Checklist (SAPAC) translated into the Greek language. To evaluate reliability, 72 students (35 girls and 37 boys) of the fifth and sixth grade completed SAPAC on two separate occasions, two weeks apart. Internal consistency was determined with Cronbach alpha coefficient and test–retest reliability with the intraclass correlation coefficient (ICC). To evaluate criterion validity, the RT3 Research Tracker accelerometer was used as standard measure, in 90 randomly selected Greek children (51 girls and 39 boys), aged between 10 and 13. Each subject participated for two consecutive days. On day one, an accelerometer was fitted when school started. On day two, the accelerometers were returned and each subject completed the questionnaire. The internal consistency and the test–retest reliability of SAPAC on total metabolic equivalent (MET) score, MET score of low physical activities (LPA) and MET score of moderate to vigorous physical activities (MVPA) were very satisfactory (all Cronbach's alpha > 0.87, and all ICC > 0.85, P <0.001). The Kendall's tau-b test revealed that the degree of agreement between SAPAC and RT3 accelerometer on total MET score and MET score of MVPA were 0.31 and 0.37, respectively (P <0.01). It was concluded that the Greek translated version of SAPAC is a reliable questionnaire that provides valid estimates of total, as well as moderate to vigorous activities MET scores.     

Using the Trauma Symptom Checklist for Children-Short form (TSCC-SF) on abused children in South Africa: Confirmatory factor analysis and Rasch models

BackgroundWhile assessment measures of trauma-related symptoms in children exist, few of them are at once brief, self-reports, normed, comprehensive (i.e., cover both general and trauma-specific symptoms), and thus suitable for poorly resourced clinical contexts.ObjectiveThis study validated the short form of the Trauma Symptom Checklist for Children (TSCC-SF) in a sample of children and adolescents.Participants and settingsParticipants were school-age children and adolescents (N = 270; M_age = 12.55 yrs., SD = 1.19; 67% = Female) exposed to different types of abuse (i.e., sexual, physical, emotional and neglect) receiving counselling at a non-governmental organisation.MethodsThe TSCC-SF’s factor structure and Differential Item Functioning (DIF) across sexes were examined using confirmatory factor analysis and Rasch analysis.ResultsResults revealed a satisfactory construct validity of the scale, while internal consistency was also adequate. No DIF was found across the sexes.ConclusionsThe TSCC-SF appears to be a viable option for use with children exposed to different types of abuse, particularly in low resource clinical contexts.     

Overestimation Bias in Self-reported SAT Scores

The authors analyzed self-reported SAT scores and actual SAT scores for five different samples of college students (N = 650). Students overestimated their actual SAT scores by an average of 25 points (SD = 81, d = 0.31), with 10% under-reporting, 51% reporting accurately, and 39% over-reporting, indicating a systematic bias towards over-reporting. The amount of over-reporting was greater for lower-scoring than higher-scoring students, was greater for upper division than lower division students, and was equivalent for men and women. There was a strong correlation between self-reported and actual SAT scores (r = 0.82), indicating high validity of students’ memories of their scores. Results replicate previous findings (Kuncel, Credé, & Thomas, 2005) and are consistent with a motivated distortion hypothesis. Caution is suggested in using self-reported SAT scores in psychological research.