Contextually-relevant validation of peer play constructs with African American head start children: Penn interactive peer play scale

The purpose of this investigation was to evaluate the construct and concurrent validity of a modified version of the Penn Interactive Peer Play Scale (PIPPS), a teacher-rating instrument of interactive play behaviors of preschool children. PIPPS were collected on 523 urban African American Head Start children. The PIPPS scales were confirmed, supporting the following constructs of peer play: Play Interaction, Play Disruption, and Play Disconnection. The 32-item PIPPS represented a significant improvement over the 36-item version. Scale validity was established using conceptually related indicators of social competence including teacher report, peer report, and direct play observation data. Children who evidenced high interactive play ratings received high social skill ratings from teachers, and were well liked by peers and engaged during play sessions. Children who were disruptive in play received ratings of low self-control and were more likely to be engaged in solitary play. Disconnection in play was associated with low acceptability by peers and lack of involvement in play sessions. Practical use of the PIPPS and further study of developmentally appropriate social competencies for African American Head Start children are discussed.     

Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings

Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be .63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment.     

Peer assessment of class participation: applying peer nomination to overcome rating inflation

Having students actively engaged with each other in discussions has become an increasingly important and common aspect of the classroom environment. This increased emphasis has also meant that instructors need to find ways to effectively and efficiently evaluate class participation. In this paper, we describe the most common method used for these assessments and highlight some of its inherent challenges. We then propose an alternative method based on peer nominations. Two case studies illustrate the advantages of this method; we find that it is both easy for students to complete and provide instructors with valuable diagnostic information with which to provide feedback and assign grades.     

Peer review in the classroom: student perceptions,peer feedback quality and the role of assessment

Abstract

Peer review in the classroom can enhance numerous employability skills such as critical appraisal, writing skills, reflection practices and collaborative experiences. This study takes place over two years and discusses the implementation of a repeating blind peer review cycle across a single semester for final year chemistry students enrolled on a compulsory employability module. The feedback cycle promotes personal reflection through the use of mini-reflective questionnaires. The process was assessed by academic tutors at the resubmission stage and/or the peer feedback stage where the quality of peer feedback was directly assessed. The research investigates the quality of peer feedback, the importance of assessment and student perceptions of what is most useful. Methods include directed content analysis of feedback produced, student opinions and a focus group. Students were capable of offering useable feedback across a range of assessment criteria but tend to focus on the important criteria best aligned to the particular assignment. A range of motivational factors and tactics were noticed but students tended to find reviewing the most beneficial.     

Penn State Worry Questionnaire: structure and psychometric properties of the Chinese version

The Penn State Worry Questionnaire (PSWQ) is a measure of worry phenomena and has been demonstrated valid in cross-cultural populations. The present study examined the factor structure and psychometric properties of the Chinese version of PSWQ (Ch-PSWQ) in a Chinese college sample (n=1243). Exploratory factor analysis of the Ch-PSWQ revealed a two-factor solution (engagement of worry and absence of worry). Confirmatory factor analysis and model comparison supported that the model of one factor with method effect provided the best fit to the data. The Ch-PSWQ and its factors evidenced good internal consistency and both convergent and discriminate validity. The present study supports the opinion that the second factor of PSWQ not only contains the component of evaluating pathological worry, but also might represent other traits.     

Development and validation of Kindergarten Environment Rating Scale

The authors present the development and the validation of the four‐dimensional, twenty‐five‐item, five‐point Kindergarten Environment Rating Scale (KERS). The Cohen’s Kappa of the items indicates acceptable reliability for the instrument. The content validity and confirmatory factor analysis indicates that the data obtained using the KERS could differentiate the kindergarten environmental quality in reality, as they proposed to do. As previous literature pointed out, the quality of kindergartens in this study varied greatly across different types and different areas. How to create and utilise the physical environment and how to interact with and provide appropriate support for young children are still common difficulties for kindergartens.     

Development and validation of a brief screening version of the Childhood Trauma Questionnaire

OBJECTIVE: The goal of this study was to develop and validate a short form of the Childhood Trauma Questionnaire (the CTQ-SF) as a screening measure for maltreatment histories in both clinical and nonreferred groups. METHOD: Exploratory and confirmatory factor analyses of the 70 original CTQ items were used to create a 28-item version of the scale (25 clinical items and three validity items) and test the measurement invariance of the 25 clinical items across four samples: 378 adult substance abusing patients from New York City, 396 adolescent psychiatric inpatients, 625 substance abusing individuals from southwest Texas, and 579 individuals from a normative community sample (combined N=1978). RESULTS: Results showed that the CTQ-SF's items held essentially the same meaning across all four samples (i.e., measurement invariance). Moreover, the scale demonstrated good criterion-related validity in a subsample of adolescents on whom corroborative data were available. CONCLUSIONS: These findings support the viability of the CTQ-SF across diverse clinical and nonreferred populations.     

Parental responses to sibling conflict: the effects of development and parent gender

Mothers' and fathers' responses to their children's spontaneous sibling conflicts were observed using a wireless microphone system. Eighty-eight two-child, two-parent families participated in three home observations. Secondborn children were 3 to 5 years of age and firstborn children were 2 to 4 years older. Associations between parents' enactment of three categories of conflict management strategies (passive nonintervention, child-centered management, and parental control) and sibling interaction quality varied according to children's ages, gender of the monitoring parent, and type of strategy used. Passive nonintervention was highly associated with the occurrence of subsequent conflict. Younger sibling dyads, in particular, behaved more antagonistically when their parents did not intervene. In contrast, older sibling dyads were less involved and less close when their mothers intervened in any way. Results suggest that relatively younger sibling dyads may benefit more than older dyads from parental intervention.     

Incorporating Emic Perspectives in Defining Social Competence: Validation of Parental Assessment of Peer Play Interactions at Home for Low-Income Chinese-Heritage Children

Early Childhood Education Journal - Despite the rapid growth of the Chinese immigrant population in the United States, little is known about the social behaviors of Chinese-heritage,...     

Peer assessment in MOOCs: The relationship between peer reviewers’ ability and authors’ essay performance

In a relatively short period of time, massive open online courses (MOOCs) have become a considerable topic of research and debate, and the number of available MOOCs is rapidly growing. Along with issues of formal recognition and accreditation, this growth in the number of MOOCs being developed increases the relevance of assessment quality. Within the context of a typical xMOOC, the current study focuses on peer assessment of essay assignments. In the literature, two contradicting theoretical arguments can be found: that learners should be matched with same‐ability peers (homogeneously) versus that students should be matched with different‐ability peers (heterogeneously). Considering these arguments, the relationship between peer reviewers’ ability and authors’ essay performance is explored. Results indicate that peer reviewers’ ability is positively related to authors’ essay performance. Moreover, this relationship is only established for intermediate and high ability authors; essay performance of lower ability authors appeared not to be related to the ability of their reviewing peers. Results are discussed in relation to the matching of learners and instructional design of peer assessment in MOOCs.     

The Development of a Scale on Assessing Peer Mentoring at the College Level

The purpose of my study was to develop and validate a scale to assess peer mentoring practices that aim to enhance learning. In the development process, 4 focus group interviews were conducted with 10 mentors and 12 mentees who participated in 8 weeks of peer mentoring. In addition to the literature, the findings from interviews were used to develop items. The 11-item form was administered to 126 college students. After the confirmatory factor analysis, the scale took on its final form with 10 items in 3 factors as Contribution to Mentee, Mentor Characteristics, and Peer Relationships. The results of confirmatory analysis were: GFI .92, CFI .99, NNFI .98, RMSEA .080, and Cronbach α coefficient was found to be .954.     

Grudges and gratitude: the social-affective impacts of peer assessment

Abstract

Students’ dissatisfaction with peer assessment has been widely documented. While most relevant literature places focus on the cognitive (content and uptake of feedback) or structural (feedback design) dimensions, students’ emotions in peer assessment have received scant attention. This study investigates the social-affective impacts of peer assessment by analysing students’ appeal letters addressed to their tutors, reflective posts in the online discussion forum and responses to a survey. A thematic analysis of data indicated three main aspects of students’ (dis)satisfaction: content, scores and process of peer assessment. The most negative emotion that students expressed was related to ‘disrespectful’ behaviour and attitudes of peer reviewers, whereas the feeling of appreciation was triggered by the helpful feedback attributes which were perceived as reflecting reviewers’ respect to others’ works. Students generally held mixed feelings toward peer assessment, valuing learning in the process of providing and receiving feedback but showing resistance to using peer assessment for summative purposes. The findings highlight the significance of respect in peer assessment and argue that the perceived lack of mutual respect seems to underpin the nature of students’ dissatisfaction. This study carries implications for nurturing students’ respectful attitudes and behaviour in and through peer assessment.     

The assessment of intrinsic and extrinsic motivation and amotivation: Validity and reliability of the Greek version of the Academic Motivation Scale

Self‐determination theory provides an integrated conception of school‐ and academic motivation. The theory proposes a continuum comprising three types of motivation: intrinsic motivation (IM), extrinsic motivation (EM), and amotivation (AM), characterised by seven dimensions (IM = to know, to accomplish and to experience stimulation, EM = external regulation, introjection and identification, and Amotivation). The purpose of the present study was to examine the psychometric properties of the Academic Motivation Scale (AMS) with Greek high school students. Two studies were conducted to examine the factorial, construct, concurrent and predictive validity of the scale along with its reliability properties. Confirmatory factor analyses supported the proposed seven‐factor structure. The scale showed satisfactory levels of internal consistency and temporal stability. Additionally, indices of the scale’s construct, concurrent, and predictive validity were in the desired direction. These findings support the use of the Greek version of the AMS for the assessment of intrinsic motivation, extrinsic motivation, and amotivation.     

Development and validation of the Self-Regulated Translation Learning Strategy Scale (SRTLSS)

Self-regulated learning (SRL) has been highlighted as a critical aspect of translation learning. However, past work in translation learning has rarely sought to synthesize translation learning strategies under a self-regulated learning paradigm. Further research would be confined by the paucity of a psychometrically sound instrument to measure learners' self-regulated translation learning strategies. This study aimed to develop a reliable and valid self-regulated translation learning strategy scale (SRTLSS). Based on relevant literature, we hypothesized a hierarchical model and generated items for the SRTLSS. Drawing on the response from 873 Chinese English majors, the validated SRTLSS had 25 items addressing five dimensions: self-control, meaning fulfillment, value and interest, text processing, and retrieving strategies. Results demonstrated the SRTLSS has good measurement validity and reliability with strong invariance across undergraduate and graduate students. The SRTLSS can be used as a complementary tool to diagnose learners' weaknesses and strengths in translation teaching and learning.     

Exploring parental involvement in early years education in China: development and validation of the Chinese Early Parental Involvement Scale (CEPIS)

This study developed and validated an instrument, the Chinese Early Parental Involvement Scale (CEPIS), that can be widely used in both local and international contexts to assess Chinese parental involvement in early childhood education. The study was carried out in two stages: (1) focus group interviews were conducted with 41 teachers and 35 parents in Hong Kong and Shenzhen. Teachers and parents were found to hold different perceptions of parental involvement. Responses further revealed that Chinese parents practiced more home-based involvement than preschool-based involvement, and that Chinese parents also have layers of responsibilities that limit their level of involvement in children's early development; (2) items of the CEPIS were developed using focus group responses. To validate the scale, 319 parents were asked to complete the new CEPIS. Results from principal-components factor analyses established that the resultant 26-item CEPIS consists of six parental involvement dimensions. Further analyses revealed that parental involvement differed as a function of parents' marital status and employment status. The major findings, implications and limitations of this research are discussed, together with directions for future research.     

Play is not the work of the child: Young children's perceptions of work and play

Using qualitative methods of participant observation and in-depth interviewing, this research explored kindergarten and first and second grade children's perceptions of classroom activities. Young children perceived classroom activities in terms of what they considered to be work and what they considered to be play. Children identified many messages they received from the classroom context, their peers, and their teachers that contributed to their distinctions. Distinguishing elements included the obligatory nature of activities, the cognitive and physical effort required, the involvement and evaluation of the teacher, and the fun children experienced while engaged in activities. Children saw some activities as “in-between” work and play. A work-play continuum is presented that incorporates children's characterizations.     

Self-concept assessment for young children: Development of a self-report, peer comparison measure

The present investigation concerned the development of the Primary Self-Concept Inventory (PSCI), a group-administered self-report self-concept inventory for children of ages 5 through 8. Replicated analysis of the factor structure of the PSCI data indicated that a seven-component pattern provides an appropriate fit. As a result of this analysis, seven subscales were formed. Acceptable test—retest reliability estimates were obtained for administrations separated by a 6-month interval. On the basis of these results, the PSCI was accepted as a research tool, and recommendations for further investigation of the inventory were made.     

Development and validation of a reading-related assessment battery in Malay for the purpose of dyslexia assessment

Malay is an alphabetic language with transparent orthography. A Malay reading-related assessment battery which was conceptualised based on the International Dyslexia Association definition of dyslexia was developed and validated for the purpose of dyslexia assessment. The battery consisted of ten tests: Letter Naming, Word Reading, Non-word Reading, Spelling, Passage Reading, Reading Comprehension, Listening Comprehension, Elision, Rapid Letter Naming and Digit Span. Content validity was established by expert judgment. Concurrent validity was obtained using the schools' language tests as criterion. Evidence of predictive and construct validity was obtained through regression analyses and factor analyses. Phonological awareness was the most significant predictor of word-level literacy skills in Malay, with rapid naming making independent secondary contributions. Decoding and listening comprehension made separate contributions to reading comprehension, with decoding as the more prominent predictor. Factor analysis revealed four factors: phonological decoding, phonological naming, comprehension and verbal short-term memory. In conclusion, despite differences in orthography, there are striking similarities in the theoretical constructs of reading-related tasks in Malay and in English.