Situated assessment: Limitations and promise

We present some key findings of a four-year, two-phase writing assessment project at Central Michigan University: Phase One (2002), a survey of faculty members (n = 115) and subsequent focus groups (n = 14) and Phase Two (2005), an evaluation of two samples of student writing (n = 635 and 632). Major findings of Phase One reported here include the amounts and types of writing assigned by faculty members and their perceptions about the quality of their students’ writing. Phase Two revealed some surprising results about our students’ critical reading and writing abilities, confirmed the limitations of a timed-writing assessment methodology, and exposed an intriguing artifact of the data set. We reflect on the process of developing and conducting the assessment project, examine its strengths and weaknesses, and share our thoughts about the next phase of our assessment odyssey.     

Social models in the cognitive appraisal of self-efficacy information

The purpose of this investigation was to test (a) whether students distinguished between self-efficacy sources according to social model and (b) how predictive the self-efficacy information students received from each social model was for their self-efficacy beliefs. For this purpose, new vicarious experience and social persuasion scales were developed that independently assess the respective source of self-efficacy information conveyed by three social models, family members, teachers, and peers. As revealed by exploratory factor analysis, confirmatory factor analysis, and multitrait-multimethod analysis, the Korean high school students in Studies 1 (N = 395) and 3 (N = 393) and the Korean college students in Study 2 (N = 220) clearly distinguished between the self-efficacy sources and the social models who delivered this information (family members, teachers, or peers). Student responses to vicarious experience fluctuated more by social model than did their responses to social persuasion. The correlations further suggest the possibility that the existing scale largely taps vicarious experience from teachers and peers rather than vicarious experience from family members. The predictive utility of vicarious experience and social persuasion for self-efficacy also varied according to the social model involved and by the academic domain. Social persuasion by teachers predicted student self-efficacy in mathematics, while vicarious experience from teachers predicted student self-efficacy in English as a foreign language, in addition to mastery experience and physiological state.     

The effect of blended learning on student performance at course-level in higher education: A meta-analysis

The present paper analyzes the impact of blended learning (BL) on the academic achievement of higher education students. A meta-analysis (k = 51 effect sizes) was conducted to perform a statistical synthesis of studies contrasting student performance in BL conditions with traditional classroom instruction. We include disciplines and instructors’ end-of-course evaluation method as moderating variables. The results show that BL demonstrates a small summary effect (g⁺ = 0.385, p < 0.001) compared to traditional teaching methods A significantly higher mean effect size was found in STEM disciplines (g⁺ = 0.496) compared to that of non-STEM disciplines (g⁺ = 0.210). Nevertheless, the weighted mean effect sizes reveal no significant differences regarding of end-of-course assessment methods, namely one-moment and multiple-component assessment. The finding confirms that BL is significantly associated with greater learning performance of STEM-disciplined students than with traditional classroom practice. Accordingly, discussion concerning the findings and implications for future research are elaborated.     

Language development of Chinese adoptees 18–35 months old

In this study, we investigated the expressive language development of 186 18–35 months old Chinese girls adopted into American families. The adoptees were adopted between 3 and 25 months (M = 11.0, S.D. = 3.1) and had lived in the adoptive families for 3–27 months (M = 16.2, S.D. = 5.8) at the time of the study. The adoptive mothers provided information on the adoptees’ pre- and post-adoption experiences, behavioral-emotional problems, and spontaneously uttered words and phrases. Cross-sectional data indicated that the adoptees experienced a full catch up after living in the adoptive families for an average of about 16 months. After that, the adoptees’ language level surpassed the U.S. norms for the same age group. Findings also suggested that the adoptees’ current age and age at adoption were associated with vocabulary size, while only age at adoption was a significant predictor of average phrase length. Pre-adoption experiences and current family demographics were not associated with the adoptees’ vocabulary size or average phrase length. The adoptees’ externalizing problems were negatively and weakly correlated with their phrase length.     

Measuring teachers’ perceptions about differentiated instruction: The DI-Quest instrument and model

Within a democratic and multicultural society, diversity is a reality, and differences between students are a fact which teachers have to deal with on a daily basis. Differentiated instruction aims to meet these differences in learning in order to provide all students with the best possible learning opportunities. However, to date no validated instruments exist to measure teachers’ perceptions of differentiated instruction and their related classroom practices. This study, therefore, examined the factor structure and reliability of the Differentiated Instruction Questionnaire, called the DI-Quest instrument. A list of 87 items was constructed, building on existing prevalent theoretical models of Differentiated Instruction (e.g. Tomlinson, 2014; Hall, 2002). An exploratory and confirmatory factor analysis was undertaken to investigate the factor structure of the questionnaire. As a result, five factors emerged: two factors related to the teachers’ philosophy of differentiated instruction (the teachers’ mindset and their ethical compass), two factors referred to the practical principles that teachers apply to differentiate (flexible grouping and output = input) and the last factor (differentiated instruction) covered the self-reported extent to which teachers differentiated their instruction related to three types of differences in learning (students’ interests, readiness and learning profile). As a result, the DI-Quest instrument entailed 31 items with a five-factor structure indicating a good fit (CFI = 0.919; TLI = 0.911; RMSEA = 0.041 [0.037–0.044 – 90% confidence interval, p(0.05) = 1.000]; SRMR = 0.048; χ² = 5888.338, df = 465, p = 0.000). In addition, assuming theoretical relatedness between the factors, the validation of a DI-Quest model was empirically validated. We compared the model fit for two models by investigating which model had a lower BIC and AIC value and by comparing their chi square values. The best-fitting DI-Quest model showed four factors (teachers’ mindset, ethical compass, flexible grouping and output = input as dependent variables) functioning as significant predictors of the fifth factor (the self-reported adoption of Differentiated Instruction, which served as an independent variable). Moreover, this paper also discusses the psychometric properties of the DI-Quest instrument and the implications of the model for schools, educators and researchers.     

An embedded fuzzy analytic hierarchy process for evaluating lecturers’ conceptions of teaching and learning

This study evaluates the effects of Continuing Professional Development Programmes (CPDP) on the conceptions of lecturers in the teaching and learning processes in a higher education setting. An interpretive paradigm and mixed method of collecting and analysing data from participants was followed. Data for the study was gathered through survey among all the participants (N = 85) after which interviews were conducted among participants from the same population (n = 12). While interviews and observation served as the qualitative approach of gathering information from lecturers, Fuzzy Analytic Hierarchy Process (FAHP) was employed as a quantitative method to evaluate the impact of CPDP on conception changes in the teaching and learning processes of lecturers. The weights of the first four factors resulted in 73.16% rate (Buckley’s method) and 67.33% (Chang’s method). The results indicates that CPDP could be used to alter lecturers’ conceptions of teaching and learning and evaluated through an embedded FAHP.     

Attitudes,beliefs, and perceived norms about corporal punishment and related training needs among members of the “American Professional Society on the Abuse of Children”

Hitting children for disciplinary purposes (i.e., spanking or corporal punishment [CP]) is a strong risk factor for child physical abuse and is highly prevalent in the U.S. Yet, little is currently known about the relevant attitudes, beliefs, or training needs of key professionals who often advise parents regarding child discipline strategies. A survey of the American Professional Society on the Abuse of Children (APSAC) membership, comprised of mental health professionals, physicians, child welfare professionals, and other professionals in the child maltreatment field, was conducted to assess attitudes, beliefs, perceived norms, training needs, and motivations to change norms regarding CP (N = 571, response rate = 51%). Most respondents agreed that spanking is a bad disciplinary technique (82%), is harmful for children (74%), and leads to negative outcomes (M = 3.0, SD = 0.6) more frequently than positive outcomes (M = 2.1, SD = 0.6; t = 20.8; p < 0.0001) for children. Professionals reported perceiving that their colleagues’ level of endorsement of CP (M = 2.4, SD = 1.0) was higher than their own (M = 1.9, SD = 1.0; t(568) = −10.7, p <0.0001) though still below the midpoint. Professionals reported high levels of preparedness to effectively advise parents on non-physical child discipline strategies, but reported perceiving lower levels of preparedness amongst their colleagues. They reported highly valuing giving such advice to parents and being very motivated to participate in activities designed to change social norms regarding CP. Most APSAC members are poised to change these norms and, in doing so, to help reduce rates of child physical abuse in the U.S.     

Teachers’ stress intensifies violent disciplining in Tanzanian secondary schools

Violent forms of discipline in schools continue to be widespread across the globe despite their damaging effects. Since little is known about factors influencing the extent of violence applied by teachers, this study aimed to investigate the influence of teachers’ stress, work satisfaction, and personal characteristics on their disciplining style. Using structural equation modeling, associations between violent discipline, burnout symptoms, and job perceptions (pressure and difficulties in class) reported by 222 teachers from 11 secondary schools in Tanzania in 2015 were analyzed. Results indicated a direct association between perceived stress and emotional violent discipline (β = .18, p < .05) as well as physical violent discipline (β = .37, p < .001). Perceived stress also mediated the association between job perceptions and both forms of violent disciplining. The model showed good model fit (χ² [44, n = 222] = 67.47 (p = .013), CFI = .94, TLI = .91, IFI = .94, RMSEA = .049 [90%-CI = .02–.07, PCLOSE = .50], SRMR = .06). Our findings suggest that teachers’ personal perceptions of their work as well as their stress burden play a role in their disciplining styles. Our findings underline the importance of integrating topics, such as stress and coping as well as positive, nonviolent discipline measures into the regular teacher’s training and in addition to develop and evaluate school-based preventative interventions for teachers.     

A national survey of characteristics of child advocacy centers in the United States: Do the flagship models match those in broader practice?

Child Advocacy Centers (CAC) emphasize developing effective cross-agency collaborations between workers involved in serious abuse investigations to foster improvements in agency outcomes, and to minimize distress, confusion and uncertainty for children and families. This study examined the characteristics of CACs, whether models in practice match the predominant model presented in the research literature. Directors of CACs in the United States that were members of the National Children’s Alliance (NCA) mailing list (n = 361) completed an online survey in 2016. While some core characteristics were ubiquitous across CACs, the data suggests that different types of CACs exist defined by characteristics that are not prescribed under NCA principles, but which are arguably relevant to the quality of the response. From the results of a cluster analysis, the researchers propose a typology of CACs that reflects the development and integration of centers: (a) core CAC services (i.e. interviewing & cross-agency case review); (b) an aggregator of external services, and (c) a more centralized full-service CAC. Further research is needed to understand how these variations may impact practice and outcomes; this is particularly important considering many CACs do not match the full-service models most commonly examined in the research literature, which limits the degree to which these findings apply to CACs generally. This article proposes further research framed by the need to better understand how different parts of the response impact on outcomes for children and families affected by abuse.     

Working memory as a moderator of training and transfer of analogical reasoning in children

Working memory is related to children’s ability to solve analogies and other inductive reasoning tasks. The aim of this study was to examine whether working memory also plays a role in training and transfer effects of inductive reasoning in the context of a short training procedure within a pretest-training-posttest-transfer design. Participants were 64 children, aged 7–8 years (M = 7.6 years; SD = 4.7 months). All of the children were pre-tested on inductive reasoning and working memory tasks. The children were trained in figural analogy solving according to either the graduated prompts method or practice without feedback. The children were then post-tested on the trained task and three additional inductive reasoning measures. Regression models revealed that visuo-spatial working memory was related to initial performance on each of the inductive reasoning tasks (r ≈ .35). Children’s improvement from pretest to posttest in figural analogy solving, as measured with item response theory models, was somewhat related to visuo-spatial WM but not verbal WM scores or pretest scores. Furthermore, transfer of reasoning skills to an analogy construction task was related to initial ability, but not working memory; transfer to two inductive reasoning tasks with dissimilar content was not apparent. Performance change and ability to transfer trained skills to new tasks are not often used in psycho-educational assessment but may be separate constructs indicative of children’s learning and change.     

In-house consultation to support professionals’ responses to child abuse and neglect: Determinants of professionals’ use and the association with guideline adherence

This study examined the presence and strengths of determinants associated with consultation of an in-house expert on child abuse and neglect (CAN) by preventive child health care professionals who suspect CAN. This study also assessed the relationship between in-house CAN expert consultation and professionals’ performance of six recommended activities described in a national guideline on preventing CAN for preventive child health care professionals. A total of 154 professionals met the study’s inclusion criteria. They filled in a questionnaire that measured in-house consultation practices and twelve determinants associated with the professional, the in-house expert, and the organizational context. Bivariate and multivariate regression analyses were performed. Almost half of the participants (46.8%) reported to consult the in-house expert in (almost) all of their suspected CAN cases. Professionals who reported better recollection of consulting the in-house expert (i.e. not forgetting to consult the expert) (p = .001), who were more familiar with consultation (p = .002), who had more positive attitudes and beliefs about consultation (p = .011) and who reported being more susceptible to the behavior (p = .001) and expectations/opinions (p = .025) of colleagues regarding in-house expert consultation were more likely to consult the in-house expert. Furthermore, in-house expert consultation was positively associated with two of six key guideline activities: consulting the regional child protection service and monitoring whether support was provided to families. The implications of these results for improving professionals’ responses to CAN are discussed.     

Effects of instruction on changes in epistemological beliefs

In this study, we investigated the effects of teaching critical-thinking principles on university students’ epistemological beliefs, whether these effects had any relation to the teaching approaches, and whether there was any significant interaction effect between teaching approach and students’ epistemological beliefs. One hundred and eight undergraduates were randomly assigned to three different 65-min instructional interventions, namely, General, Infusion, and Immersion approaches. Statistical analyses of the data using a Repeated Measures ANOVA showed a statistically significant higher post-assessment performance, F (1, 105) = 19.769, p = .00. The main effect related to the intervention was also significant, F (2, 105) = 3.995, p = .021, but there was no significant interaction between intervention and epistemological beliefs. Post hoc comparisons revealed that students assigned to the Infusion strategy outperformed those assigned to the General approach on epistemological change.     

Child sexual abuse research knowledge among child abuse professionals and laypersons

The purposes of this study were to: (1) Assess child abuse professionals’ and nonprofessionals’ knowledge of scientific research findings that are relevant to forensic child sexual abuse (CSA) evaluations and (2) describe associations between child abuse professionals’ levels of research knowledge and their education and experience. An 18-item multiple-choice test was administered to 188 child abuse professionals and 457 nonprofessionals (undergraduate college students) in Brazil and the United States. The nonprofessionals’ average percent correct, M = 44%, was not significantly different than what would be expected for random guessing (45%). The professionals’ average percent correct, M = 55%, was higher than that of nonprofessionals and random guessing (both ps < .001). The average percent correct score for the US-sample psychologists, M = 76%, was higher than the average score of the other professionals, M = 51%, p < .001. Professionals’ educational level, as measured by the highest academic degree obtained, was positively associated with percent correct scores, Spearman's ρ = .46, p < .001. Controlling for educational attainment, professional experience, as measured by the total number of CSA evaluations performed, was weakly associated with percent correct scores, partial r = .15, p = .04. Percent correct scores were low for both nonprofessionals and professionals. Most of the participants in this study were uninformed or misinformed about scientific research findings that are important for conducting optimal forensic CSA evaluations and for making accurate judgments about the validity of sexual abuse allegations.     

Adolescents’ preparedness and motivation across the transition to post-comprehensive education

This longitudinal study aims to test the concept of transition preparedness in the context of educational transitions. The study investigates how adolescents’ transition preparedness, conceptualized as their self-efficacy beliefs and their inoculation against setbacks, before an educational transition affect the adolescents’ school value and effort related to educational goals after the transition through the effects on achievement goal orientations. Student data from three waves of a longitudinal study are used, first collected in 2004 (before the students’ transition from comprehensive school to upper secondary education) and then collected twice after the transition. The students included in the analyses are those who participated at all three measurement points (N = 588; 49.5% girls; age M_T1 = 15.01, SD = 0.13). Longitudinal structural equation modeling revealed that adolescents’ self-efficacy beliefs (Time 1) positively predicted school value and effort (Time 3) through their effect on mastery goal orientation (Time 2). Furthermore, self-efficacy moderated the relation between performance-approach goal orientation (Time 1) on school value (Time 2). Results are discussed in terms of their relevance for enhancing adolescents’ adaptive motivational development across educational transitions.     

Variation in prevention of child maltreatment by Dutch child healthcare professionals

Child maltreatment (CM) is a common condition with a large impact on the victim and society. In the Netherlands, the preventive child healthcare (CHC) aims to protect children against such threats. However, several studies indicate that the efficacy in this area may be suboptimal for many CHC professionals. Therefore, this study aims to map the practice variation in the primary and secondary prevention of CM, by CHC physicians and nurses. This mixed-methods study used interviews to identify relevant topics and develop an online questionnaire. All CHC organizations in the Netherlands (n = 45) were asked to forward this questionnaire to their professionals. Practice variation was described with domain scores and item response distributions. Multi-level analysis was used to assess case mix-corrected variance between organizations. Interview participants (n = 11) expected suboptimal care in 35 topics which they considered important for prevention of CM, resulting in a 15 min questionnaire. Nearly two-thirds of the organizations (n = 29) agreed to forward the questionnaire to their employees. The response rate was 42% (n = 1104). Suboptimal care and practice variation was found in all domains (i.e. communication, medical expertise, collaboration, involvement in prevention of CM, and improvement opportunities), mostly caused by intra-organization variance. Significant inter-organization variance was found for collaboration (variance partition coefficient 6–7%) and involvement (2–3%). Furthermore, the majority of the respondents (96%) reported fear in acting upon suspicions of CM. Substantial suboptimal care and practice variation in prevention of CM warrant action from authorities, CHC training institutes, CHC organizations, and professionals.     

Maternal and paternal physical abuse: Unique and joint associations with child behavioral problems

Although there is a substantial amount of literature documenting the relationship between child abuse and behavioral problems in China, there is, on the other hand, a limited number of studies on the joint and unique associations of maternal and paternal physical abuse with child behaviors within the Chinese context. The present study, using the family systems theory as the theoretical framework, aims to examine these joint and the unique associations of maternal and paternal physical abuse with externalizing and internalizing behaviors among a community sample of Chinese children. A total of 296 children (54.7% boys, mean age 12.31 ± 0.56 years) from two-parent families participated in the study, and they reported their physical abuse experience by their mother and father in the previous year using the Chinese version of the Parent-Child Conflict Tactics Scale. Participants, using the Youth Self Report, reported personal externalizing and internalizing behaviors, and, similarly, their mothers, using the Child Behavior Checklist, assessed children’s externalizing and internalizing behaviors. Linear mixed effect models with random intercept and slope were used to examine the joint and unique associations of maternal and paternal physical abuse with child externalizing and internalizing behaviors. Results revealed that physically abused children were more likely to be simultaneously abused by both mothers and fathers. Furthermore, when compared with their non-abused counterparts, children with physical abuse that was carried out solely by mothers (externalizing behaviors: β = 6.71, 95% CI = 2.45–10.98, p < 0.01; internalizing behaviors: β = 4.52, 95% CI = 0.37–8.66, p < 0.05) or by both mothers and fathers (externalizing behaviors: β = 4.52, 95% CI = 1.80–7.24, p < 0.001; internalizing behaviors: β = 2.98, 95% CI = 0.34–5.61, p < 0.05) reported more externalizing and internalizing behaviors. Externalizing and internalizing behaviors of children who were physically abused solely by fathers did not significantly differ from those of their non-abused counterparts, which may result from the small sample size. The present findings suggest that maternal physical abuse may have a dominant and unique association with child behaviors, regardless of whether paternal physical abuse occurs within the family. Implications for future research and practice within the Chinese context regarding the subject of child behaviors and parental abuse are discussed.     

Does it matter how Molly does it? Person-presentation of strategies and transfer in mathematics

Educational materials often present general concepts or strategies via specific people. Although this practice may enhance interest, it may also have costs for learning and transfer. Linking a strategy to a person (e.g., “Molly’s strategy”) could result in narrower transfer because students infer that the strategy is specific to the person, rather than a general strategy they should adopt. The present study tested this hypothesis among middle school students (N = 191) who learned a novel strategy for solving a mathematics story problem. For some students, the strategy example was presented via a specific person, and for others it was not. Students then solved posttest problems and rated the generality of the strategy. Students who saw the example without the person were more likely to transfer the strategy to new problems, and this effect was mediated by students’ perceptions of the strategy’s generality. Thus, associating information with a person substantially limits the extent to which students transfer their knowledge.     

The influence of childhood polyvictimization on disordered eating symptoms in emerging adulthood

Children who endure multiple victimization experiences, or “polyvictims," are vulnerable to maladaptive outcomes. Yet, little research exists evaluating the relationship between childhood polyvictimization and disordered eating symptoms (DES) in emerging adulthood. The current study examines the relationship between childhood polyvictimization and DES in emerging adults. Data were collected from 288 participants across two universities using online self-report measures. Hierarchical regression analyses revealed a significant positive relationship between number of childhood victimization experiences and DES in young adulthood (ß = 0.14; p = 0.016). Female participants were more likely to demonstrate DES (ß = 0.14; p = 0.008). Further, high levels of emotion dysregulation during young adulthood were associated with more DES (ß = 0.33; p < 0.001). Findings suggest that exposure to victimization experiences in childhood increases individuals’ risk for exhibiting DES in young adulthood. Results also highlight the strong relationship between individuals’ emotion regulation abilities and the presence of DES. Findings align with the theory that children who have endured high levels of victimization often feel overwhelmed by their emotions and circumstances, demonstrate emotion regulation difficulties, and may rely on maladaptive coping strategies, including disordered eating, to manage adversities. Study results emphasize the importance of considering victimization history when working with emerging adults displaying disordered eating symptomatology.     

Mentoring as service-learning: The relationship between perceived peer support and outcomes for college women mentors

This study examined whether peer support was related to psychosocial outcomes for college women serving as youth mentors in the Young Women Leaders Program (YWLP), a service-learning mentoring program. The outcomes assessed were college students’ ethnocultural empathy and their sense of competence, relatedness, and autonomy. Data included questionnaires completed by YWLP mentors (YWLP; n = 227) and college women with (CS; n = 230) and without (no CS; n = 105) alternative community service involvement. Results showed that YWLP mentors’ level of perceived peer support was associated with stronger outcomes in autonomy as compared to the CS group and in ethnocultural empathy as compared to both comparison groups. These findings extend the literature on effective support for college service-learning participants.     

Previous maltreatment and present mental health in a high-risk adolescent population

Childhood maltreatment is known to increase the risk of future psychiatric disorders. In the present study, we explored the impact of experienced maltreatment on the prevalence and comorbidity of psychiatric disorders in a high-risk population of adolescents in residential care units. We also studied the impact of poly-victimization. The participants of the study were adolescents in residential care units in Norway (n = 335, mean age 16.8 years, girls 58.5%). A diagnostic interview (Child and Adolescent Psychiatric Assessment Interview) was used, yielding information about previous maltreatment (witnessing violence, victim of family violence, community violence, sexual abuse) and DSM-IV diagnoses present in the last three months. Exposure to maltreatment was reported by 71%, and in this group, we found significantly more Asperger's syndrome (AS) (p = .041), conduct disorder (CD) (p = .049), major depressive disorder (MDD) (p = .001), dysthymia (p = .030), general anxiety disorder (GAD) (p < .001), and having attempted suicide (p = .006). We found significantly more comorbid disorders in the maltreated group. Poly-victimization was studied by constructing a scale comprised of witnessing violence, victim of family violence, victim of sexual abuse and household dysfunction. We found that poly-victimization was associated with significantly increased risk of MDD, GAD, AS, CD, and having attempted suicide (p < .01). The complexity of the clinical outcomes revealed in this study suggest that longer-term treatment plans and follow-up by psychiatric services might be needed to a greater extend than for the rest of the child and adolescent population, and that trauma informed care is essential for adolescents in residential youth care.