The development of the protective factors survey, 2nd edition: A self-report measure of protective factors against child maltreatment

BackgroundThe Protective Factors Survey (PFS) is a self-report measure of multiple family-level protective factors against abuse and neglect. It is the only peer-reviewed valid and reliable tool collecting data on multiple protective factors, and is widely used by practitioners in child abuse prevention and related fields.ObjectiveThe objective of this study was to revise the PFS in response to feedback from practitioners, and analyze the internal structure of new items.Participants and settingData was collected from two Qualtrics panel samples (N = 213 and N = 109).MethodsA team of researchers generated new items informed by the literature on protective factors against child maltreatment and best practices in survey design to address feedback from the field and improve sensitivity to change. We conducted focus groups with caregivers and practitioners to review new items, and then fielded revised items using panel data. We conducted exploratory factor analyses to obtain a small, integrated set of items that tap the targeted protective factors.ResultsExploratory factor analyses yield a five-factor solution. Four of the factors consisting of Family Functioning and Resilience, Nurturing and Attachment, Social Supports, and Concrete Supports. A fifth factor emerged consisting of items intended to capture Social Supports. We adapted these items to measure Caregiver/Practitioner Relationship.ConclusionsWe have developed the PFS, 2nd Edition based on feedback from the field and focus groups with parents and practitioners. Initial evidence from the panel data suggests that the new subscales are internally consistent. Future research will establish reliability and validity.     

Medical leadership competences among medical students at Hashemite University in Jordan

ABSTRACT

The purpose of this study is to identify Medical Leadership Competences among medical students at Hashemite University, and analyze the significant differences in the university participants based on their academic level, gender and GPA. Data collection randomly selected from medical students, the response rate for were (260) students. A 40 items survey covered the five areas of Medical Leadership Competences were used. The responses indicated that the most leadership competences for medical students ascending by means were: ‘Demonstrating personal qualities’, ‘Working with others’, ‘Managing services’, ’Setting direction’, an ‘Improving services’, all of these competencies were in high level. There were no significant differences at the 0.05 level among medical leadership competences of medical students’ at Hashemite University related to their academic year, gender, and GPA.     

Graphical Modeling: A New Response Type for Measuring the Qualitative Component of Mathematical Reasoning

We investigated the functioning of a new computer-delivered response type for potential use in graduate admissions assessment. This response type, which is open-ended and automatically scorable, presents problems calling for the examinee to draw a graph modeling a given situation. Problem situations can be like the single-best-answer items currently found on the Graduate Record Examinations (GRE) General Test (ETS, 1998) or they can be more loosely defined, allowing for multiple-correct responses. Two graphical modeling (GM) tests differing from one another in the manipulation of specific item features were randomly spiraled among study participants. Results showed that GM scores were very reliable and moderately related to the General Test's quantitative section, suggesting that GM might help broaden the GRE quantitative construct. In exploratory difficulty analyses, 1 of 3 manipulated item features, problem structure, had a dependable effect. No significant gender differences independent of those associated with the GRE quantitative section were detected. Finally, more participants preferred regular multiple-choice graphical reasoning questions to GM items but thought GM was the fairer indicator of their ability to undertake graduate study.     

Enhancing student engagement in student experience surveys: a mixed methods study

Background

Measuring the student experience is becoming increasingly important in higher education in the UK. Student experience surveys are used as indicators of quality and form the basis of rankings of higher education institutions. They are also used by them as tools to assist their quality enhancement initiatives. However, these surveys frequently suffer from low response rates, which can reduce the reliability and usefulness of their data. The UK Postgraduate Taught Experience Survey (PTES) is a relatively new survey and suffers from a low response rate. As this survey is new, little is known about why students do not respond to it.

Purpose

This study aimed to explore the reasons why postgraduate students do not respond to the PTES.

Sample

Three hundred and fifty-five postgraduate taught students from four health faculties in one UK higher education institution completed an online survey. Of these, seven participated in one of two focus groups.

Design and methods

The online survey was completed both by students who completed the PTES in 2011 and those who did not. This provided us with cross-sectional data to compare both groups’ knowledge of PTES and their reasons for completing or not completing it. We used multivariate regression analysis to explore which variables were associated with response to PTES. We led two focus groups to explore the themes that emerged from the survey in more depth. This data was analysed by two researchers using thematic analysis.

Results

The cross-sectional data found that students who were not clear about the purpose of PTES were less likely to respond, independent of other potential predictor variables. Focus group data indicated that if postgraduate students felt a stronger connection to the university community they may be more likely to respond to PTES.

Conclusions

This study suggests that higher education institutions may wish to review their strategies for advertising student experience surveys to focus more on their purpose rather than their impact.     

Strengthening Environmental Communications

Abstract

An attitudinal survey that contrasted student perceptions on environmental/energy questions during the decade of intense concern for these issues was conducted at Cornell University in 1971 and 1981 (3414 and 3867 students sampled, respectively). The survey was designed to measure changes in attitude toward thirty-five specific items in five major categories (Food-stuffs, Household items, Transportation, Personal items, and Recreation). Significant differences were observed between the two surveys with most of the differences associated with political leanings, income, gender and geographical background. The changes were in the direction of a more materialistic lifestyle with less consideration for environmental/energy issues and concerns.     

Teachers’ perceptions of and attitudes towards performance appraisal in Zimbabwean schools

Abstract

This article reports on an empirical investigation of Zimbabwean teachers’ attitudes towards Performance Appraisal (PA) as a model of staff supervision and the resultant impact on their motivation and performance. A survey design was used to gather data by means of a questionnaire containing ninety one precoded response items on the concepts of supervision and PA, induction programmes, PA interviews and teachers’ attitudes to PA. The responses of fifty two teachers out of a sample of sixty revealed that on the whole teachers are positively motivated by staff supervision models which seek to develop their pedagogical skills and therefore tend to enhance their performance with a view to improving education and attaining educational goals. The research revealed that PA should be collaborative, transparent, dialogical and accountable. Models which are judgmental and call for close and constant supervision are unpopular.     

Identification of Greek beekeepers' educational needs,a case study

Abstract

This study was conducted to identify the Greek beekeepers' educational needs. A questionnaire was mailed to 1000 beekeepers selected at random from a list of subscribers to a beekeeping journal published monthly. The questionnaire consisted of 16 items related to course instruction and other questions regarding their demographic characteristics.

For data analysis three statistical techniques were used: (i) factor analysis, (ii) Kruskal-Wallis test and (iii) Mann-Whitney U test. From the factor analysis, the 16 items related to course instruction were grouped into four factors indicating beekeepers' preference on those topics. Using demographic characteristics, beekeepers' preference to educational needs was identified.

It is necessary to provide a quality education for adult beekeepers which must be flexible enough to meet the needs of farmers and which is also supported by the local community. The findings aided authors in recommending procedures for the organisation of future seminars meaningful for the Greek beekeepers.     

Pupil Opinions and the Relationship of Television Viewing to Academic Achievement

Abstract

An instrument was developed to measure multicultural attitudes of teacher trainees. The Multicultural Attitude Questionnaire (MAQ) was based on the hypothesis that multicultural attitudes would best be reflected by responses in several dimensions. Consequently, the MAQ contains items relating to variety in family and friends, social distance, acceptance of others, opinions on specific groups, and ethnic composition. The MAQ was analyzed through the use of factor analysis, multiple regression, and the correlation of scores with personality variables. The MAQ appears to be a promising tool to assess multicultural attitudes. It appears to be sensitive to differences between students and to offer a method for assessment of developmental differences of teacher trainees in a teacher education program.     

Management of non-consensually shared youth-produced sexual images: A Delphi study with adolescents as experts

There is an increased availability of online child abuse images, a proportion of which is created by young people in coercive and non- coercive relationships (sexting).ObjectivesThis Delphi study with adolescents as "experts" who had taken and shared sexual images, was conducted to identify appropriate responses to sexting where images are shared without consent and identify indicators of distress and ways to facilitate disclosure when the sharing of images causes anxiety or is associated with further victimization.Participants and setting124 adolescents from the United Kingdom completed an online survey. All self-identified as taking and sharing sexual images of themselves. 45 provided full survey responses (73% female; mean age 16.24) and of these 23 completed the second round. Recruitment was through social media and local schools.MethodsAn online two-round Delphi method was completed using a vignettes-based questionnaire. To assess consensus, a defined average percentage agreement (80% cut-off) was used. Qualitative content analysis identified relevant themes in responses to Round 1 which informed the Round 2 items.ResultsIn the first round 60 items were identified that endorsed views of problem identification, facilitation of disclosure, proportionate responding, and problem management. Overall, participants agreed that the clear majority of statements identified in Round 2 were important and thus achieved consensus.ConclusionsThis study represents a novel and inclusive approach through the formation of an expert panel of young people. These views may inform appropriate victim-centered management of cases where images have been shared without permission.     

Analyzing Fairness Among Linguistic Minority Populations Using a Latent Class Differential Item Functioning Approach

ABSTRACT

Differential item functioning (DIF) analyses have been used as the primary method in large-scale assessments to examine fairness for subgroups. Currently, DIF analyses are conducted utilizing manifest methods using observed characteristics (gender and race/ethnicity) for grouping examinees. Homogeneity of item responses is assumed denoting that all examinees respond to test items using a similar approach. This assumption may not hold with all groups. In this study, we demonstrate the first application of the latent class (LC) approach to investigate DIF and its sources with heterogeneous (linguistic minority groups). We found at least three LCs within each linguistic group, suggesting the need to empirically evaluate this assumption in DIF analysis. We obtained larger proportions of DIF items with larger effect sizes when LCs within language groups versus the overall (majority/minority) language groups were examined. The illustrated approach could be used to improve the ways in which DIF analyses are typically conducted to enhance DIF detection accuracy and score-based inferences when analyzing DIF with heterogeneous populations.     

Cross-cultural comparability of noncognitive constructs in TIMSS and PISA

Abstract

Noncognitive assessments in Programme for International Student Assessment (PISA) and Trends in International Mathematics and Science Study share certain similarities and provide complementary information, yet their comparability is seldom checked and convergence not sought. We made use of student self-report data of Instrumental Motivation, Enjoyment of Science and Sense of Belonging to School targeted in both surveys in 29 overlapping countries to (1) demonstrate levels of measurement comparability, (2) check convergence of different scaling methods within survey and (3) check convergence of these constructs with student achievement across surveys. We found that the three scales in either survey (except Sense of Belonging to School in PISA) reached at least metric invariance. The scale scores from the multigroup confirmatory factor analysis and the item response theory analysis were highly correlated, pointing to robustness of scaling methods. The correlations between each construct and achievement was generally positive within each culture in each survey, and the correlational pattern was similar across surveys (except for Sense of Belonging), indicating certain convergence in the cross-survey validation. We stress the importance of checking measurement invariance before making comparative inferences, and we discuss implications on the quality and relevance of these constructs in understating learning.     

An Experiment with the Controlled Reader

Abstract

This study was an investigation of items on the Peabody Picture Vocabulary Test (PPVT) to ascertain if verbal responses to items missed indicated that the concept was familiar at the same level of abstraction as the word in the PPVT. One hundred 8-year-old children-25 black boys, 25 black girls, 25 white boys, and 25 white girls-were administered Form A of the PPVT. Eighty-eight children responded verbally to the pictures of the stimulus words missed. Data were analyzed by means of a two-way analysis of variance. A chi square test of significance was used to determine significance level of difference between items for each group. Judges analyzed verbal responses to determine if responses elicited were 1) at the same level of abstraction as the stimulus word, 2) considered to be synonymous to the stimulus word, and 3) indicated the student's understanding of the concept signified by the word. A total of 23 words were identified as being missed disproportionately by one group more than the other. Verbal responses indicated that the concept was familiar for 16 items and unfamiliar for three items. Of the remaining four items, there was indication of differences among the groups.     

‘Come in with an open mind’: changing attitudes towards mathematics in primary teacher education

Background: The relationship between attitudes and behaviour has led to a focus on the role played by attitudes in the teaching and learning of mathematics.

Purpose: This paper reports on an investigation into student teachers’ self-reported attitudes towards mathematics in the context of a mathematics education programme. The programme had been developed by the authors in response to a new, reformed four-year undergraduate initial teacher education (ITE) for primary teachers in Ireland. The authors aimed to use the feedback to evaluate and develop the course further.

Sample: We report on the attitudes of 345 pre-service primary teachers enrolled in a four-year undergraduate ITE programme. 281 of these participants had matched survey data before and after participating in the mathematics education programme.

Method and Design: Four evaluation criteria were used as a conceptual framework for the evaluation of the mathematics education programme. A multi-method approach was taken in investigating the students’ attitudes to mathematics by using a scale as a quantitative measure of attitude alongside open-ended survey items that provided qualitative insights into changes in attitudes.

Results and conclusions: Results from the survey data suggested overall that the participants’ attitudes towards mathematics were more positive after they had experienced the mathematics education programme. Overall, the written responses suggested that according to self-reportage, participants perceived that participation in the mathematics education programme had affected their attitudes towards mathematics positively. Comments indicated that the ‘small group’ tutorial structure was particularly well received and was associated with opportunities to actively engage, explore, interact and reflect. Suggestions offered by the participants will be used to inform planning and development of the mathematics programme.     

The Effect of Item Response Changes on Scores on an Elementary Reading Achievement Test

Abstract

The effect of changing item responses on scores of elementary school children on a standardized achievement test was studied. Previous research, primarily involving non-standardized instruments and adult samples, indicates that changed responses are more likely to be correct than not. Subjects were 165 third grade students using the Metropolitan Reading Tests. Students received no special instructions regarding changing responses. Changes were identified visually and were independently verified. While frequency of response changes was low, such changes generally improved scores. Sex differences in number and success of changes were non-significant. The relationship between frequency of response change and test score was minimal. Responses to difficult items were changed more frequently with less success than changes on easy items. High scorers made more successful changes than did low scorers. Within the limits of the methodology, results clearly indicated that response changes of elementary students on multiple-choice items tend to improve test scores.     

LIFESTYLE VARIABLES RELATED TO COMMUNITY COLLEGE ATTENDANCE

This study investigated a set of variables – designated by marketing researchers as psychographic – and their relationship to non‐residential college students' concerns centering around commuting to class. A fourteen item instrument was developed and responded to by 425 students. A factor analysis revealed four factors and the dominant factor was comprised of items such as car security, parking, physical security and traffic. Other factors such as education quality items (i.e, library, faculty) accounted for a small percentage of the variance. A discriminant function analysis of the psycho‐graphic variables compared with six student time‐distance groups did not find differences among the groups by various class attendance times and commuting distances. Research limitations and future research directions are offered.     

TCIQ: An identification by intensity and frequency of “potent” testing cues in science

Everyone experiences some anxiety while taking an examination. High-test-anxious (HTA) and low-test-anxious (LTA) students are described by two characteristic differences: frequency and intensity of anxious responses and attentional direction to testing cues. The purposes of this study were threefold: (1) to report “potent” testing cues (i.e., 90% response agreement for both intensity and frequency) that were identified by HTA and LTA students; (2) to report differences between HTA and LTA students for frequencies and intensities of responses to testing cues; and (3) to report differences between HTA and LTA students of attentional direction to testing cues. A pool of 396 males and females who were enrolled in physical geology completed the State-Trait Anxiety Inventory. A random sample consisting of 93 HTA and 40 LTA subjects completed the Test Cues Identification Questionnaire (TCIQ). The TCIQ consists of 28 disruptive items and 27 helpful items. Subjects responded with both frequency and intensity ratings for all of the 55 items in the TCIQ. Results revealed that 22 items were viewed by subjects as “potent” testing cues. Empirical evidence obtained did not support previous theoretical reports of differences between HTA and LTA students for either frequency and intensity of anxious responses or attentional direction to the set of disruptive and helpful testing cues. Although test anxiousness did not appear to be associated with those two characteristics differences, a discriminant analysis revealed 24 items in the TCIQ which significantly, χ² (24) = 47.59, p < 0.004, separated HTA and LTA subjects responses. Apparently, HTA and LTA students differ in their responses to specific disruptive and helpful cues but not in their responses to the set of testing cues as was previously postulated.     

Using Focus Groups,Expert Advice,and Cognitive Interviews to Establish the Validity of a College Student Survey

This study focused on how the design of a national student survey instrument was informed and improved through the combined use of student focus groups, cognitive interviews, and expert survey design advice. We were specifically interested in determining (a) how students interpret the items and response options, (b) the frequency of behaviors or activities associated with the response options, (c) if the items are clearly worded and specific enough to produce reliable and valid results, and (d) if the items and response categories accurately represent students' behaviors and perceptions. We collected focus group data from 8 colleges and universities as part of a nationally funded research project on student engagement. The findings provide additional insight into the importance of using focus groups and cognitive interviews to learn how students interpret various items and what different responses really mean.     

ISPCAN Child Abuse Screening Tools Retrospective version (ICAST-R): Delphi study and field testing in seven countries

ObjectivesTo gain consensus among an ethnically and linguistically diverse group of international child protection experts on the structure and content of a new survey tool for retrospective measurement of child abuse, and to determine the performance of the instrument through an international field trial with young adults.MethodsThe questionnaire was developed through focus group discussions with international experts, and then subjected to a Delphi study in two waves to determine the perceived importance and translatability of items. The resultant questionnaire was translated into six languages and field tested in seven countries with convenient samples of young adults aged 18–26 years (N = 842).ResultsChild maltreatment experts from 28 countries provided input to questionnaire development. Satisfactory agreement on draft item inclusion and exclusion and the translatability of items was gained. The tool includes 15 primary questions about potentially abusive physical, sexual and emotional events, with follow-up questions about perpetrator characteristics, frequency of acts and periods in childhood when the recalled abuse occurred. The field test revealed lifetime prevalence per item usually exceeded 10% (11/15 items; range 2.1–49.5%). Internal consistency (Cronbach's alpha) was moderate to high for each of three item sub-sets (between .61 and .82) and the rates of missing data were low (less than 1.5% for 14 of 15 items). The great majority of respondents nominated either peer and/or adult perpetrators (between 82.3% and 98.2% depending upon the item), and among these, child/adolescent peers and non-family adults (including teachers for emotional and physical acts) were nominated often.ConclusionsThe ICAST-R is based on consensus from international experts, translates clearly and has satisfactory properties for adoption as a survey tool to estimate prevalence and describe perpetrators and other contextual aspects of child abuse.Practice implicationsThis tool can be utilized in a broad range of cultures and languages and may contribute to improved research practice. Although the core items are limited to just 15 acts of maltreatment, if these behaviorally specific questions are adopted as key indicators and incorporated into comprehensive local, national or regional surveys, eventually there should be greater comparability in survey estimates.     

Noncognitive Variables and Student Learning in Extended Opportunity Programs and Services (EOPS)

ABSTRACT

The purpose of this mixed methods study was to investigate the relationship between participation in Extended Opportunity Programs and Services (EOPS) at California Valley College (CVC) (one of the 113 California Community Colleges in California) and several measures of student learning. An embedded survey design was developed using William Sedlacek’s noncognitive questionnaire (NCQ), items from the Community College Survey of Student Engagement (CCSSE), items based on Marcia Baxter Magolda’s epistemological reflection model of cognitive complexity, and items based on student learning outcomes for learning in EOPS. The survey had a 43.7% response rate. Students’ demographic characteristics, progress data, and grades were also collected. The survey concluded with four open-ended questions examining students’ perceptions about their learning. GPA (grade point average) as an outcome measure, and several NCQ scales were positively correlated with the Learning in EOPS Scale. Qualitative and mixed methods analyses extended statistical findings, highlighting the importance of positive outlook, positive self-concept, realistic self-appraisal, and support for learning. Finally, the study found that students’ academic and social involvement played a noteworthy role in students’ development, especially as related to cognitive complexity and learning in EOPS.