Learning to mark: exemplars,dialogue and participation in assessment communities

The problems of shifting from norm-referenced assessment to criterion-referenced assessment have been identified by several scholars in recent years. These important critiques touch on a number of areas, but neglect a key question about how assessors learn to accomplish what Shay calls a ‘socially situated interpretive act'. Research that does exist tends to focus on salaried, full-time academics. This overlooks the heterogeneity of the academic labour force in higher education and the substantial contribution made by contract (hourly-paid) lecturers, particularly in applied disciplines such as Business and Management. This study explores how nine newcomers to a UK Business School – including salaried and contract staff – attempt to understand local assessment practice. We use a situated learning lens to analyse their diary entries and interviews about their experiences of learning to mark. Drawing on scholars such as Sadler, we examine the suggestion that exemplars are important for newcomers coming to understand local assessment practice. We argue for the fundamental importance of dialogue about exemplars and other aspects of practice, both to develop inter-subject understandings of assessment ‘anchor points' and also to foster among newcomers (and especially contract lecturers) a greater sense of participating in, and being valued by, the local assessment community.     

Best entry points for structured document retrieval—Part II: Types,usage and effectiveness

Structured document retrieval makes use of document components as the basis of the retrieval process, rather than complete documents. The inherent relationships between these components make it vital to support users’ natural browsing behaviour in order to offer effective and efficient access to structured documents. This paper examines the concept of best entry points, which are document components from which the user can browse to obtain optimal access to relevant document components. It investigates at the types of best entry points in structured document retrieval, and their usage and effectiveness in real information search tasks.     

Beginning and end of the internship: student teachers’ interpersonal profiles and the accuracy of their self-beliefs

An important purpose of internships in teacher preparation programmes is to develop competence through experience. The research questions in the present study concern student teachers’ interpersonal profiles (i.e. patterns of their interpersonal behaviour as perceived by students) and the accuracy of their self-belief regarding the interpersonal relationship with students at the beginning and end of the internship. Participants were student teachers (n=34) of a one-year teacher education programme. There were fewer student teachers with preferable interpersonal profiles at the end of the internship than in the beginning. Self-beliefs at the beginning indicated that the majority of student teachers were underestimating themselves; at the end of the internship most of them were overestimating themselves. About two-thirds had more accurate self-beliefs at the end of the internship than at the beginning. Overestimating oneself seemed negatively related to more accurate self-beliefs at the end of the internship and student teachers with more preferable profiles had more accurate self-beliefs.     

Developing Service Area Indices for Community Colleges: California's Method and Experience

The economic, educational and social environments of the students served by a community college are important factors in college performance accountability, policy analysis, program evaluation, and strategic planning. For example, previous research shows that income per county is a significant predictor of transfer rates for community colleges. However, conditions for the actual geographic area of the students served by a community college may differ, for various reasons, from the economic conditions for the county in which the college is located. This article describes the development of institutional or college-level indices as an enhancement to county-level data, their use as adjustment variables for California's Accountability Reporting for the Community Colleges (ARCC), and their applicability to other research and planning studies. The service area indices are created by combining the enrollment patterns of students by ZIP Code of residence with ZCTA (ZIP Code Tabulation Area) level economic and educational data from Census 2000.     

BE COOL! a digital learning environment to challenge and socially include gifted learners

Educational technology research and development - This paper describes the development of the BE COOL! learning environment that gives all children, gifted and non-gifted, the opportunity to learn...     

Latent Markov Factor Analysis for Exploring Measurement Model Changes in Time-Intensive Longitudinal Studies

When time-intensive longitudinal data are used to study daily-life dynamics of psychological constructs (e.g., well-being) within persons over time (e.g., by means of experience sampling methodology), the measurement model (MM)—indicating which constructs are measured by which items—can be affected by time- or situation-specific artifacts (e.g., response styles and altered item interpretation). If not captured, these changes might lead to invalid inferences about the constructs. Existing methodology can only test for a priori hypotheses on MM changes, which are often absent or incomplete. Therefore, we present the exploratory method “latent Markov factor analysis” (LMFA), wherein a latent Markov chain captures MM changes by clustering observations per subject into a few states. Specifically, each state gathers validly comparable observations, and state-specific factor analyses reveal what the MMs look like. LMFA performs well in recovering parameters under a wide range of simulated conditions, and its empirical value is illustrated with an example.     

Psychometric defensibility of the Intervention Selection Profile‐Social Skills (ISP‐SS) with students at risk for behavioral concerns

The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP‐SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants ( n = 71) rated each of these students using both the ISP‐SS and the Social Skills Improvement System—Rating Scales (SSiS‐RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP‐SS structural validity, indicating ISP‐SS items broadly conformed to a single “Social Skills” factor. Follow‐up analyses suggested ISP‐SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP‐SS items, finding each ISP‐SS item to be moderately or highly related to its corresponding SSiS‐RS subscale. Finally, analyses indicated three of the seven ISP‐SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP‐SS is to be appropriate for use in schools. Implications for practice and future research are discussed.     

Do universal social and emotional learning programs for secondary school students enhance the competencies they address? A systematic review

While universal school‐based social and emotional learning (SEL) programs claim to target various SEL competencies, earlier reviews have not provided a clear overview of the competencies in question. We therefore wished to identify the competencies targeted in SEL programs for secondary school students. We also aimed to examine the effects of these programs on SEL competencies and psychosocial health. The specific SEL competencies directly addressed in the programs' primary learning targets were identified based on the Collaborative for Academic, Social and Emotional Learning (CASEL) framework for SEL. Five bibliographic databases (PubMed, PsychINFO, Education Resources Information Center (ERIC), Applied Science Premier (ASP), and Web of Science) were searched for relevant research papers published between 2014 and 2018. We included 40 studies that investigated 32 programs focusing on two or more SEL competencies. While most programs targeted four or five of the SEL competencies, many of the included studies did not measure the programs' effects on all the competencies targeted. Our results showed that the SEL programs had substantial effects on the SEL competencies they addressed and on psychosocial health. Although the programs focused predominantly on self‐management skills and relationship skills, the largest summary effects were found for self‐awareness and social awareness.     

Resilience in higher education students: a scoping review

ABSTRACT

The health, wellbeing and employability of university students are key considerations within higher education. In response, interest in student resilience is on the rise. Reviews of contemporary resilience literature highlight both conceptual and methodological weaknesses, issues which hamper attempts to design effective resilience interventions. To inform the design of a student resilience program, to be piloted at three Australian universities, a scoping review of resilience specific to the higher education context was undertaken. Searches of three electronic databases (PsychINFO, CINAHL and ProQuest) were conducted. Seventy-two peer-reviewed articles published between 2007 and 2017 were included in the review. While the review reaffirms the conceptual and methodological issues found in previous resilience research, it provides a useful critique of key issues in relation to university student resilience and interventions to enhance students’ resilience. Recommendations for educators and researchers are provided.     

The similarity of siblings' attachments to their mother

Do siblings develop similar attachment relationships with their mother? Attachment theory suggests that brothers and sisters growing up in the same family are likely to relate in similar ways to their parents, at least when parental attachment representations and interactive styles remain stable across time. In the current study, sibling attachment data from three research groups (from Pennsylvania State University, Leiden University, and the University of Western Ontario) have been pooled to assemble a sufficiently large sample of observations (N = 138 sibling pairs) for a detailed comparison of sibling attachment relationships. Spacing between the births, differences in maternal sensitivity, and gender of siblings were examined as possible sources of concordance of nonconcordance. Attachment security (including disorganized attachment) of each sibling was assessed with the Strange Situation procedure between 12 and 14 months after birth. Maternal sensitivity was observed with the same rating scale in a laboratory play session in one of the studies and in home observations in the others. Sibling relationships were found to be significantly concordant when classified as secure/nonsecure (62% concordance, p < .01, 1-tailed, intraclass correlation = .23) but not when further subcategorized. Maternal insensitivity to both siblings (shared environment) was associated with concordance of sibling nonsecurity. Siblings of the same gender were more likely to form concordant relationships with their mother (68%; p < .01, 1-tailed, intraclass correlation = .37) than those of opposite gender. Same-sex sibling concordance was comparable to the concordance found for monozygotic twins in earlier studies. Genetic factors may, therefore, play a relatively small role in the development of attachment.