THE ROLE OF RELIABILITY IN CRITERION-REFERENCED TESTS

In discussion of the properties of criterion-referenced tests, it is often assumed that traditional reliability indices, particularly those based on internal consistency, are not relevant. However, if the measurement errors involved in using an individual's observed score on a criterion-referenced test to estimate his or her universe scores on a domain of items are compared to errors of an a priori procedure that assigns the same universe score (the mean observed test score) to all persons, the test-based procedure is found to improve the accuracy of universe score estimates only if the test reliability is above 0.5. This suggests that criterion-referenced tests with low reliabilities generally will have limited use in estimating universe scores on domains of items.     

Mothers' Perspectives of the Peer-Related Social Development of Young Children with Developmental Delays and Communication Disorders

Mothers' perspectives of children's peer-related social development were obtained from matched groups of young children with developmental delays, communicative disorders, and typically developing children. Structured interviews elicited information on numerous issues including mothers' views of the importance of children's social skills development, rationales with respect to why children succeed or had difficulties on specific social tasks, and the socialization strategies mothers employ to promote children's peer-related social development. Mothers also reported on their efforts to arrange play with peers for their child and the degree to which they monitored that play. Results indicated that mothers rated children's social development as highly important, offered primarily internal rationales (e.g., traits, dispositions) for success or difficulties in achieving social tasks, and endorsed moderate and low power socialization strategies. Differences across the three groups were minimal. Mothers arranged play with peers least often for children with developmental delays and communication disorders, but monitored play more extensively for children with delays. These finding were discussed in terms of mothers adopting a developmental orientation to understand children's social development and their implications for maternal participation in peer competence intervention programs.     

Students’ perceptions of the academic environment and approaches to studying in British postgraduate business education

Recent research on student learning in higher education has identified clear associations between variations in students’ perceptions of the academic environment and variations in their study behaviour. This study investigated a general theoretical model linking students’ demographic characteristics, perceptions and study behaviour with measures of outcome, and in particular, compared three accounts of the causal relationship between perceptions and study behaviour. Data were obtained from 469 postgraduate students at six British business schools. Path analysis was used to assess the causal relationships among the students’ age and gender, their scores on the Course Experience Questionnaire, their scores on the Revised Approaches to Studying Inventory and their ratings of general satisfaction with their programmes. This yielded evidence for the causal efficacy of most of the paths identified in the general theoretical model. In particular, as in the case of students taking more traditional academic subjects, there exists a bidirectional causal relationship between variations in students’ perceptions of the academic environment and variations in their study behaviour.     

The Future of Student Self-Assessment: a Review of Known Unknowns and Potential Directions

Educational Psychology Review - This paper reviews current known issues in student self-assessment (SSA) and identifies five topics that need further research: (1) SSA typologies, (2) accuracy, (3)...     

Making sense of learner and learning Big Data: reviewing five years of Data Wrangling at the Open University UK

Most distance learning institutions collect vast amounts of learning data. Making sense of this ‘Big Data’ can be a challenge, in particular when data are stored at different data warehouses and require advanced statistical skills to interpret complex patterns of data. As a leading institute on learning analytics, the Open University UK instigated in 2012 a Data Wrangling initiative. This provided every Faculty with a dedicated academic with expertise data analysis and whose task is to provide strategic, pedagogical and sense-making advice to staff and senior management. Given substantial changes within the OU (e.g. new Faculty structure, real-time dashboards, two large-scale adoptions of predictive analytics approaches, increased reliance on analytics), this embedded case study provides an in-depth review of lessons learned of five years of data wrangling. We will elaborate on the design of the new structure, its strengths and potential weaknesses, and affordances to be adopted by other institutions.