Note on Sources of Sampling Variability in Science Performance Assessments

In 1993, we reported in Journal of Educational Measurement that task-sampling variability was the Achilles' heel of science performance assessment. To reduce measurement error, tasks needed to be stratified before sampling, sampled in large number, or possibly both. However, Cronbach, Linn, Brennan, & Haertel (1997) pointed out that a task-sampling interpretation of a large person x task variance component might be incorrect. Task and occasion sampling are confounded because tasks are typically given on only a single occasion. The person x task source of measurement error is then confounded with the pt x occasion source. If pto variability accounts for a substantial part of the commonly observed pt interaction, stratifying tasks into homogenous subsets—a cost-effective way of addressing task sampling variability—might not increase accuracy. Stratification would not address the pro source of error. Another conclusion reported in JEM was that only direct observation (DO) and notebook (NB) methods of collecting performance assessment data were exchangeable; computer simulation, short-answer, and multiple-choice methods were not. However, if Cronbach et al. were right, our exchangeability conclusion might be incorrect. After re-examining and re-analyzing data, we found support for Conbach et al. We concluded that large task-sampling variability was due to both the person x task interaction and person x task x occasion interaction. Moreover, we found that direct observation, notebook and computer simulation methods were equally exchangeable, but their exchangeability was limited by the volatility of student performances across tasks and occasions.     

Individual differences in school mathematics performance and feelings of difficulty: The effects of cognitive ability, affect, age, and gender

The aim of the study was to identify possible individual differences effects on school mathematics performance and feelings of difficulty (FOD). Cognitive ability (general and domain-specific), affect (anxiety and achievement need), age, and gender were considered the main sources of individual differences. The effect of the testing experience (i.e., the repeated exposure to the testing situation) was also taken into account. Two hundred forty three subjects, of both genders, from 13 to 15 years of age were tested with three task batteries: the cognitive ability, the affective battery and the school mathematics battery. Ratings of the difficulty of each of the mathematics items were also collected. A second testing of the affective battery, mathematical tasks and FOD was effected one year after the first. A series of path analyses and ANOVAs were performed on the data. It was found that ability directly influenced performance whereas both ability and affect influenced FOD. Feelings of difficulty were also influenced by performance. Age differentiated FOD only at the 2nd testing. Gender interacted with both person and task characteristics and had an effect on FOD but not on performance.     

Physiological responses in different intensities of resistance exercise – Critical load and the effects of aging process

Aim was to identify critical load (CL) in young and elderly apparently healthy male cohorts. To contrast the metabolic, cardiovascular and perceptual responses on CL according to age. We evaluated 12 young (23 ± 3 years) and 10 elderly (70 ± 2 years) apparently healthy active males, who underwent: (1) 1 repetition maximum (1RM) test on a 45° Leg Press; (2) on different days, three high-intensity resistance exercise constant load tests (60%, 75% and 90% 1RM) until fatigue (Tlim). Absolute values of both the CL asymptote and curvature constant (kg) were significantly lower in elderly subjects (P < 0.05). In contrast, elderly subjects demonstrated a significantly higher number of repetitions at CL when compared with young subjects (P < 0.05). As expected, oxygen uptake (VO₂) and heart rate (HR) during maximal aerobic exercise testing were significantly reduced in older subjects. However, percent-predicted aerobic capacity were higher in older subjects (P < 0.05). In addition, blood lactate ([La^?]) corrected to Tlim and rating of perceived exertion values were greater in younger subjects at all intensities (P < 0.05). These findings, despite reduced force production in older subjects, endurance-related parameters are well preserved according to age-adjusted percent-predicted values in apparently healthy males.     

Evaluation and publication delay in Ibero-American scientific journals

This article analyses the review, acceptance and publication dates of a sample of 21,890 articles from 326 Ibero-American scientific journals from all subject areas and countries included in the Latindex Catalogue 2.0 and published between 2018 and 2020 (freely available as an open access dataset). The aim is to discover evaluation and publication times. The evaluation process takes a median of 110 days, the publication process, a median of 82 days, and the whole process, a median of 224 days. Statistical differences are found according to periodicity, subject areas, countries, existence of a printed version and article type (Call for Papers or General articles). From the data we find that the delay in publication is longer than publishers themselves report to the DOAJ. STEM areas present the most similarity in publication patterns, having a higher number of evaluation days (Ed) than publication days (Pd); Arts and Humanities present the opposite pattern, with a higher Pd than Ed. In the case of Social Sciences, the times are similar. General articles and Call for Papers articles differ in terms of Ed, but not Pd, indicating that Call for Papers revisions are faster.     

Who talks how to their kids about TV: A clarification of demographic correlates of parental mediation patterns

A random telephone survey (N = 255) of Washington state parents of children between the ages of 2 and 17 assesses parents’ reported patterns of interaction with their children regarding television, along with parental viewing habits and perceptions of television content. Demographic differences in mediation and coviewing patterns, as well as parental attitudes toward television, are explored, and explanations for these differences are considered. It is concluded that education is a weak predictor of mediation levels, single parents do not differ from dual parents in attitudes about television, and that the negative relationship of income to positive mediation and use of television as a babysitter is related more to overall viewing patterns and environmental constraints, rather than to attitudinal differences. It is suggested that demographics hold little value jar explaining why and how parents hold particular attitudes or engage in particular behaviors relevant to television and parenting.     

Are you a budding academic writer?

Academic writing can seem a daunting prospect although with the right support and information it can be more achievable than you think. In this first set of editorial comments of 2016, editors from all sections of the Health Information and Libraries Journal outline the origins of the individual section of the journal which they oversee and highlight some of the things you might want to consider when thinking of submitting your writing for publication.     

Big Data – What is it and why it matters

Big data, like MOOCs, altmetrics and open access, is a term that has been commonplace in the library community for some time yet, despite its prevalence, many in the library and information sector remain unsure of the relationship between big data and their roles. This editorial explores what big data could mean for the day‐to‐day practice of health library and information workers, presenting examples of big data in action, considering the ethics of accessing big data sets and the potential for new roles for library and information workers.