Replication crisis or an opportunity to improve scientific production?

Science is undergoing a crisis that has been referred to, since the early 21st century, as a crisis of confidence and a crisis of replication. This article reviews questions pertaining to the replication crisis; questions addressing the quality and credibility of the sciences; specifically, questions linked to what are known as false positives, null results, and questionable research practices (p-hacking, harking, cherry-picking). As an outcome of our review and analysis, a set of recommendations to strengthen the elaboration of reliable and valid research studies is provided. Changes are needed in order to foment meta-research, open science practices and replication studies; notably, changes are needed in the instruction of research methods; in the use and interpretation of statistical data, as well as in research culture in general. We conclude that the replication crisis presents an opportunity to improve research practices and the quality of scientific production in all fields of research, including research in education.     

Validating the multimedia activity recall for children and adolescents in a large New Zealand sample

Abstract

The aim of the study was to validate the self-report Multimedia Activity Recall for Children and Adolescents (MARCA) against accelerometry for the assessment of physical activity in New Zealand children. Participants (n = 716, 10–18 years) recalled 3–4 days of activity using the MARCA and underwent a partially overlapping 7-day accelerometry protocol during a national survey. Spearman correlation coefficients (ρ) assessed the association between accelerometer-derived counts per minute and MARCA-derived physical activity level and time in locomotion. Both data sources estimated time spent in light and moderate–vigorous physical activity. Association and agreement between methods for light physical activity and moderate–vigorous physical activity was assessed using correlations and Bland–Altman plots respectively, and paired t-tests conducted. Accelerometer-derived activity counts were moderately correlated with both MARCA-derived physical activity level and locomotion (ρ = 0.38, P < 0.0001). The correlation between methods was –0.14 for light physical activity and 0.28 for moderate–vigorous physical activity (P < 0.0001). The MARCA overestimated moderate–vigorous physical activity compared with accelerometry (120 min, P < 0.0001), which increased as moderate–vigorous physical activity time increased. Some sex and ethnicity (Māori [indigenous] versus non-Māori) differences were observed. Overall, the MARCA indicated moderate validity for assessment of physical activity level, locomotion and moderate–vigorous physical activity and poor validity for assessment of light physical activity. This was comparable to other self-report tools. The MARCA has utility for future large-scale research.     

Are student exchange programs worth it?

The number of university students participating in exchange programs has risen sharply over the last decade. A survey of Swiss university graduates (classes of 1999 and 2001) shows that participation in student exchange programs depends significantly on the socio-economic background of students. We further analyze whether the participants benefit from additional advantages caused by these exchange programs. Analyses show that student exchange programs are associated with higher starting salaries and a higher likelihood of opting for postgraduate degrees. Analyses using instrumental variable estimations (IV), however, show that these outcomes are not causally related to participation in exchange programs.      

Women's contributions to instructional technology journals

Eleven leading instructional technology journals were examined to determine the percentage of articles written by women during a five-year period, 1988–1992. In addition, where women were either first or second author, the articles were analyzed to identify their main topic and categorized based on the categories used by Ely (1992) in determining the trends of the field. Results of this study indicate that the percentage of women publishing in journals in instructional technology showed no indication of consistency or trends of increase or decrease over the five-year period and averaged 34%, with an annual mean ranging from 27% to 54%. Content analysis revealed that women's publications in instructional technology journals were primarily of a technological nature in educational contexts.     

Multinationality, foreignness and institutional distance in the relation between R&D and productivity

This paper empirically examines to what extent being foreign and part of a multinational affects the endogenous relation between R&D and productivity. Our findings indicate that multinationals obtain in general higher R&D returns. Also, there is a negative foreignness effect in that domestic-owned multinationals outperform foreign subsidiaries. However, these effects are somehow moderated by the institutional distance between the home and host countries. These results, obtained for a panel of UK firms, are largely consistent with a set of hypotheses derived from the institutional and international business theories.     

Influences on intercultural relations: Counseling implications for American adolescents in Germany

A comparison of the relative importance of variables shown to influence the outcome of interracial contact was made in an intercultural contact situation. Implications of the findings for counseling applications were discussed. The variables studied were: amount of contact, length of time living in the country, norms, personal association, initial attitudes toward the country (expectations and first impressions), and attitudes toward people in general. The subjects were 199 American adolescents living in Germany and enrolled in on-base American schools for military dependents. The data were collected by questionnaires administered by faculty members at the schools during regular class time. Attitudes toward Germans, attitudes toward Germany and social distance toward German adolescents were utilized as the dependant variables. The analyses controlled for past intercultural experience and the age, sex, and ethnic group of the subjects. Three variables affected subjects' attitudes toward Germany: norms, first impressions, and sex of subject. The same three variables plus attitudes toward people affected attitudes toward Germans. Three different variables affected the social distance scale: age, sex, and expectations. Age and sex were control variables and appear to be artifacts of the particular social climate of the situation under study. Thus, norms, first impressions, expectations, and attitudes toward people appear to be the major influences on attitudes toward members of another culture. Amount of contact, length of time living in the country and personal association do not appear to be important in intercultural interaction. Suggestions were made for the preparation of educational programs and for family, group and individual counseling for families with adolescents who are transferred to new cultural environments.     

Early Childhood Education and Public School Principals: Constructing a Relationship

This article discusses the results of a statewide study of elementary school principals' perceptions of barriers to the establishment of preschool programs in the public school setting. The study was conducted in response to current federal an: state mandates requiring school districts to provide comprehensive services for developmentally delayed and at-risk preschoolers, as well as other preschool populations. A representative sample of principals responded to a comprehensive questionnaire that included principals' knowledge of child development and their attitudes about establishing programs for preschool children in the public school sector. Results indicate that, across the board, elementary principals foresee major barriers to the effective implementation of such federal mandates as Public Law 99-457. Specific barriers are identified and discussed. Implications for practice and policy are presented.     

Drop-outs from Swiss Universities: an empirical analysis of data on all students between 1975 and 2008

This study presents in-depth empirical analyses of drop-outs from all Swiss universities for the entire student population between 1975 and 2008. The results show that most identifiable factors associated with a greater or lesser probability of dropping out are identical to those found in a recent Systematic Review (Larsen et al., 2013). The main findings are that: first, since the 1970s, there has been a marked trend towards falling drop-out rates which is largely due to female students who, today, have lower drop-out rates than their male counterparts; secondly, not only are there different drop-out rates for specific subjects of study, but there are also differences in baccalaureate profiles, which indicates that the skills acquired prior to entering university have a great impact on successful study; thirdly, students who change their first subject choice are at great risk of dropping out. No firm conclusions can yet be drawn about the Bologna reform but, based on the subjects which changed to the Bachelor/Master system between 2001 and 2003, no reduction in drop-out rates can be found as a result of the reform.