Bias Corrections for Standardized Effect Size Estimates Used With Single-Subject Experimental Designs

A multilevel meta-analysis can combine the results of several single-subject experimental design studies. However, the estimated effects are biased if the effect sizes are standardized and the number of measurement occasions is small. In this study, the authors investigated 4 approaches to correct for this bias. First, the standardized effect sizes are adjusted using Hedges’ small sample bias correction. Next, the within-subject standard deviation is estimated by a 2-level model per study or by using a regression model with the subjects identified using dummy predictor variables. The effect sizes are corrected using an iterative raw data parametric bootstrap procedure. The results indicate that the first and last approach succeed in reducing the bias of the fixed effects estimates. Given the difference in complexity, we recommend the first approach.     

The use of keywords for delivering immediate performance feedback on teacher competence development

Literature shows that feedback that is specific, immediate and goal-oriented is effective on (pre-service) teachers’ performance. Synchronous coaching gives this kind of feedback. Due to immediateness of feedback, pre-service teachers can suffer from cognitive load. We propose a set of standardised keywords through which this performance feedback can be delivered – each keyword acts as a summary for the feedback message. The construction and the selection of the keywords is aimed at the reduction of message ambiguity, while at the same time a low level of cognitive load on the pre-service teacher must be maintained. An in vivo pilot-study with 40 respondents (pre-service teachers and their coaches) supported our hypothesis that usage of such sets of standardised keywords will mitigate the levels of ambiguity and cognitive load. These findings and other considerations for additional research using immediate performance are addressed.     

Development of an engineering identity in the engineering curriculum in Dutch higher education: an exploratory study from the teaching staff perspective

How do engineering students develop a professional identity during the course of the curriculum? What are the development mechanisms and important conditions? In an exploratory study among teachers the authors tried to find out whether the development of engineering identity can be understood by using the theoretical models of Ibarra and Sullivan. The results showed that the development of engineering identity is boosted during the internship in industry in the third year. Furthermore, the theoretical models could be recognised in the findings and four interaction types in internships, with significant differences in effect on identity development, could be identified if two dimensions were used: (1) industry supervisors’ perception of students; (2) the professional responsibility awarded. Some recommendations for curriculum improvement could be made; for example, introducing projects into the curriculum to stimulate identity development from the start. Further research is required on students’ preparation for internships.     

Different pathways towards dropout: the role of engagement in early school leaving

In this study, we examine the development of student engagement in relation to dropout. We focus on different growth trajectories of engagement between groups of students and on whether these trajectories lead to differences in the survival of the student. The development of behavioural and emotional engagement of 4063 graduates and 541 (11.7%) dropouts is examined from Year 7 to Year 12 and this development is linked to the probability of dropping out in each grade by means of a discrete-time survival mixture model. For emotional engagement, results point to a model with two different subgroups: one group starting at a high level of engagement and following a (relatively) stable pattern and the other group starting at a lower level of engagement and following a decreasing trend. For behavioural engagement, the results indicate that a three-class model showed the best fit: a high and (relatively) stable group, a high and decreasing group and a low and stable group. In terms of dropout, the unstable and low groups demonstrate a significantly higher probability of dropping out, as evidenced in the steep, declining survival curves. Different background variables are included to gain more insight into engagement and dropout, and to predict membership in the low and decreasing class.     

On strategies of educational innovation: Between substitution and transformation

The innovation of education seems to beself-evident. Boosted by a wide range of newtechnologies, educational institutes all overthe world are innovating their educationalsystems, in order to extend their services, toimprove their performances or to reduce costs.The apparent self-evidence of educationalinnovation hardly prompts the educational staffto reflect on the very idea of innovation andits consequences. This paper treats the basicprinciples that support the phenomenon oftechnology-induced educational innovation. Itaims to contribute to a better insight andunderstanding of its implications to anyoneengaged in education. It also aims to effect agrowing awareness of the premises on technologyand to support the right attitude to realiseimprovements in practice. The paper goes intostrategies of change, while discussing bothsubstitutional and transformational strategies.It explains its supposed differences byreferring to the philosophical frameworks ofJaspers, Heidegger and Borgmann. Starting fromBorgmann's ``devices paradigm', four principlesfor educational innovations are formulated,referring to the transparency and interactivityof educational technologies, the socio-culturalsignificance of products, the importance ofvalues beyond efficiency and the political biasinvolved with technological innovation.     

Reading Comprehension of Dutch Deaf Children

In this study, the reading comprehension of deaf children and adolescents in the Netherlands is examined along with their word identification. The reading comprehension of 464 deaf students and the word identification of 504 deaf students between 6 and 20 years of age was examined. The results show the reading comprehension scores of deaf children to be far below the scores of hearing children. On average, the deaf subjects scored at a level equivalent to a hearing child in the first grade. The word identification scores of the deaf children, however, were almost equivalent to the scores of hearing children. Although reading comprehension and word identification appear to be related, this relation does not completely explain the comprehension difficulties encountered by deaf children. Additional factors are required to explain deaf children’s difficulties with reading comprehension.     

Communication skills training exploiting multimodal emotion recognition

The teaching of communication skills is a labour-intensive task because of the detailed feedback that should be given to learners during their prolonged practice. This study investigates to what extent our FILTWAM facial and vocal emotion recognition software can be used for improving a serious game (the Communication Advisor) that delivers a web-based training of communication skills. A test group of 25 participants played the game wherein they were requested to mimic specific facial and vocal emotions. Half of the assignments included direct feedback and the other half included no feedback. It was investigated whether feedback on the mimicked emotions would lead to better learning. The results suggest the facial performance growth was found to be positive, particularly significant in the feedback condition. The vocal performance growth was significant in both conditions. The results are a significant indication that the automated feedback from the software improves learners’ communication performances.     

Beyond additive and multiplicative reasoning abilities: how preference enters the picture

While previous studies mainly focused on children’s additive and multiplicative reasoning abilities, we studied third to sixth graders’ preference for additive or multiplicative relations. This was investigated by means of schematic problems that were open to both types of relations, namely arrow schemes containing three given numbers and a fourth missing one. In study 1, children had to fill out the missing number, while in study 2, children had to indicate all possibly correct answers among a set of given alternatives. Both studies explicitly showed the existence of a preference for additive relations in some children, while others preferred multiplicative relations. Mainly younger children preferred additive relations, whereas mainly children in upper primary education preferred multiplicative relations. Number ratios also impacted children’s preference, especially in fifth grade. Moreover, the results of study 2 provided evidence for the strength of children’s preference and showed that calculation skills do not coincide with preference, and hence, that preference and calculation skills are two distinct child characteristics. The results of both studies using these open problems resembled previous research results using classical multiplicative or additive word problems. This supports the hypothesis that children’s preferred type of relations may be at play in solving classical word problems as well—besides their abilities—and may hence be an additional factor explaining the mistakes that children make in those word problems. This research line thus seems promising for further research as well as educational practice.     

Identity Processes and Parent–Child and Sibling Relationships in Adolescence: A Five‐Wave Multi‐Informant Longitudinal Study

The purpose of this study was to examine reciprocal associations between identity processes (commitment, in‐depth exploration, and reconsideration of commitment) and dimensions (support, negative interaction, and power) of maternal, paternal, and sibling relationships. A total of 497 Dutch families including 14‐years‐old adolescents (56.9% males), their fathers, mothers, and siblings, for a total of 1,988 respondents, participated in a five‐wave longitudinal study. Cross‐lagged analyses indicated that commitment and in‐depth exploration predicted improvements in family relationships (unidirectional effects), whereas reconsideration of commitment was predicted by low levels of maternal support and worsened the quality of the paternal relationship (reciprocal effects). These results were not moderated by adolescents' gender and sibling characteristics. Theoretical and practical implications are discussed.