In search of the reliability of a Flemish version of the Knowledge Monitoring Assessment Test

Metacognitive skills are widely recognized as an important moderating variable for learning. Many studies have shown that these skills affect students’ learning results. Tobias and Everson (2000) argue that metacognitive skills cannot be effectively applied in absence of accurate knowledge monitoring. Consequently, they constructed a knowledge monitoring assessment test, which is claimed to be a valid test to measure students' knowledge monitoring capacity. In this contribution the reliability of a Flemish version of the KMA test is studied. Two studies are reported on, one with secondary education students and one with freshmen university students. In both studies split half method and Kuder Richardson 20 were used to calculate the internal consistency as a measurement of reliability. Because none of the results showed a good reliability it is suggested that additional efforts are needed to elaborate a reliable instrument.     

Research into the construction of mathematical texts

Investigations of the actual reading process and of the structure of a mathematical text are important for elaborating didactical methods for teaching reading a mathematical text. The article reports on a broader project concerning the structure of a mathematical text. The structure of several hundred texts has been analyzed. Academic textbooks and mathematical monographs (especially in Polish) written by mathematicians have been used as a source. Characteristic features of proof construction, that may influence the course of the reading process, have been isolated. For instance, transmission means have been investigated such as text segmentation which uses delimiters and so called procedure schemes.     

Eye-tracking verification of the strategy used to analyse algorithms expressed in a flowchart and pseudocode

The results of qualitative and quantitative investigations conducted with individuals who learned algorithms in school are presented in this article. In these investigations, eye-tracking technology was used to follow the process of solving algorithmic problems. The algorithmic problems were presented in two comparable variants: in a pseudocode and flowchart. The eye-tracking data resulted in both qualitative (films registering the gaze paths) and quantitative measures, which allowed the detection and interpretation of the differences in the task-solving strategies between those who found the correct answer and those that did not. The results confirmed a hypothesis that use of the formal notation characteristic of a programming language for presenting algorithms is often a practical difficulty in the process of solving even simple tasks. This study opens a new direction of research; they show that eye-tracking technology can be used to optimise the educational process of learning programming.     

Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics

Electronic portfolios (E-portfolios) are crucial means for workplace-based assessment and feedback. Although E-portfolios provide a useful approach to view each learner’s progress, so far options for personalized feedback and potential data about a learner’s performances at the workplace often remain unexploited. This paper advocates that E-portfolios enhanced with learning analytics, might increase the quality and efficiency of workplace-based feedback and assessment in professional education. Based on a 5-phased iterative design approach, an existing E-portfolio environment was enhanced with learning analytics in professional education. First, information about crucial professional activities for professional domains and suited assessment instruments were collected (phase 1). Thereafter probabilistic student models were defined (phase 2). Next, personalized feedback and visualization of the personal development over time were developed (phase 3). Then the prototype of the E-portfolio—including the student models and feedback and visualization modules—were implemented in professional training-programs (phase 4). Last, evaluation cycles took place and 121 students and 30 supervisors from five institutes for professional education evaluated the perceived usefulness of the design (phase 5). It was concluded that E-portfolios with learning analytics were perceived to assist the development of students’ professional competencies and that the design is only successful when developed and implemented through the eyes of the users. Feedback and assessment methods based upon learning analytics can stimulate learning at the workplace in the long run. Practical, technological and ethical challenges are discussed.     

Effects of cooperation on spelling achievement at three age levels (Grades 2, 4, and 6)

In a field experiment among second, fourth and sixth grade pupils from 27 primary schools, two instruction methods were compared. At 13 schools (control condition) pupils did spelling exercises as usual, i.e. individually. At 14 schools pupils worked in pairs; each pupil was asked to check a partners’ work and discuss mistakes. At grade 2 cooperation led to less off-task behaviour when pupils did spelling assignments of a more complex type. Nevertheless we found a negative effect on achievement. At grade 4 cooperation led to less off-task behaviour for complex assignments and an increase in pupil’s effort as rated by their teachers as well. These findings were accompanied by a weak effect on achievement. Cooperation did not affect effort nor achievement of pupils from grade 6. At none of three grade levels we found indications of better reasoning strategies as a consequence of pair learning. The differential effect of cooperation at the three age levels may be explained in terms of complexity of learning subject and of lesson type.     

The Training of Headmasters: a Belgian (Flemish) Experiment

The article illustrates the development of Headmaster training in Flanders and the role of the University of Antwerp in that development. The analysis of needs is discussed, as is the strategy evolved to meet these needs. Not all problems have been solved, and the article reviews briefly some questions still to be asked.

L'article décrit le développement de la formation des directeurs d'école en Flandre, et aussi le rôle de l'Université d'Anvers dans ce processus. Il discute l'analyse des besoins ainsi que la stratégie qui a été développée pour répondre à ces besoins. Tous les problèmes n'ont pas été résolus et l'article soulève brièvement quelques questions qui se posent encore.     

Peer review: The experience and views of early career researchers

This paper presents selected findings from the first year of a 3‐year longitudinal study of early career researchers (ECRs), which sought to ascertain current and changing habits in scholarly communication. Specifically, the aims of the paper are to show: (1) how much experience and knowledge ECRs had of peer review – both as authors and as reviewers; (2) what they felt the benefits were and what suggestions they had for improvement; (3) what they thought of open peer review (OPR); and (4) who they felt should organize peer review. Data were obtained from 116 science and social science ECRs, most of whom had published and were subject to in‐depth interviews conducted face‐to‐face, via Skype, or over the telephone. An extensive literature review was also conducted to provide a context and supplementary data for the findings. The main findings were that: (1) most ECRS are well informed about peer review and generally like the experience, largely because of the learning experiences obtained; (2) they like blind double‐peer review, but would like some improvements, especially with regards to reviewer quality; (3) most are uncomfortable with the idea of OPR; and (4) most would like publishers to continue organizing peer review because of their perceived independence.     

Modelling the influences on learning outcomes of study processes in university mathematics

The field trialling of inventory scalesreflecting variation in students' mathematicsstudy and learning processes is described.These scales predict learning outcomes (finalmarks), but with differentiated patterns ofrelationship to those outcomes. In combination,the scales also detect cohorts of students atrisk of study failure. The work reported is inthe broader context of developing anindividual-differences-based model of studentlearning. Although this model is sitedspecifically within mathematics learning, themethodology of its development is transferableto other discipline contexts. The trialledscales complement others already developed thatreflect affective variation in students'mathematics study.