Detection of Misconceptions about Colour and an Experimentally Tested Proposal to Combat them

We study the misconceptions about colour that most people hold, determining the general phenomenological laws that govern them. Concept mapping was used to combat the misconceptions which were found in the application of a test specifically designed to determine these misconceptions, while avoiding the possible misleading inductions that could have arisen from the use of everyday language. In particular, care was taken to avoid the distorting effect that the use of the verb ‘to be’ applied to coloured objects could have on the responses. The misconceptions found were shown to have an internal consistency in the form of authentic mini-theories (implicit theories). We compared experimentally the results of two different teaching methods applied to combat these misconceptions. This study was conducted with 470 undergraduates of the University of Extremadura. We analysed the persistence over time of their learning made to overcome those misconceptions. The students were divided randomly into an experimental group (EG) and a control group (CG). To combat their misconceptions, EG were taught following a method based on the use of concept maps, and CG were taught following traditional teaching methods. The results of a pre-test and a post-test were compared for the two groups, finding statistically significant differences. The results allowed the principal working hypothesis to be accepted—concept maps are learning tools which foster conceptual change and allow misconceptions to be eradicated via meaningful learning maintained over time, i.e. EG acquired a relative long-lasting gain in learning that was superior to that acquired by CG.     

AIDA: An integrated authoring environment for educational software

This paper describes an integrated authoring environment, AIDA (Ambiente Integrado de Desenvolvimento de Aplicações educacionais). It is an open tool, giving the author a high degree of freedom both in package characteristics and design methodologies used. This environment integrates several modules. The core of the design module is a prototyping tool, allowing the creation of evolutionary prototypes. These prototypes can include several types of multimedia components and can be used as part of the final package. The AIDA environment also includes other options that support evaluation, learning materials re-use, communication between authoring team members and translation and cultural adaptation of packages to work in different environments. An experimental version of this authoring environment was implemented and the results of its evaluation are encouraging. In this paper we also present an example of a package created with the AIDA authoring environment.     

PUBLIC EXPENDITURE ON HIGHER EDUCATION: A COMPARATIVE STUDY IN THE EC‐MEMBER STATES, 1975‐1990

This article is an exercise in cross‐national comparative research on the financing of higher education, the countries involved being the EC countries. Before relevant comparisons could be made, agreement had to be reached as to what “higher education” is and what “students” are. It was then necessary to find some way of making accurate comparisons of monetary units and of dealing with contradictory ways in which educational statistics were and still are collected and collated. A research strategy was developed using existing sources, a specially developed questionnaire, and consultation with national experts. The results displayed biases for which corrections had to be made. They also, however, displayed a wide variety in the level of higher education expenditure in the EC countries. The project gave rise to the creation of the first comprehensive database that covers public expenditure on higher education in the twelve member states of the EC. It can be regarded as the first step in the creation of the “perfect database” on higher education expenditure which in turn would be a most valuable tool for higher education policy‐makers.

     

Learning analytics application to examine validity and generalizability of game-based assessment for spatial reasoning

Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.

Practitioner notes

What is already known about this topic:

• Digital games can be a powerful context to support and assess student learning.
• Games as assessments need to meet certain psychometric qualities such as validity and generalizability.
• Learning analytics provide useful ways to establish assessment models for educational games, as well as to investigate their psychometric qualities.

What this paper adds:

• How a digital game can be coupled with learning analytics practices to assess spatial reasoning skills.
• How to evaluate psychometric qualities of game-based assessment using learning analytics techniques.
• Investigation of validity and generalizability of game-based assessment for spatial reasoning skills and the interplay of the game-based assessment with enjoyment.

Implications for practice and/or policy:

• Game-based assessments that incorporate learning analytics can be used as an alternative to pencil-and-paper tests to measure cognitive skills such as spatial reasoning.
• More training and assessment of spatial reasoning embedded in games can motivate students who might not be on the STEM tracks, thus broadening participation in STEM.
• Game-based learning and assessment researchers should consider possible factors that affect how certain populations of students enjoy educational games, so it does not further marginalize specific student populations.

     

Building personalised homework from a learning analytics based formative assessment: Effect on fifth-grade students' understanding of fractions

This study analyses the potential of a learning analytics (LA) based formative assessment to construct personalised teaching sequences in Mathematics for 5th-grade primary school students. A total of 127 students from Spanish public schools participated in the study. The quasi-experimental study was conducted over the course of six sessions, in which both control and experimental groups participated in a teaching sequence based on mathematical problems. In each session, both groups used audience response systems to record their responses to mathematical tasks about fractions. After each session, students from the control group were given generic homework on fractions—the same activities for all the participants—while students from the experimental group were given a personalised set of activities. The provision of personalised homework was based on the students' errors detected from the use of the LA-based formative assessment. After the intervention, the results indicate a higher student level of understanding of the concept of fractions in the experimental group compared to the control group. Related to motivational dimensions, results indicated that instruction using audience response systems has a positive effect compared to regular mathematics classes.

Practitioner notes

What is already known about this topic

• Developing an understanding of fractions is one of the most challenging concepts in elementary mathematics and a solid predictor of future achievements in mathematics.
• Learning analytics (LA) has the potential to provide quality, functional data for assessing and supporting learners' difficulties.
• Audience response systems (ARS) are one of the most practical ways to collect data for LA in classroom environments.
• There is a scarcity of field research implementations on LA mediated by ARS in real contexts of elementary school classrooms.

What this paper adds

• Empirical evidence about how LA-based formative assessments can enable personalised homework to support student understanding of fractions.
• Personalised homework based on an LA-based formative assessment improves the students' comprehension of fractions.
• Using ARS for the teaching of fractions has a positive effect in terms of student motivation.

Implications for practice and/or policy

• Teachers should be given LA/ARS tools that allow them to quickly provide students with personalised mathematical instruction.
• Researchers should continue exploring these potentially beneficial educational implementations in other areas.