An evaluation of the effectiveness of a computer‐assisted reading intervention

Background

A cost‐effective method to address reading delays is to use computer‐assisted learning, but these techniques are not always effective.

Methods

We evaluated a commercially available computer system that uses visual mnemonics, in a randomised controlled trial with 78 English‐speaking children (mean age 7 years) who their schools identified as needing reading support. School‐based individual tutorials usually took place 2–3 times/week. Only the experimental group received the intervention in the first 10 months; thereafter, both the experimental and control groups received the intervention for 6 months.

Results

After 10 months, the experimental group had significantly higher standardised scores than the waiting list control group of decoding, phonological awareness, naming speed, phonological short‐term memory and executive loaded working memory.

Conclusions

The computer‐assisted intervention was effective, and this suggests that this medium can be used for reading interventions with English‐speaking children. What is already known about this topic

• There are comparatively few randomised controlled trial evaluations of computer‐based reading interventions.
• Meta‐analyses report small positive effect sizes for such interventions with English‐speaking children.
• The use of visual mnemonics to improve reading has rarely been investigated.

What this paper adds

• The findings suggest that computer‐based interventions for English‐speaking, struggling readers can be effective.
• The effects extended beyond the targeted abilities, and a longer intervention was more effective than a shorter one.
• Apart from spelling, the mean reading and reading related standardised scores for children at the end of the intervention were above or just below 100.

Implications for theory, policy or practice

• Computer‐based interventions can be used to support English‐speaking, struggling readers, and their effects can go beyond targeted abilities.
• The use of visual mnemonics and the development of the intervention programme over a number of years could have contributed to this success.
• The role of visual mnemonics as a help for struggling readers deserves further investigation.

     

Development of a peer‐assisted learning strategy in computer‐supported collaborative learning environments for elementary school students

This study explores the effects of Electronic Peer‐Assisted Learning for Kids (EPK), on the quality and development of reading skills, peer interaction and self‐concept in elementary students. The EPK methodology uses a well‐developed, synchronous computer‐supported, collaborative learning system to facilitate students' learning in Chinese. We first review the theoretical framework and architecture of EPK. This study aimed to compare students learning Chinese language arts activities online using EPK with students learning face‐to‐face in a classroom setting. Students' online interactions were coded into four patterns of peer interactions: task coordination, tutor behaviour, tutee behaviour and off‐task. The online activity type significantly influenced the online peer interactions. Students in the online peer‐assisted learning group outperformed the face‐to‐face group on reading skills. Students learning online showed significant growth in self‐concept, and this was especially true for students who were passive participants. These findings demonstrate that EPK is an effective tool that can enhance elementary students' reading, as well as promote positive self‐concepts.     

A usability study of users' perceptions toward a multimedia computer‐assisted learning tool for neuroanatomy

This usability study evaluated users' perceptions of a multimedia prototype for a new e‐learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e‐learning tools to maximize user acceptance, satisfaction, and adoption. Sixty‐two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: (1) highly needed across a spectrum of educational contexts, (2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and (3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health‐professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. Anat Sci Ed 2008. © 2008 American Association of Anatomists.     

Rethinking strategy instruction: direct reading strategy instruction versus computer‐based guided practice

There are many established reading strategy training programmes, which explicitly teach strategic and meta‐cognitive knowledge to improve reading comprehension. Although instruction in strategy knowledge leads to improvements in meta‐cognitive skills, the effects do not always transfer to reading comprehension. Therefore, to investigate preconditions for knowledge transfer, two different strategy training programmes were implemented in nine classes of Grade 6 students (N = 148) over the course of one school year. One programme involved teacher‐directed instruction of declarative meta‐cognitive knowledge (Reading Detectives; Rühl & Souvignier, 2006). The other aimed at improving executive meta‐cognition by guided practice: students worked with a computer program based on latent semantic analysis (LSA) (conText) and received immediate feedback on written summaries. Although both groups improved their strategy knowledge to the same extent, the conText group showed a greater improvement in reading comprehension. These fndings suggest that guided practice, which is characterised by intensive practice and individualised corrective feedback, is superior to explicitly teaching strategy knowledge.     

Exploring design features to enhance computer‐based assessment: Learners' views on using a confidence‐indicator tool and computer‐based feedback

Many institutions encourage formative computer‐based assessment (CBA), yet competing priorities mean that learners are necessarily selective about what they engage in. So how can we motivate them to engage? Can we facilitate learners to take more control of shaping their learning experience? To explore this, the Learning with Interactive Assessment (LINA) project, a small‐scale study, trialed a selection of online, interactive question features designed to increase motivation, particularly of work‐based learners, and to enhance learners' ability to self‐regulate their own learning experience. We present initial findings on learner perceptions of: (1) a confidence indicator tool—for learners to indicate their confidence that their answer will be correct before answering a question; (2) a learning log—for learners to insert reflections or view system‐recorded information about their learning pathway; and (3) question feedback—for displaying a range of author comments. Themes emerged relating to motivational, behavioural and cognitive factors, including risk taking and skills in self‐assessment. A serendipitous finding highlights learners' frequently not reading onscreen feedback and presents perceptions on when feedback becomes most useful. Motivators and barriers to engagement and self‐regulation are discussed in relation to principles of best feedback practice.     

AI in computer‐based training*

In this paper, intelligent approaches to CBT are put into several perspectives in an attempt to elucidate the concepts and give them a more realistic (and not only glamorous) footing. The role of expert systems in training is explored and possible routes towards intelligent CBT are outlined.     

Implementation integrity in peer tutoring of mathematics

A two-year randomised controlled trial of peer tutoring in mathematics using the Duolog Math technique was operated in 80 schools. The aim was to achieve adequate implementation quality with modest pre-intervention training for teachers, who received brief didactic training and no process feedback (but they were to train pupils using modelling, practice and feedback). Implementation integrity was observed in Year 1 in 29 randomly selected schools; in Year 2 in 30 randomly selected schools. In both years some observed variables of class-wide context and individual technique were high; however, some were lower. There were deficits in: teachers introducing the problem, suggesting ways to concretise the problem and holding plenary sessions. Crucially, there was very little summarising or generalising. Thus, implementation was partial in both years, but better in Year 2. The implications for future intensity of training are explored.     

Progressive inquiry in a computer‐supported biology class

The problem addressed in the study was whether 10‐ and 11‐year‐old children, collaborating within a computer‐supported classroom, could engage in progressive inquiry that exhibits an essential principal feature of mature scientific inquiry: namely, engagement in increasingly deep levels of explanation. Technical infrastructure for the study was provided by the Computer‐Supported Intentional Learning Environment (CSILE). The study was carried out by qualitatively analyzing written notes logged by 28 Grade 5/6 students to CSILE's database. Results of the study indicated that with teacher guidance, students were able to produce meaningful intuitive explanations about biological phenomena, guide this process by pursuing their own research questions, and engage in constructive peer interaction that helped them go beyond their intuitive explanations and toward theoretical scientific explanations. Expert evaluations by three widely recognized philosophers of science confirmed the progressive nature of students' inquiry. © 2003 Wiley Periodicals, Inc. J Res Sci Teach 40: 1072–1088, 2003     

Students' cognitive focus during a chemistry laboratory exercise: Effects of a computer‐simulated prelab

To enhance the learning outcomes achieved by students, learners undertook a computer‐simulated activity based on an acid–base titration prior to a university‐level chemistry laboratory activity. Students were categorized with respect to their attitudes toward learning. During the laboratory exercise, questions that students asked their assistant teachers were used as indicators of cognitive focus. During the interviews, students' frequency and level of “spontaneous” use of chemical knowledge served as an indicator of knowledge usability. Results suggest that the simulation influenced students toward posing more theoretical questions during their laboratory work and, regardless of attitudes, exhibiting a more complex, correct use of chemistry knowledge in their interviews. A more relativistic student attitude toward learning was positively correlated with interview performance in both the control and treatment groups. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 44: 1108–1133, 2007     

A comparison of the pencil‐and‐paper and computer‐administered Minnesota Multiphasic Personality Inventory–Adolescent

Within the context of a counterbalanced design, 102 students from either a high school or a large Southeastern university were administered two versions of the Minnesota Multiphasic Personality Inventory–Adolescent (MMPI–A): a computer‐administered version (CA) and a paper‐and‐pencil version (PAP). Time between testing sessions was approximately one week. Differences in individual scale means between the CA and PAP were calculated using paired t tests, with the Bonferroni correction procedure; no mean differences were statistically significant ( p > .05). To determine if the scale distributions were similar Hartley's homogeneity of variance tests were conducted; there were no differences in the shapes of the scale distributions ( p > .05). Pearson product‐moment coefficients were calculated to determine if the relative rankings were similar across administration formats; coefficients for every scale were positive and statistically significant ( p < .01). © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 605–613, 2005.     

Face‐to‐face talk to support computer‐mediated discussion in a primary school literacy practice

In this study, Dutch primary school children used a computer‐mediated discussion forum to discuss the concept of horror stories. In such discussion forums children often write their contributions individually. This paper presents an ongoing empirical study in which the contributions to an electronic discussion forum from children working individually were compared to contributions from children working in dyads. Preliminary results indicated that children working in dyads around the computer wrote more contributions to the computer‐mediated discussion and were more attentive to the collaborative process, than children who wrote their contributions individually.     

Rapid recovery in sub‐optimal readers in Wales through a self‐paced computer‐based reading programme

Basic literacy skills underlie much future adult functioning, and are targeted in children through a variety of means. Children with identified special needs in reading were exposed to a self‐paced computer‐based reading programme that focused on improving phonetic ability. Exposure was limited to three, 40‐minute sessions a week, for 10 weeks. The children were assessed in terms of their reading, spelling and mathematics abilities before the programme commenced, and immediately after the programme terminated. The programme improved reading and spelling by about eight months, but had no impact on mathematics. The results suggest that brief exposure to a self‐paced phonetic computer‐based teaching programme had some benefits for the sample.