Improving the quality and effectiveness of computer-mediated instruction through usability evaluations

Brigham Young University's Center for Instructional Design (CID) creates online courses and multimedia instructional applications for university faculty. This paper asserts that including usability testing as a part of evaluation improves the quality and effectiveness of computer‐mediated instruction. The paper describes the fundamental purpose and functions of usability testing, and also distinguishes between different forms of evaluation: accessibility, quality assurance (QA), usability and implementation. Through a detailed case study, we describe how usability testing improved the quality of a computer‐based chemistry course and facilitated a clearer analysis of the learning effectiveness of this course.     

Using science songs to enhance learning: an interdisciplinary approach

Music is recognized as an effective mode of teaching young children but is rarely used in university-level science courses. This article reviews the somewhat limited evidence on whether and how content-rich music might affect college students' understanding of science and offers practical suggestions for incorporating music into courses. Aside from aiding memorization, songs may potentially improve learning by helping students feel relaxed and welcome in stressful settings, engaging students through multiple modes (verbal vs. nonverbal) and modalities (auditory vs. visual vs. kinesthetic) simultaneously, challenging students to integrate and "own" the material through the medium of song lyrics, and increasing students' time on task outside of class through enjoyable listening or songwriting assignments. Students may produce content-rich songs of good quality if given sufficient assistance and encouragement by instructors and peers. The challenges ahead include 1) defining the circumstances in which music is most likely to promote learning and 2) developing rubrics for evaluating the quality of songs.     

Recent Conferences

Atomic theory or the nature of matter is a principal concept in science and science education. This has, however, been complicated by the difficulty students have in learning the concept and the subsequent construction of many alternative models. To understand better the conceptual barriers to learning atomic structure, this study explores the troublesome nature of this fundamental scientific concept. In order to illustrate the distinction of student understanding by threshold barriers, this study chose three particularly high‐achieving students from an original interview sample of 20 students who were selected from an introductory college chemistry course. The pre‐course and post‐course interview responses were examined and compared in detail. This study considers the concepts of ‘probability’ and ‘energy quantization’ to both describe the structure of the threshold of understanding students’ need to negotiate in their construction of the target model of atomic structure. In this respect, this study suggests atomic structure as a possible threshold concept for further study in science. Identifying the nature and structure of the threshold of understanding confronting students, and analyzing the troublesomeness of atomic structure, provides valuable information for understanding student learning difficulties, and insight into how they may be addressed.     

Judging the Constructive Impacts of Communication Technologies: A Business Education Study

Through an IBM partnership, Acadia University has the benefit of an infrastructure that places a laptop computer in the hands of some 4000 faculty and students on campus. Coupled with anytime–anyplace campus access to the computer network, the setting offers unique opportunities to study the pedagogical impacts of the use of computers in classroom instruction.University business administration courses have routinely employed case study approaches in the delivery of some course content. The research described follows the use of an elaborate case study communications networking system being used in a business course on competitive intelligence. Though the technology collage allows for certain opportunities to promote quality instruction, not all aspects of technology use were found to be productive. This paper provides an analysis of the appropriateness of technology usage in the context of a single business education course.     

The basic tastants in aversion conditioning: Evidence for sensory preconditioning and not potentiation

In Experiment 1, a potentiation paradigm was used to test the relative influence of odor and taste with two 2 basic tastants (i.e., salt and sweet) in conditioned aversion learning. Experiment 1 showed that aversions to tastants (salt or sweet presented in a manner by which it could be tasted) were established only in subjects trained with the tastant, not the odor (i.e., salt or sweet presented in a manner by which it could not be tasted). Experiment 2 demonstrated, with a sensory preconditioning procedure, that the expression of an aversion to tastants was dependent on previous tastant experience prior to odor aversion training. These results suggest that while subjects can smell salt and sweet solutions, these odors are neither sufficient nor necessary for the expression of a conditioned tastant aversion.     

Innovations in Measuring Rater Accuracy in Standard Setting: Assessing “Fit” to Item Characteristic Curves

Standard setting methods such as the Angoff method rely on judgments of item characteristics; item response theory empirically estimates item characteristics and displays them in item characteristic curves (ICCs). This study evaluated several indexes of rater fit to ICCs as a method for judging rater accuracy in their estimates of expected item performance for target groups of test-takers. Simulated data were used to compare adequately fitting ratings to poorly fitting ratings at various target competence levels in a simulated two stage standard setting study. The indexes were then applied to a set of real ratings on 66 items evaluated at 4 competence thresholds to demonstrate their relative usefulness for gaining insight into rater “fit.” Based on analysis of both the simulated and real data, it is recommended that fit indexes based on the absolute deviations of ratings from the ICCs be used, and those based on the standard errors of ratings should be avoided. Suggestions are provided for using these indexes in future research and practice.     

Teaching and Learning about Language Change (Part One)

With particular reference to recent developments (including some in communication‐technology), this first of two papers explores the nature of ‘language change’ – its kinds, mechanisms and effects – and some attitudes towards it. It then suggests a case for teaching and learning about language change (bearing in mind, particularly, students in the 11–16 age range). The second paper, which will appear in Changing English 18:2, suggests approaches of two broad kinds and contexts: (1) as opportunities arise in undertaking other work; and (2) within planned, ‘set‐piece’ activities. Extensive notes/references are offered as support to teachers.