An analysis of research studies in which “homemade” achievement instruments were utilized

This article will have as its focus a problem described by Anderson, namely, the quality of the construction and reporting of research that contains “homemade” achievement tests. The current status of homemade achievement tests was examined in this study. Research reports in two science education journals were analyzed, using Anderson's eight categories of information that a high quality research report should include. The journals examined were Journal of Research in Science Teaching and Science Education from January 1975 to January 1980. The findings indicate that reliability estimates and the procedures for selecting test items were mentioned more frequently in the science education journals than in Anderson's study. However, there was little or no improvement in describing the relation of test items to instruction. These findings should be of interest both to researchers who are utilizing “homemade” achievement tests in their studies and to journal panels who are reviewing studies for publication.     

“American = English Speaker” Before “American = White”: The Development of Children's Reasoning About Nationality

Adults implicitly judge people from certain social backgrounds as more “American” than others. This study tests the development of children's reasoning about nationality and social categories. Children across cultures (White and Korean American children in the United States, Korean children in South Korea) judged the nationality of individuals varying in race and language. Across cultures, 5‐ to 6‐year‐old children (N = 100) categorized English speakers as “American” and Korean speakers as “Korean” regardless of race, suggesting that young children prioritize language over race when thinking about nationality. Nine‐ and 10‐year‐olds (N = 181) attended to language and race and their nationality judgments varied across cultures. These results suggest that associations between nationality and social category membership emerge early in life and are shaped by cultural context.     

“Helping” Versus “Being a Helper”: Invoking the Self to Increase Helping in Young Children

Can a subtle linguistic cue that invokes the self motivate children to help? In two experiments, 3‐ to 6‐year‐old children (N = 149) were exposed to the idea of “being a helper” (noun condition) or “helping” (verb condition). Noun wording fosters the perception that a behavior reflects an identity—the kind of person one is. Both when children interacted with an adult who referenced “being a helper” or “helping” ( 2 ) and with a new adult ( 3 ), children in the noun condition helped significantly more across four tasks than children in the verb condition or a baseline control condition. The results demonstrate that children are motivated to pursue a positive identity. Moreover, this motivation can be leveraged to encourage prosocial behavior.     

Consumers Favor “Right Brain” Training: The Dangerous Lure of Neuromarketing

Over the past decade the neuromarketing of educational products has become increasingly common. Researchers have however expressed concern about the misapplication of neuroscience to education marketing, fearing that consumers may be deceived into investing in apparently “brain‐based” products under the misapprehension that they will be more effective. This study provides the first demonstration that these fears are justified. We presented 180 participants with one of four advertisements for an identical educational program, named either “Right Brain” or “Right Start” Training; the advertisements either did, or did not, include an MRI brain image in one corner. Results demonstrated that “Right Brain” training was deemed more interesting, educationally valuable, and scientifically strong than an identical product named “Right Start” training. Advertisements including an unrelated brain image enhanced ratings of scientific rationale. These results confirm that by implying a strong scientific basis, “brain‐based” product names are remarkably effective in implicitly manipulating consumer opinion.     

Relationship among laboratory instruction,attitude toward science,and achievement in science knowledge

This study investigated the use of a hands-on laboratory program as a means of improving student attitude toward science and increasing student achievement levels in science knowledge. Using a posttest-only control group design, curriculum referenced objective examinations were used to measure student achievement in science knowledge, and a posttest Q-sort survey was used to measure student attitude toward science. A one-way analysis of variance compared the groups' differences in achievement and attitude toward science. Analysis of covariance was used to determine the effect of the laboratory treatment on the dependent achievement variable with attitude toward science as the covariable. The findings showed that students who had regular laboratory instruction (a) scored significantly higher (p < .01) on the objective examination of achievement in science knowledge than those who had no laboratory experiences; (b) exhibited a moderate, positive correlation (r = .406) between their attitude toward science and their achievement; and (c) scored significantly higher (p < .01) on achievement in science knowledge after these scores were adjusted on the attitude toward science covariable. There were no significant differences in achievement or attitude toward science for the limited English proficiency groups. It was concluded that laboratory instruction influenced, in a positive direction, the students' attitude toward science, and influenced their achievement in science knowledge. It was recommended that science instruction include a regular laboratory experience as a demonstrated viable and effective instructional method for science teachers. This model of science instruction has been shown to be effective with students of diverse backgrounds who live within large urban centers. J Res Sci Teach 34: 343–357, 1997.     

The Stanford Binet fourth edition and its use with individuals with Down Syndrome: cautions for clinicians

Stanford Binet: Fourth Edition (SB:IV) assessments have been collected longitudinally for 195 individuals with Down syndrome. This article discusses individual assessments which were selected for their ability to highlight major concerns that practitioners need to consider when interpreting intelligence test scores with this population. In this study, Intelligence Quotient (IQ) changed substantially for many individuals, demonstrating changes in classification from a mild level of intellectual impairment on initial assessment to a severe level on later assessment. Subtests used in calculating composite scores were found to have a dramatic effect on IQ. There was up to 9 IQ points difference depending on whether only the “core” subtests or all subtests used by the assessor were included in the calculations. Thirty‐seven percent of the assessments were at “floor level” (i.e., IQ of 36), despite obvious divergent abilities illustrated by age equivalent scores. Mean Age Equivalent (MAE) scores were also problematic as they failed to adequately represent either the range, or divergence, of abilities of the individuals whose data are presented. Directions for future research are discussed.     

A comparison of student reactions to biology instruction by interactive videodisc or conventional laboratory

This study was designed to learn if students perceived an interactive computer/videodisc learning system to represent a viable alternative to (or extension of) the conventional laboratory for learning biology skills and concepts normally taught under classroom laboratory conditions. Data were collected by questionnaire for introductory biology classes at a large midwestern university where students were randomly assigned to two interactive videodisc/computer lessons titled Respiration and Climate and Life or traditional laboratory investigation with the same titles and concepts. The interactive videodisc system consisted of a TRS-80 Model III microcomputer interfaced to a Pioneer laser-disc player and a color TV monitor. Students indicated an overall level satisfaction with this strategy very similar to that of conventional laboratory instruction. Students frequently remarked that videodisc instruction gave them more experimental and procedural options and more efficient use of instructional time than did the conventional laboratory mode. These two results are consistent with past CAI research. Students also had a strong perception that the images on the videodisc “were not real” and this factor was perceived as having both advantages and disadvantages. Students found the two approaches to be equivalent to conventional laboratory instruction in the areas of general interest, understanding of basic principles, help on examinations, and attitude toward science. The student-opinion data in this study do not suggest that interactive videodisc technology serve as a substitute to the “wet” laboratory experience, but that this medium may enrich the spectrum of educational experiences usually not possible in typical classroom settings.     

Gender differences in national assessment of educational progress science items: What does “i don't know” really mean?

The National Assessment of Educational Progress Science Assessment has consistently revealed small gender differences on science content items but not on science inquiry items. This assessment differs from others in that respondents can choose “I don't know” rather than guessing. This paper examines explanations for the gender differences including (a) differential prior instruction, (b) differential response to uncertainty and use of the “I don't know” response, (c) differential response to figurally presented items, and (d) different attitudes towards science. Of these possible explanations, the first two received support. Females are more likely to use the “I don't know” response, especially for items with physical science content or masculine themes such as football. To ameliorate this situation we need more effective science instruction and more gender-neutral assessment items.     

The “Encounter” as an “Event of Truth” in Education: An Anthropological‐Pedagogical Approach

In this essay, Vasileios Pantazis examines how two philosophers having different orientations acknowledge and study the phenomenon of the “encounter” (Begegnung) and its fundamental importance to human life and education. On the one hand, Otto Friedrich Bollnow drew on existential philosophy and philosophical anthropology in his analysis of the encounter, while Alain Badiou, on the other hand, used psychoanalysis, mathematics, and Plato in exploring the concept. The approach Pantazis takes in this essay aims at fusing the concept of the encounter as developed by Bollnow with a philosophical view, specifically Badiou's understanding of the encounter in the context of his concept “event of truth.” Through the “fusion of horizons,” as Hans‐Georg Gadamer put it, between these two views, Pantazis seeks to enrich the concept of the encounter and to draw out a renewed meaning for philosophical and educational theory.     

Turning a City into a Milieu of Study: University Pedagogy as “Frontline”

In 2016 Bruno Latour delivered a lecture at Cornell University in which he responded to what he called the actual situation of disorientation and (literal) lack of common ground by offering some “hints for a neo‐Humboldtian university.” One hint he offered was that we should consider pedagogy as the frontline for staging an approach to societal challenges that links basic research and public engagement. Here, Jan Masschelein follows and extends upon this hint through exploring some ways to reclaim or reinvent the university as pedagogic form. Concretely, he describes the development of a course on designing educational practices that is conceived as a way to turn cities into a milieu of public and collective study. Masschelein's contribution to this symposium offers a “technical story” about physical, material experiences, one that contains some prepositions and propositions, an example, many detours, and a few practical notes and considerations. By this means, he explores the meaning and form pedagogy takes when we do not reduce it to teaching and extension, but instead approach it as the genus and the locus of a nexus between public engagement and basic research. Masschelein concludes by proposing the “public design studio” as a pedagogic form suited to the neo‐Humboldtian university.     

The impact of interactive,computerized educational modules on preclinical medical education

Interactive computerized modules have been linked to improved retention of material in clinical medicine. This study examined the effects of a new series of interactive learning modules for preclinical medical education, specifically in the areas of quiz performance, perceived difficulty of concepts, study time, and perceived stress level. We randomly allocated 102 medical student volunteers into control and experimental groups. All participants studied selected anatomical and physiologic concepts using existing material (lecture notes, textbooks, etc.), while those in the experimental groups used the new interactive modules as well. All participants completed a quiz to test their knowledge of the assigned concepts and a survey to assess their subjective experiences in studying with the modules. We found a trend toward higher quiz scores in the experimental group relative to the control group, though it did not reach statistical significance (P = 0.31). Perceived concept difficulty was significantly reduced among those who studied with the modules (P < 0.001), and the number of hours spent studying the concepts was significantly increased (P = 0.028). Of those who used the modules, 83% rated them as “very helpful” or “extremely helpful.” No significant differences existed between participants' reported stress levels during the course of the study (P = 0.44). Our data suggest that medical students may learn more effectively and feel less intimidated by difficult concepts when interactive modules supplement traditional instruction. Anat Sci Ed 1:247–251, 2008. © 2008 American Association of Anatomists.     

A comparison between the WISC and WISC-R among educable mentally retarded students

The study compared differences and similarities between WISC and WISC-R scores for 48 ten- and thirteen-year-old EMR students, who were matched according to sex and race. The WISC-R yielded significantly lower VS, PS, and FS IQ scores than the WISC for this predominantly rural Georgia population. The FS IQ scores from the WISC-R averaged 7.5 points lower than the WISC FS IQs, with similar differences noted for VS and PS scores. There was no significant difference in FS IQs between the two age groups. Results suggest that many children classified as “Borderline” or slightly above by the WISC will be classified as “Mentally Deficient” by the WISC-R.     

An analysis of the use of the “in doubt” response by university students on the musical aptitude profile and the iowa tests of music literacy

The Musical Aptitude Profile (MAP) and four levels of the Iowa Tests of Music Literacy (ITML) were administered to university non-music majors to investigate the use of the “in doubt” test item response. The “in doubt” response was not used indiscriminately by the university students on either test battery, and it appeared to function in a similar manner to use by public school students. The incidence of use of the “in doubt” response on ITML levels suggests that the students in this investigation felt quite confident of their answers on the achievement test levels and that this confidence remained stable throughout a semester of training. No reason to suspect the process validity of MAP or of ITML when used with university students was ascertained.     

“Sprouting” the Couch Potato: Techniques to Increase the Effort Learners Invest in Video-Based Materials

Although videotapes are a popular instructional medium in the training environment, viewers often adopt a passive stance toward learning from video. Viewers perceptions of video as a passive, “easy” medium may minimize the information they gain from video-based instruction. If instructional designers and trainers want to encourage the “couch potato” to process the content of a video-based lesson in an active manner, they should make sure that their lessons are designed to facilitate this process. This article discusses the relationship of mental effort to achievement, provides recommendations for designing video-based materials to increase the effort learners invest in the instruction, and presents a list of practical techniques for increasing learners' mental effort and achievement that can be incorporated into lessons that include video-based materials.     

The relationship between attitudes toward science and science achievement

This study investigated the relationship between elementary pupils' attitudes toward science and their science achievement. Residualized gain scores were used to analyze the data. By using residualized gain scores, the effects of individual differences can be minimized. In addition to controlling for these differences, residualized gain scores do not possess the measurement errors that are normally associated with simple change scores. The subjects of this study were 583 intermediate elementary pupils. The average class size was 21. A pretest-posttest design was used. To insure consistency in the teaching of the lesson, each teacher was given an identical detailed science lesson that included all the instructions and materials needed for the activity. The pupils were pre- and posttested. The pupils' science achievement was assessed by a test, the “Hough Pupil Process Test.” It consisted of multiple choice and fill-in questions. The attitude instrument, the “Hough Attitude Inventory,” was given to the elementary pupils involved in this study. It was field tested and found to discern attitudes. The instrument consisted of six statements to which the subjects responded by circling either yes, I don't know, or no. The analysis revealed that there was a significant relationship between the pupils' residualized gain scores on the “Hough Pupil Process Test” and their residualized gain scores on the “Hough Attitude Inventory” (r = 0.45).     

Bannatyne's “genetic dyslexic” subtype: A validation study

Bannatyne's “genetic dyslexic” subtype of reading disability was evaluated using WISC-R data obtained from 140 disabled readers and their matched controls (total N = 280). Although a familial pattern of reading problems was present among the relatives of the disabled readers, it was not unique to the “genetic dyslexic” subtype. However, the predicted Spatial > Conceptual > Sequential pattern of means was found to be reliable and specific to the reading disabled sample.     

“We're Not Going to Do That Because It's Not Right”: Using Pedagogical Responsibility to Reframe the Doublespeak of Fidelity

In this essay, Doris Santoro examines the discourse of “fidelity of instruction” to show how it is doublespeak for teacher compliance that is incompatible with democracy and education. Analyzing the distorted use of the term “fidelity” by market‐based reformers, Santoro illustrates how it can be used as a weapon against teacher intelligence and moral response. She argues that John Dewey's philosophy provides conceptual resources to reframe some teacher infidelity as intelligent response, the moral agency required for pedagogical responsibility.     

The effect of A teacher questioning strategy training program on teaching behavior,student achievement,and retention

The use of questions in the classroom has been employed throughout the recorded history of teaching. One still hears the term “Socratic method” during discussions of questioning procedures. The use of teacher questions is presently viewed as a viable procedure for effective instruction. This study was conducted to investigate the feasibility of training teachers in the use of a questioning technique and the resultant effect upon student learning. The Post-Test Only Control Group Design was used in randomly assigning teachers and students to experimental and control groups. A group of teachers was trained in the use of a specific questioning technique. Follow-up periodic observations were made of questioning technique behavior while teaching science units to groups of students. Post-unit achievement tests were administered to the student groups to obtain evidence of a relationship between the implementation of specific types of teacher questions and student achievement and retention. Analysis of observation data indicated a higher use of managerial and rhetorical questions by the control group than the experimental group. The experimental group employed a greater number of recall and data gathering questions as well as higher order data processing and data verification type questions. The student posttest achievement scores for both units of instruction were greater for the experimental groups than for the control groups. The retention scores for both units were Beater for the experimental groups than for the control groups.     

The effects of digital storytelling on student achievement,social presence,and attitude in online collaborative learning environments

This study investigated the effects of digital storytelling on student achievement, social presence, and attitude in online collaborative learning environments. Students in one middle school course were randomly assigned to one of the two treatment groups after they received initial general instruction regarding teamwork skills. The “digital storytelling-based online collaborative learning (DST-OCL)” and the “general online collaborative learning (G-OCL)” groups received subsequent associated skills training. The overall results indicated that after each group took part in the treatment during online collaborative learning activities, the “DST-OCL” groups had significantly higher social presence than the “G-OCL” groups. Specifically, using “DST-OCL” strategies was significantly more effective than using “G-OCL” strategies for improving the “online communication,” “interactivity,” and “privacy” components of students’ social presence in online collaborative learning environments. There was no significant difference between the two groups regarding student achievement and attitude. The findings of this study offer an insight into methods for using digital storytelling as an instructional strategy for improving online collaborative learning effectiveness.