THE EFFECT OF PRACTICE SESSIONS ON THE USE OF SEPARATE ANSWER SHEETS BY FIRST AND SECOND GRADERS

The purpose of this study was to determine the effect of formal practice sessions on the ability of first and second graders to use separate answer sheets on the California Test of Mental Maturity. The Ss were all 79 pupils enrolled in these grades at one elementary school. Academically, these Ss were above average. Through the use of a counterbalanced design, the CTMM was administered twice to all Ss; once employing the usual answer marking format contained in the test booklet and once employing a separate answer sheet preceded by a formal practice session. Significant mean raw score differences between formats of 10.30 and 7.19 were obtained for Ss in grades one and two respectively in favor of the booklet format. Accuracy scores, which removed the effect of speed from raw score performances, were also analyzed and the results confirmed the superiority of the booklet format. It was concluded that even with prior practice sessions, above average pupils in grades one and two are unable to utilize separate answer sheets in an effective manner.     

Introduction and training of students to use separate answer sheets: Effects on standardized test scores

Previous research has found conflicting evidence regarding how early children can effectively use separate answer sheets with achievement tests. This study looked at the effects of separate answer sheets on the California Achievement Test (CAT) scores of third, fourth, and fifth graders. The Mathematics Computation and the Reading Comprehension subtests of the CAT were used. Seventy-one classrooms were randomly assigned to have students record their answers on either: (a) their test booklets, (b) separate answer sheets, or (c) separate answer sheets after being given training in the use of separate answer sheets. The results were consistent across both subtests and grades; no response mode treatment effect was found. Further, no evidence of a treatment by ability interaction was found, which was contrary to previously reported research. The results of this study suggest that students can, as early as grade three, effectively use separate answer sheets without prior training.     

Putting Standardized Tests and Scales to Practical Use in the Rural Schools

ABSTRACT

The authors compared the performance of third-grade students testing on answer sheets with those testing on machine-scored test booklets. The 1,832 students in the nationally representative sample were assigned at the campus level to complete the Stanford Achievement Test Series, Tenth Edition in 1 of 4 conditions: (a) Form A answer sheet, (b) Form A booklet, (c) Form B answer sheet, and (d) Form B booklet. After controlling for scholastic ability, no significant differences in performance on total reading, total mathematics, and total language strands were found between students using booklets and those using answer sheets. The results of this study provide no evidence to support the need to use separate test booklets with general education third-grade students. States may consider using separate answer sheets with these students to realize potential cost and schedule efficiencies.     

TEST RELIABILITY AS A FUNCTION OF ANSWER SHEET MODE

The purpose of this study was to examine the effect of using separate, machine scorable answer sheets on the number of marking errors made by third-, fourth-, and sixth-grade students. Half of the Ss at each grade level answered in the test booklet (AIB), and half answered on separate answer sheets (SAS). The number of marking errors for the SAS group was approximately three times as great as for the AIB group at each grade level. This indicates that test standardization information must specify the answer sheet mode used to collect normative data.     

THE USE OF SEPARATE ANSWER SHEETS BY PRIMARY AGE CHILDREN1

The purpose of this study was to determine the effects on test scores of employing a separate answer sheet using the California Test of Mental Maturity with 117 pupils in the primary grades of one through three. The CTMM was administered twice to all students; once employing the usual answer marking format contained in the test booklet and once employing a separate answer sheet. A counterbalanced design was used to control for order effects. The mean raw differences between marking format conditions decreased from 23.67 to 10.79 to 3.32 for students in grades one through three respectively, indicating that the need for the test booklet marking format decreases sharply as the grade level of the Ss increases.     

The influence of a response format test accommodation for college students with and without disabilities

Standardised and other multiple-choice examinations often require the use of an answer sheet with fill-in bubbles (i.e. ‘bubble’ or Scantron sheet). Students with disabilities causing impairments in attention, learning and/or visual-motor skill may have difficulties with multiple-choice examinations that employ such a response style. Such students may request and receive testing accommodations that intend to mitigate these impairments, such as circling responses in a test booklet, which contains both the questions and corresponding multiple-choice answers. The current study evaluated this test accommodation as compared to using a bubble sheet or Scantron on a multiple-choice vocabulary test. College students with (n = 25) and without (n = 76) disabilities completed a vocabulary test under both booklet (accommodated) and bubble sheet (standard) conditions. Results demonstrated that answering in a test booklet, a much preferred response mode, allowed students to attempt significantly more items than using a bubble sheet, improving their overall test scores. Booklet responding tends to improve overall performance, even for students without disabilities, calling into question the specificity and validity of this accommodation.     

The Influence of Social Stratification and Age on Occupational Aspirations of Adolescents

Abstract

This study examines children’s awareness of socially prominent occupations and educational motivation to enter these occupations successfully. Four separate groups of students were analyzed to determine variations in the occupational/educational aspirations: (1) low socioeconomic third graders; (2) high socioeconomic third graders; (3) low socioeconomic eighth graders; and (4) high socioeconomic eighth graders. It was concluded that children form occupational predispositions at a very early age. The study indicates that children from a higher socioeconomic stratum had higher educational goals and the desire to obtain prestige occupations, while lower socioeconomic students had resigned themselves to less education and lower job status.     

USE OF OPTICALLY SCORED TEST ANSWER SHEETS WITH YOUNG CHILDREN

By testing a sample of 840 school children from an urban school district, the authors examined the practical limitations of the use of an optically scored answer sheet. The independent variables were grade (two through nine) and degree of instruction and practice (three levels). The dependent variable was the number of easy items (embedded within a set of ordinary test items) that were correctly answered. The easy items, which were different for the various grades, were selected because other children, comparable to those used in the experiment, were able to answer them virtually without error when answering on a test booklet rather than on the answer sheet. The findings indicated that students in grades two and three, in the fall of the year, were unable to make valid responses. Students in grades four and five seemed able to make valid responses only after receiving specific instructions and a practice session. Above grade five, students made valid responses regardless of the types of instructions they received.     

Supporting the self-regulated use of retrieval practice: A higher education classroom experiment

This study investigated whether an instructional intervention can increase students’ self-regulated use of retrieval practice in a higher education classroom environment. A lab-experiment by Ariel and Karpicke (2017) revealed that strategy instructions improved students’ self-regulated use of retrieval practice and subsequent test performance. Our goal was to determine whether these effects generalize to a classroom environment using key concepts from marketing communication. We compared two groups on their self-regulated use of retrieval practice using an online environment. An experimental group (n = 58) received strategy instructions on retrieval practice and a control group (n = 58) received neutral instructions. Instructions were provided during sessions 1 and 2; no instructions were provided in a third, transfer session, measuring self-regulated use of retrieval practice. In sessions 1 and 2, no significant differences between groups were found. In the transfer session, the experimental group tested themselves more (Hypothesis 1) and displayed a larger number of (correct) retrieval attempts per key concept (Hypothesis 2) than the control group. No correlations were found with performance (Hypothesis 3). With our experiment, we took a first step in supporting students in their self-regulated use of retrieval practice in a classroom environment with complex materials.     

Confirmatory factor analysis of the Iowa tests of basic skills

Confirmatory factor analysis was used to explore the internal structural validity of the Iowa Tests of Basic Skills (ITBS) using three samples: (a) the third‐grade standardization sample, (b) a fourth‐grade sample reported by Klein (1981), and (c) a new sample of third graders. Results showed that a four‐factor structure provided a better representation of the relations among the 11 subtests than Klein's one‐factor model, a two‐factor model, or the three‐factor model described in the ITBS manual. The four‐factor model was refined using the new sample and was cross‐validated using the other two samples. A hierarchical model with a single, second‐order general achievement factor was also found to fit the data well. Decomposition of subtest variance into common, specific, and error components indicated that little specific variance is associated with several ITBS subtests, raising the question of whether interpretation of individual subtests is warranted.     

ACHIEVEMENT TEST RELIABILITY AS A FUNCTION OF PUPIL-RESPONSE PROCEDURES

Muller, Calhoun, and Orling (1972) conclude that test reliability is dependent on the type of answer document used by elementary pupils. The present study was designed in part to assess the differential effect of two pupil response procedures (answering directly in the test booklet versus on a separate answer folder) on Metropolitan Achievement Tests scores of grades 3 and 4 pupils.
Over 4000 pupils from nine school systems took the Metropolitan , half responding in their booklets and half using answer folders. The two groups were matched by grade in general scholastic aptitude.
Although the separate answer folder group received lower scores than did the group responding in the test booklets, the score reliabilities did not differ significantly for any test. Additionally, these reliabilities did not differ significantly from comparable Metropolitan normative reliabilities. For survey achievement tests such as Metropolitan , test reliability would not appear to depend on pupil response mode.     

Developing and evaluating a strategy for learning from animations

Based on current theories of multimedia learning, we propose a strategy for learning from animations. Two different experimental studies were conducted in order to evaluate the strategy. In the first study, 22 sixth graders learned from an animation without the strategy while 21 students were encouraged to make use of the proposed strategy during learning; use of the strategy was not monitored. The students who were encouraged to take advantage of the strategy learned significantly more than the students who were not asked to do so. In the second study, three groups of sixth graders were investigated. The first group consisted of 49 students who learned from an animation without the strategy. The second group consisted of 52 students who were encouraged to make use of the strategy during learning; but use of the strategy was not monitored. The third group consisted of 53 students who were also encouraged to make use of the strategy during learning and their use of the strategy was monitored. The results of the second study replicated the findings of the first study. Furthermore, learning was most successful when the students' use of the learning strategy was monitored.     

Study of a Dual-Language Test Booklet in Eighth-Grade Mathematics

The purpose of this study was to address the effectiveness of a Spanish-English dual-language test booklet in 8th-grade mathematics. This study used analyses of test data (n = 402) as well as information gathered through focus groups (n = 68) and cognitive interviews (n = 18) to assess the accuracy and utility of the dual-language format as a testing accommodation. The data indicate that the translation procedures were effective and that the 2 test booklet formats were comparable once English-language proficiency and language used to answer the test were accounted for. Students found the dual-language format to be very useful, and no undue advantage appeared to be accorded to students given the dual-language booklet over the English-only booklet. In our discussion, we address translation issues and the challenges in accurately identifying students who should receive language accommodations.     

Mental arithmetic in children with mathematics learning disabilities: the adaptive use of approximate calculation in an addition verification task

The adaptive use of approximate calculation was examined using a verification task with 18 third graders with mathematics learning disabilities, 22 typically achieving third graders, and 21 typically achieving second graders. Participants were asked to make true-false decisions on simple and complex addition problems while the distance between the proposed and the correct answer was manipulated. Both typically achieving groups were sensitive to answer plausibility on simple problems, were faster at rejecting extremely incorrect results than at accepting correct answers on complex addition problems, and showed a reduction of the complexity effect on implausible problems, attesting to the use of approximate calculation. Conversely, children with mathematics disabilities were unaffected by answer plausibility on simple addition problems, processed implausible and correct sums with equal speed on complex problems, and exhibited a smaller reduction of the complexity effect on implausible problems. They also made more errors on implausible problems. Different hypotheses are discussed to account for these results.     

The big-fish-little-pond effect on academic self-concept and interest in first- and third-grade students

BackgroundThe big-fish-little-pond effect (BFLPE) postulates that class-average achievement has a negative effect on students’ academic self-concept. Research examining the BFLPE with elementary school students is scarce, especially with first graders.AimsThis study examined the BFLPE of class-average achievement on academic self-concept and interest in the math domain with first and third graders.SampleParticipants were Luxembourgish first graders (N = 5057) and third graders (N = 4925).MethodsA multilevel, doubly latent approach was used to assess a BFLPE model containing achievement (as the predictor) and ASC and interest (as outcomes) in the math domain.ResultsThe BFLPE on math self-concept was supported in both grades, whereas the BFLPE on math interest was supported only for third graders. In both grades, larger effect sizes were observed for the BFLPE on math self-concept than on math interest.ConclusionOur results suggest that the social comparisons underlying the BFLPE play an important role in the formation of math self-concept in both grades, but they play a less substantial—and probably later—role in the formation of math interest in elementary school.     

Gender Differences in Constructed Response Reading Items

To evaluate the effects of calculator use on performance on the SAT I: Reasoning Test in Mathematics, questions about use of the calculator on the test were inserted into the answer sheets for the November 1996 and November 1997 administrations of the examination. Overall, nearly all of examinees indicated that they brought a calculator to the test and about two thirds reported using them on one third or more of the math items. Some group differences in the use of calculators were observed with girls using them more frequently than boys and Whites and Asian Americans using them more often than other racial or ethnic groups. Use of calculators was associated with higher test performance, but the more able students were more likely to have calculators and used them more often. The results were analyzed further using multiple regression and differential item functioning procedures. The degree of speededness on different degrees of calculator use was also examined. Overall, the effects of calculator use were found to be small, but detectable.     

The effects of teaching notetaking strategies on elementary students’ science learning

The research examined effects of notetaking instruction on elementary-aged students’ abilities to recall science information and their notetaking behaviors. Classes of eight to nine years old third grade students were randomly assigned to three treatment conditions: strategic notetaking, partial strategic notetaking, and control, for four training sessions. The effects of the notetaking instruction were measured by their performances on a test about science information, a long-term free recall of the information, and the number of information units recalled with or without cues. Students’ prior science achievement was used to group students into two levels (high vs. low) and functioned as another independent variable in analysis. Results indicated significant treatment effect in favor of the strategy notetaking instruction groups on cued and non-cued recall of the information units. Students with higher prior achievement in science performed better on cued recall and long-term free recall of information. The results suggest that students as young as those in third grade classes can be instructed to develop notetaking ability that promotes their learning.     

Conservation Comes of Age

Abstract

This study investigated the effects of instruction in environmental education on the attitudes of elementary school children toward the environment. One class of third graders was provided with two hours of environmental education instruction. A comparable class of third graders served as a control group. Both classes were pre- and posttested using an author-designed environmental attitude questionnaire. Analyses of these data showed that 1) the experimental group had significantly improved attitudes on a pre-post basis and 2) this same group had significantly more positive attitudes toward the environment when compared with the control group. When tested again as fifth graders, the experimental group remained significantly more positive toward the environment than the fifth grade control group.     

Determining the academic and affective outcomes of dyad reading among third graders

Abstract

Dyad reading involves a lower level reader paired with a higher level reading partner who models proficient oral reading while providing access to challenging texts. Previous research has reported increased reading fluency and comprehension for participants of dyad reading; however, to date no research has investigated how dyad reading may influence student attitudes toward reading. Using mixed effects linear modeling, this quasi-experimental study of third graders investigated the academic and attitudinal outcomes for students who read in dyads for 15?minutes daily for 90 school days. Results indicated that dyad readers experienced mixed outcomes in improving reading proficiency and a pattern of decline in reading attitudes compared to students in the control group. While lower level dyad readers demonstrated significant gains on a measure of comprehension, there were no differences between groups on several other measures of reading. Recommendations target how to maximize the use of dyad reading to support students’ reading development without eroding their perceptions of themselves as readers.