Qualitative and quantitative differences in learning associated with multiple-choice testing

This study assesses some effects of the Computer-Assisted Self-Evaluation (CASE) system of frequent multiple-choice testing with immediate computer feedback; it is part of a larger project aiming to combine the principal strengths of individualized instruction with lecture teaching (Fisher, 1979). Learning and retention are examined in two equivalent groups of undergraduates enrolled in an upper division science course. One group (N =34) received 24 CASE quizzes with immediate feedback and the other (N=30) received two CASE-generated midterms with delayed feedback. Quiz students significantly outperformed Midterm students on the posttest; the Quiz section scored nine percentage points higher on rote items and fourteen points higher on meaningful items. Quiz students also had more positive attitudes toward and were more involved in the course. On a retention test given two years later, the Quiz Group scored eight percentage points higher than the Midterm Group on meaningful items. This study suggests that, contrary to popular opinion, multiple-choice questions promote meaningful learning at least as well as, and possibly better than, rote learning. The CASE system appears to be about as effective as other forms of frequent testing and immediate feedback in enhancing learning, and it provides a simple, cost-effective means of individualized testing in large lecture classes.     

Teaching Grammar and Mechanics in Freshman Composition

Abstract

A study was conducted using a combination of radio lectures and small group discussion meetings to teach an introductory psychology course to resident freshmen. There were two radio lectures each week, broadcast at 3:00 p.m. on Mondays and Wednesdays and again at 7:00 p.m. on Tuesdays and Thursdays; these were supplemented by small group meetings on Fridays, during which films were sometimes presented, and during which there was an opportunity for questions to be raised and points in the lecture to be clarified. About one-third of the 2,300 freshmen were taught by means of this radio procedure and about two-thirds were taught by the usual lecture method; the results of the two methods were then compared. Variables such as personality of instructors, type of test, test questions, and time allowed for testing were controlled. Also, all radio students were assured that their grades would not be penalized in any way as a result of this experimental procedure. Results indicated that, in terms of scores on objective tests in the course, there were no significant differences between the radio group and the regular lecture group. However the attitudes of the students toward these two types of instruction were quite different. Those who took the course by means of the radio procedure were generally rather negative in their attitudes toward this method of instruction.     

The Relative Effectiveness of the Reflective and the Lecture Approach Methods on the Achievement of High School Social Studies Students

The aim of this study was to find out whether the achievement of high school social studies students differs significantly according to whether they are taught by the reflective teaching method or the lecture approach method. A stratified random sample of 215 year three social studies students was randomly assigned to two groups: 107 students into the reflective approach group and 108 into the lecture approach group. An achievement test was used as the pre‐ and the post‐test. The means of the aggregate mean performance scores were compared by the use of Student's t‐test. There was no significant difference between the two groups on the pre‐test scores but there was a significant difference between the post‐test scores, in favour of the group taught by the reflective approach method.     

Hypertext computer study guides and the social studies achievement of students with learning disabilities, remedial students, and regular education students

Hypertext is a relatively new term for today's teachers, who work hard to stay abreast of the quickly changing field of computer technology in education. Hypertext as an educational tool is very different from traditional computer-assisted instructional software, offering the reader immediate access through its computer format to supplemental information. Two related studies were conducted to design and field-test hypertext computer study guides. In Study 1, 40 students (10 with learning disabilities, 15 remedial, and 15 regular education) worked in three different treatment groups (lecture, lecture/computer study guide, and computer study guide). Study 2 involved the five lowest achieving students (two with learning disabilities and three remedial) from Study 1 in an A-B-A design. Results indicated that (a) the computer study guide treatment was as effective as lecture, (b) the lecture/computer study guide treatment was as effective as lecture, (c) posttest scores were higher for the computer study guide group, and (d) retention test scores were higher for the computer study guide group.     

Verbal retelling abilities in adolescents with and without language-learning disabilities for social studies lectures

Verbal retelling abilities for social studies lectures were examined and compared in 20 adolescent boys, ages 12-5 to 14-7, with language-learning disabilities (LLD) and 29 with normal language abilities (NL). Participants viewed one videotaped social studies lecture with a comparison expository discourse structure and one with a causation discourse structure. Following each lecture presentation, participants verbally retold the lecture. Results of several repeated-measures analyses of variance indicated that the group with LLD produced a significantly smaller number of T-units, subordinate clauses, subordinate clauses per T-unit, T-units per second, lecture components per second, and percentage of lecture components in their retellings, compared with the group with NL, regardless of lecture type. Both groups produced a significantly greater number of T-units and subordinate clauses for the comparison lecture. By contrast, both groups recalled a significantly greater number of lecture components per T-unit and per second for the causation lecture. Results indicated that the comparison discourse structure facilitated more substantive and elaborate retellings, whereas the causation discourse structure facilitated more efficient, concise retellings in both groups. Research and instructional implications are discussed.     

The effects of concept and vee mappings under three learning modes on Jamaican eighth graders’ knowledge of nutrition and plant reproduction

The first objective of this study was to investigate if the experimental students’ post‐test knowledge of nutrition and plant reproduction would be improved more significantly than that of their control group counterparts based on their treatment, attitudes to science, self‐esteem, gender and socio‐economic background. Treatment involved teaching the experimental students under three learning modes—pure cooperative, cooperative–competitive and individualistic whole class interpersonal competitive condition—using concept and vee mappings and the lecture method. The control groups received the same treatment but were not exposed to concept and vee mappings. This study’s second objective was to determine which of the three learning modes would produce the highest post‐test mean gain in the subjects’ knowledge of the two biology concepts. The study’s sample comprised 932 eighth graders (12–13‐year‐olds) in 14 co‐educational comprehensive high schools randomly selected from two Jamaican parishes. An integrated science performance test, an attitudes to science questionnaire and a self‐esteem questionnaire were used to collect data. The results indicated that the experimental students (a) under the three learning modes, (b) with high, moderate, and low attitudes to science, and (c) with high, moderate, and low self‐esteem, performed significantly better than their control group counterparts. The individualist whole class learning mode engendered the highest mean gain on the experimental students’ knowledge, while the cooperative–competitive learning mode generated the highest mean gain for the control group students.     

A teachable-agent-based game affording collaboration and competition: evaluating math comprehension and motivation

This paper presents an educational game in mathematics based on an apprenticeship model using a teachable agent, as well as an evaluative study of how the game affects (1) conceptual understanding and (2) attitudes towards mathematics. In addition, we discuss how collaborative and competitive affordances of the game may affect understanding and motivation. 19 students played the game in pairs once a week during math lessons for 7?weeks (the game-playing group) while another 19 students followed the regular curriculum (the control group). Math comprehension scores increased significantly for the game-playing group but not the control group (p?<?0.05). However, there was no significant difference in attitude change between the two groups. Post hoc analyses indicated that game-playing primarily affected students?? confidence in explaining math to a peer, but not their enjoyment of doing so. Collaborative and competitive activities seem to carry a strong motivational influence for students to play the game.     

Experimental Effects of Student Evaluations Coupled with Collaborative Consultation on College Professors’ Instructional Skills

This experimental study concerned the effects of repeated students’ evaluations of teaching coupled with collaborative consultation on professors’ instructional skills. Twenty-five psychology professors from a Dutch university were randomly assigned to either a control group or an experimental group. During their course, students evaluated them four times immediately after a lecture (class meeting in which lecturing was the teaching format) by completing the Instructional Skills Questionnaire (ISQ). Within 2 or 3 days after each rated lecture, the professors in the experimental group were informed of the ISQ-results and received consultation. Each consultation, three in total, resulted in a plan to improve their teaching for the next lectures. Controls received neither their ISQ-results nor consultation during their course. Multilevel regression analyses showed significant differences in ISQ-ratings in the experimental group compared to the control group, specifically on the instructional dimensions Explication, Comprehension and Activation. In addition, the impact of each of the three consultations plus differences between targeted versus non targeted dimensions were analyzed. This study complements recent non-experimental research on a collaborative consultation approach with experimental results in order to provide evidence-based guidelines for faculty development practices.     

Food Safety and Regulation: Evaluation of an Online Multimedia Course

ABSTRACT: The effectiveness of, and student attitudes toward, an online Food Safety and Regulation course (WEB) were compared with lecture (LECTURE) and combined lecture/online (COMBINED) courses. All students took identical pre-tests, post-tests, and attitude assessments. No significant differences were detected in pre-test scores. Post-test results for WEB, LECTURE, and COMBINED groups were 65.9±3.02, 67.1±2.62, and 73.5±2.59 (mean±SEM), respectively. After controlling for the pretest, the COMBINED score was significantly higher ( P < 0.05) than the LECTURE and WEB scores. Some student attitude scores in the LECTURE and COMBINED groups were better than the WEB group. The results indicate that students perform as well in the Web-based course as the lecture-based course and that student performance is maximized by combining online and lecture methods.     

The Effect of Instructional Modality and Prior Knowledge on Learning Point Group Symmetry

Many topics in chemistry are difficult for learners to understand, including symmetry. Reasons for this difficulty include its multi-level content, instructional methodologies utilized, and learner variables. This study examined the effect of initial instructional modality and prior knowledge on learning of point group symmetry. Forty-four students in a sophomore-level inorganic chemistry class at a small private university were divided by pre-selected lab groups into two groups, lecture and computer, for introductory information about point group symmetry. Both groups had low prior knowledge of symmetry elements although the lecture group had significantly higher knowledge than the computer group. After initial instruction, the lecture group scored significantly higher than the computer group on a point group assessment, even when prior knowledge was controlled. A second assessment, given after both groups had follow-up information from computer courseware, showed no significant difference between the groups. The computer group significantly improved between the two assessments, the lecture group did not. At the end-of-the semester post-test showed no significant difference between the two groups, although only 50% of the students in each group achieved mastery. Factors affecting the significant improvement of the low prior knowledge, computer group were examined and recommendations for future research provided.     

The effect of field dependence and outline condition on learning high- and low-structure information from a lecture

Sixty-eight college students participated in the current research investigating the effects of an outline on field-dependent and field-independent students' learning of structurally important and less important information from a lecture. The lecture involved a 20-minute videotaped presentation on bird migration. Learning was assessed using a free recall task 10 minutes after the lecture (immediate recall) and both free recall and probed recall tasks one week after the lecture (delayed recall). Data were analyzed using mixed factorial ANOVAs. Results indicated that the outline assisted the field-dependent students in recall of high structure information and field-independent students in recall of low structure information. Performance of field-dependent and field-independent students was equivalent on probed recall of low-structure information, but significant differences were found on the free recall of low-structure information. It is proposed that these differences are attributable to superior organizational abilities of the field-independent students and to use of the outline as a guide for retrieval.     

Cognitive and Psychological Factors Underlying Secondary School Students' Feelings Towards Group Work

ABSTRACT Two-hundred-and-ninety secondary school students from Years 7, 9 and 11 completed questionnaires relating to motivational goals, metacognitive awareness, need for affiliation, social anxiety and feelings towards group work. Factor analysis revealed three attitudes towards participation in group work: a preference for group environments, a preference for individual work environments, and a sense of discomfort in group environments. Students reporting a preference for group work also indicated higher levels of sociability, lower levels of social anxiety, stronger mastery and performance goals, and greater levels of metacognitive awareness. Students expressing a preference for individual work environments reported lower levels of sociability and higher levels of social anxiety, but were not differentiated on any of the cognitive measures. Students reporting discomfort in groups similarly reported enhanced levels of social anxiety combined with lower levels of sociability, but also indicated lower levels of metacognitive awareness. Results are discussed in the context of current theoretical and empirical work on group-based learning.     

Vibrant student voices: exploring effects of the use of clickers in large college courses

Teachers have begun using student response systems (SRSs) in an effort to enhance the learning process in higher education courses. Research providing detailed information about how interactive technologies affect students as they learn is crucial for professors who seek to improve teaching quality, attendance rates and student learning. This study investigates social, educational and emotional effects of the use of SRSs – clickers – at the University of Colorado at Boulder. Methods include participant observation, survey data from over 2000 students enrolled in three semesters of General Chemistry, and in‐depth interviews exploring the nature of student experiences with clickers. Findings suggest clickers significantly alter the social environment experienced by students as they learn. Clickers create learning environments characterized by greater activity, cooperation and conceptual application compared to traditional, lecture‐based instruction. Gender also influences whether students choose to work with peers during clicker‐prompted interaction. The qualitative analysis presented here extends upon themes identified in existing research on the effects of clickers for learning.     

Encouraging Counselor Trainee Affective Group Behavior by Social Modeling

Can the planned social modeling of affective, group-focused, personal responses significantly increase such group behaviors in counselor trainees? In the study reported here 32 counselor trainees were randomly assigned to four practicum discussion groups: two video social model groups, one video lecture group, and one discussion group (eight in each group). Pre- and post-response frequencies were analyzed from audiotapes of the counseling groups to study type of delivery, content, process, and focus. Social modeling treatment significantly increased the response frequencies on all measures, while insignificant changes were generally found for the video lecture and group discussion treatments. Questions about social modeling variables and the usefulness of planned modeling in training are considered.     

Saudi arabian students' chemistry achievement and science attitudes stemming from lecture-demonstration and small group teaching methods

The study was designed to determine differences between two chemistry teaching methods on students' chemistry achievement and attitudes toward science. The two methods were the large lecture-demonstration and small-group laboratory approaches to teaching chemistry. The subjects were 74 eleventh-grade Saudi Arabian students randomly assigned to the two treatment groups. The findings revealed that the small-group laboratory students exhibited significantly greater chemistry achievement than students in the lecture-demonstration group on both immediate and delayed posttests. The results also indicated that students taught by the lab approach possessed more desirable attitudes toward science.     

Individual attitudes and social influences on college students’ intent to participate in study abroad programs

Participation in study abroad programs (SAPs) is widely viewed as offering important professional and personal benefits for college students. This study applies the Theory of Reasoned Action [Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice-Hall.] as a theoretical framework to better understand how undergraduate students’ individual attitudes and subjective norms from three social groups (family, friends and professors) impact their intent to participate in SAPs. Surveys were conducted at three public and private universities in the USA and Taiwan. The results suggest that both individual attitudes and subjective norms are influential factors for college students, and the effects are dependent on the type of SAPs. The current research offers several additions to the SAPs literature. Also, the results offer new insights for higher education and other institutional managers for increasing student participation in SAPs.     

考试模式对考生英语成绩的影响研究———英语机考与纸考成绩的实证对比分析

为探明考试模式对考试成绩的影响,本研究抽取了石河子大学大学一年级410名非英语专业学生,将其分成两组,同时以机考和纸考形式进行内容相同的英语测试。通过对比分析两组考生成绩发现:不同的考试模式对样本学生的总成绩没有显著性影响。纸考组主观题成绩低于机考组,且差异显著,说明考试模式对考生(尤其是英语能力较弱的考生)的主观题产生了影响;两组考生的客观题成绩没有显著差异;纸考组英语水平较高的学生听力成绩高于机考组,且差异显著;不同的考试模式有时会对学生的阅读成绩有显著性影响。     

A Research Preparatory Program for First-Year College Students: Student Selection and Preparation Lead to Persistence in Research

Undergraduate research experiences may increase persistence in STEM majors. We describe a research program that targets first-year students selected for their curiosity and attitudes towards science. We explain the implementation of the program over 3 years and present evaluation data using a group of matched controls. Participants and controls pursued STEM degrees at equivalent rates, but participants were significantly more involved in research. Initial laboratory interest and mentor pairing may have played a role in this finding. Female participants, particularly those with male laboratory mentors, engaged in more research than men.     

Iranian university students’ experiences of and attitudes towards alternatives in assessment

This study investigated the effect of assessment type (self vs. peer vs. teacher) on university students’ academic achievement and students’ attitudes toward them. In the main study, 82 undergraduate English-as-a-Foreign-Language students in four classes at three universities in Iran were randomly assigned into one of self-, peer- and teacher-assessment or control groups. A pre-test was designed to measure students’ initial knowledge in the subject Teaching Methods. Then experimental groups were subjected to one of the assessment types; however, the control group received no intervention. Thirty-eight students from experimental groups completed an attitude questionnaire. A similarly designed follow-up study was conducted with two classes of BA Chemistry students taking a General English course at Urmia University. The application of one-way analysis of covariance on the main study post-test data indicated differences in performances of all groups, with peer-assessment group performing the best. Quantitative and qualitative analyses indicated that both self- and peer-assessment, as well as the teacher-assessment group, had positive attitudes toward their assessment experiences. The application of one-way analysis of variance on replication study data showed that the experimental group significantly outperformed the control group on the post-test and that students in the former group had positive attitudes toward self-assessment.     

Inquiry-Based Laboratory Activities in Electrochemistry: High School Students’ Achievements and Attitudes

This study aimed to investigate the effects of inquiry-based laboratory activities on high school students’ understanding of electrochemistry and attitudes towards chemistry and laboratory work. The participants were 62 high school students (average age 17 years) in an urban public high school in Turkey. Students were assigned to experimental (N?=?30) and control groups (N?=?32). The experimental group was taught using inquiry-based laboratory activities developed by the researchers and the control group was instructed using traditional laboratory activities. The results of the study indicated that instruction based on inquiry-based laboratory activities caused a significantly better acquisition of scientific concepts related to electrochemistry, and produced significantly higher positive attitudes towards chemistry and laboratory. In the light of the findings, it is suggested that inquiry-based laboratory activities should be developed and applied to promote students’ understanding in chemistry subjects and to improve their positive attitudes.