Evaluation of an adaptive tutorial supporting the teaching of mathematics

ABSTRACT

Adaptive tutorials enable engaged, personalised and interactive online learning that includes instant adaptive feedback. By integrating an adaptive tutorial into a large and diverse engineering mathematics course, we explored its potential to support and guide students’ learning from afar. The aim of this study was to assess whether students provided with an adaptive tutorial, could benefit from its use and whether they would engage in and take responsibility for their learning. Comparisons were made between students who did and did not use the tutorial. Quantitative and qualitative data analyses determined the impact of including an adaptive tutorial in a blended learning environment, where 58% of students engaged with the tutorial and 74% of them completed it. Improved confidence and understanding was reported by 98% of the participants. A comparison of examination results indicated that median scores for students who utilised the tutorial were significantly higher than those who did not.     

Effects of group size and advance organizers on learning parameters when using microcomputer tutorials in kinematics

The purpose of this study was to investigate how the use of CAI tutorial programs, incorporating advance organizers and involving various sizes of groups of subjects, would affect students' achievement scores, retention scores, and rates of learning. Used as subjects were 100 suburban high school physics students running interactive tutorial physics programs focusing on strobe simulation and displacement-time and velocity-time graphs. For fifty students (experimental group) an advance organizer program preceded each tutorial. The remaining fifty students (control group) had an advance non-organizer program preceding each tutorial. While pursuing the tutorials the students worked individually or together in groups of two, three, or four. Five days were allocated for the students to repeat the four tutorials until 90% competency level was attained. Achievement and retention were measured by individually administered paper-pencil teacher-made tests sampling the content of all four tutorials. Rate of learning was determined for groups by the number of times the first three tutorial programs were executed in order to attain 90% competency. In the two-way analysis of variance the only significant result at the 0.05 level pertained to group size. Results of the Tukey Test revealed that students working in groups of three and four on CAI tutorials had significantly better rates of learning than students working alone. No significant differences in achievement or retention were observed for the various groups. The implications for using CAI tutorials in physics point to grouping students in fours as a time saving and economic method of presenting material without significant loss of achievement or retention.     

Conceptions of learning science among high school students in Taiwan: a phenomenographic analysis

Educators and psychologists have evidence that students’ conceptions of learning have a profound influence on the learning process, and thus are related to learning outcomes. The purpose of this paper was to explore the conceptions of learning science held by 120 Taiwanese high school students. The interview data gathered from these students, analysed by a phenomenographic method, revealed seven categories of conceptions of learning science, including: learning science as memorizing, preparing for tests, calculating and practising tutorial problems, the increase of knowledge, applying, understanding, and seeing in a new way. The educational contexts or curricular programmes in which these high school students enrolled also played a role in their conceptions of learning science. This study finally proposed a framework to describe the variations of the conceptions of learning science, consisting of the following features: the forms of knowledge acquisition, motivational orientations, and standards of evaluating learning outcomes. How to change students’ unfruitful conceptions of learning science was also discussed.     

Student Views of Concept Mapping Use in Introductory Tertiary Biology Classes

Introductory tertiary level science classes (i.e., at the university or post-compulsory school level) including those for biology face increasing diversity in intake. Previous research has indicated university level teachers assume a certain level of prior knowledge which may or may not be possessed by such students. This report focuses on the use of concept mapping in introductory biology tutorial classes. The research findings suggest that the students found the use of concept mapping enjoyable and that it can enhance meaningful learning for topics that require students to link concepts.     

Mastering cognitive development theory in computer science education

To design an effective computer science curriculum, educators require a systematic method of classifying the difficulty level of learning activities and assessment tasks. This is important for curriculum design and implementation and for communication between educators. Different educators must be able to use the method consistently, so that classified activities and assessments are comparable across the subjects of a degree, and, ideally, comparable across institutions. One widespread approach to supporting this is to write learning objects in terms of Bloom’s Taxonomy. This, or other such classifications, is likely to be more effective if educators can use them consistently, in the way experts would use them. To this end, we present the design and evaluation of our online interactive web-based tutorial system, which can be configured and used to offer training in different classification schemes. We report on results from three evaluations. First, 17 computer science educators complete a tutorial on using Bloom’s Taxonomy to classify programming examination questions. Second, 20 computer science educators complete a Neo-Piagetian tutorial. Third evaluation was a comparison of inter-rater reliability scores of computer science educators classifying programming questions using Bloom’s Taxonomy, before and after taking our tutorial. Based on the results from these evaluations, we discuss the effectiveness of our tutorial system design for teaching computer science educators how to systematically and consistently classify programming examination questions. We also discuss the suitability of Bloom’s Taxonomy and Neo-Piagetian theory for achieving this goal. The Bloom’s and Neo-Piagetian tutorials are made available as a community resource. The contributions of this paper are the following: the tutorial system for learning classification schemes for the purpose of coding the difficulty of computing learning materials; its evaluation; new insights into the consistency that computing educators can achieve using Bloom; and first insights into the use of Neo-Piagetian theory by a group of classifiers.     

Things I've Learned from My Pupils

In this article, the authors, students in an instructional technology graduate course, describe a process to create an online tutorial for teaching software. They created the tutorial for a cyber school's use. Five tutorial modules were linked together through one menu screen using the MenuBuilder feature in the Adobe Captivate program. The separate modules allowed the cyber school's students to customize their learning, whereas the entire tutorial allowed teachers to concentrate class time on teaching lesson objectives, rather than software.     

The Interaction Between Methods of Instruction and Individual Learning Style

Individual learning differences under competitive and co‐operative methods of instruction were investigated. It was hypothesised that: (a) students would learn more when the method was matched to the student's preference and that (b) the co‐operative (and tutorial) methods would promote more favourable attitudes toward peer students. One hundred and thirty‐two female students participated in the experiment. In the first part of the experiment they were asked to state their preferences and in the second part, half of the students received their preferred method of instruction. Both hypotheses were confirmed. In addition, it was found that students who preferred competition had better initial knowledge of the material, learned more during the learning experience and held somewhat less favourable attitudes toward their peers. The analysis of the results suggests that the interaction between goal, individual, subject‐matter and learning methods needs to be taken into account when determining an optimal method of instruction.     

A community of inquiry-based framework for civic education at Universitas Terbuka,Indonesia

This study focused on the civic education course at Universitas Terbuka (UT). Its purpose was to design a new approach for the online tutorial for the course by analyzing the literature related to online and distance education and investigating participant feedback on the current offering of the course and tutorial, which is a compulsory course in all programs at UT. The study draws from the community of inquiry framework, which promotes a social constructivist approach as well as teaching about democracy by example. This model is intended to create meaningful learning experiences for students in a reformulated civic education course, in which they would learn to think critically through interacting with classmates, experiencing collaborative learning, and supporting fellow students in learning activities and processes. In this model, learning is seen as occurring within the community through the interaction of social presence, cognitive presence, and teaching presence where, students are able to develop civic competences, namely civic knowledge, civic skills, and civic dispositions, as well as experience a democratic interaction that forms the core of civic interactions in a democratic society.     

亲产业型本科生导师制及其应用探索

针对我国现有本科生导师制经验难以在各院校间形成示范模式的问题,考虑到以青年教师为主的导师群体在指导工作中的自我提高需求,从高等教育服务产业的目标出发,提出亲产业型本科生导师制概念,并对其应用模式进行试验探索。试验结果表明:亲产业型本科生导师制对于本科生学习能力、成绩、产业认知、职业信心和学涯规划等方面都具有显著的促进作用,同时有利于青年教师在指导本科生的同时获得锻炼和成长,是一种师生双方都能获益的人才培养制度。     

Increasing international and domestic student interaction through group work: a case study from the humanities

This article explores the use of group work strategies to increase student interaction and learning. Despite the growing linguistic and cultural diversity in tertiary institutions, there is strong evidence of minimal interaction between ‘domestic’ and ‘international’ students in classrooms and in wider university contexts. This study investigates the implementation of teaching and learning strategies in an undergraduate class comprising domestic and international students from Education and Arts. The strategies relate to in-class group work, tutorial groups and assessment design. The findings indicate greater class interaction, higher satisfaction ratings and better learning outcomes as a result of the strategies. The article argues for three key features underpinning the pedagogy: where international students can work from a position of power equality in class, where both groups of students can enact the role of ‘experts’ and where support in language and learning how to learn is embedded in assessment and outcomes.     

Study to minimize learning progress differences in software learning class using PLITAZ system

This study developed a system using two-phased strategies called ??Pause Lecture, Instant Tutor-Tutee Match, and Attention Zone?? (PLITAZ). This system was used to help solve learning challenges and to minimize learning progress differences in a software learning class. During a teacher??s lecture time, students were encouraged to anonymously express their desire to pause the lecture, or to take a short break, in order to catch up with a teacher??s lecture. A simple proportion of one-third of the class was found to be a suitable pause-lecture threshold to prevent learning progress differences from becoming too great as well as to provide enough peer tutorial resources. During students?? practice time, an instant tutor-tutee match strategy extended tutorial resources, which took 60% workload from the teacher. Meanwhile, the attention zone (AZ) strategy helped the teacher to identify students with low levels of learning progress, as AZ students who needed more attention. It was found that AZ student numbers had a negative relation to overall learning achievement. Furthermore, 49% of the identified AZ students who received PLITAZ strategies experienced improved learning progress over identified non-AZ students. Overall learning progress differences were significantly minimized with the Instant Tutor-Tutee Match and Attention Zone strategies.     

Enabling meaningful learning through Web-based instruction with occupational therapy students

This paper explores the design of a Web-based tutorial for Activity Analysis offered within an undergraduate course of occupational therapy and how its design features influenced meaningful learning from the students’ perspective. This tutorial, using a case-based format, offers a learner-directed approach to students and the application of Activity Analysis, a clinical practice tool. The design is based on principles of meaningful learning for on-line instruction (Jonassen, Educational Technology, 35, 60–63, 1995) and instructional theories. Analysis of feedback from learners identifies the salient attributes of the tutorial on meaningful learning.     

Attitudes to computer-assisted learning amongst business and management students

Computer‐assisted learning (CAL) is becoming ever more important as a method of teaching and facilitating learning in an increasingly overburdened higher education sector in the UK. A number of authors have made pleas for more evaluation and research in the area of CAL. This study set out to evaluate the attitudes to CAL amongst over 300 business and management undergraduates using a questionnaire survey. The survey revealed a positive disposition towards CAL irrespective of age, gender or educational background. In addition respondents were asked to compare the features of CAL with those of other more traditional methods of teaching and learning. Two factors were identified, labelled CAL ‘instructional’ features and CAL ‘tutorial’ features. The instructional features of CAL were rated more highly than its tutorial features. Respondents rated CAL as better than traditional methods in terms of its instructional features and about the same as traditional methods in terms of its tutorial features. Younger respondents rated the instructional features of CAL more highly than did the older respondents. The findings were discussed in terms of their implications for the use of CAL in an expanding system of mass higher education.     

Chris Dede's response

Abstract

The Division of Criminal Justice at the Florida Gulf Coast University (FGCU) offers an entire criminal justice degree program via distance learning, principally through computer‐based Internet courses. During the Spring 1998 semester, an Internet tutorial was provided during the first week of classes to students in all Internet courses in the program. Its purpose was to familiarize students with basic computer skills and Internet usage. This article focuses on the use of the Internet tutorial in Web‐based courses, including an explanation of the tutorial, a discussion of its benefits for students and faculty, and implications for future computer‐based Internet courses.     

Using Assessment to Induct Students and Staff into the PBL Tutorial Process

The introduction of a new problem-based Graduate Medical Course with over 230 students and more than 200 staff required a systematic process for induction into the PBL philosophy and tutorial process. The 4SAT (4 Step Assessment Task) was designed for use as an instrument for formative and summative assessment of reasoning ability, elements of the PBL tutorial (group) process and individual learning outcomes. The instrument was developed through evaluative cycles based upon staff and student feedback, reflection and peer review. The 4SAT has face validity with the learning process and emphasises reasoning and integration of knowledge. An unexpected out come of its development was its use as a powerful tool to induct staff and students into the PBL group processes, scaffold development of hypothetico-deductive reasoning and provide guidance on the depth and breadth of learning expected in the course.     

Web-based training in child maltreatment for future mandated reporters

OBJECTIVE: The purpose of this study was to determine the effectiveness of providing Web-based information about child maltreatment to undergraduate education and graduate counseling students. The goal was to determine, via an objective test, whether students would gain information about abuse signs and symptoms and reporting laws. METHODS: One hundred and five education and counseling students enrolled in a large, urban, ethnically diverse, university participated in the Web-based training tutorial. Their participation was part of their course requirements. They logged into the Web site using their university identification number and password. The pre and post-tests could only be taken once. Completion of the tutorial took on average 1 hour. RESULTS: Findings indicated that students' post-test scores were significantly higher than pretest scores on an examination measuring knowledge of child maltreatment signs, symptoms, and reporting procedures. Participants rated their knowledge of child maltreatment significantly higher after taking the tutorial and reported enjoying the self-paced learning of the Web format. CONCLUSION: Overall, this study demonstrated the effectiveness of a brief on-line tutorial to disseminate information related to child abuse identification and reporting to future mandated reporters. In approximately 1 hour of on line training, participants gained an increase in knowledge of reporting procedures. Utilization of Web-based training is proposed as an effective and convenient method of instruction particularly for child abuse issues.     

Library Research Success: Designing an Online Tutorial to Teach Information Literacy Skills to First-Year Students

This article reports on a collaborative effort recently undertaken between librarians and faculty at Toronto's Seneca College to develop and implement an online, interactive tutorial for first-year business students enrolled in the College's School of Business Management. The concept for this tutorial arose when library management was approached by the Acting Chair from the College's School of Business Management to partner with them in developing a library tutorial that would be incorporated into the curriculum of this newly created course, and that would accommodate its over 600 first-year students. Library management agreed, and proposed developing a self-paced online, interactive tutorial that would utilize current Web-based technology. The primary pedagogical goals were to increase student knowledge of library resources in general, and business resources in particular, and to increase levels of information literacy and basic research skills. With the help of the College's Centre for New Technology and the Centre for Professional Development, the result was a five-module tutorial entitled Library Research Success that, in addition to its main content, also incorporated hands-on exercises at the end of each module, live connections to the Library's Web site and electronic databases, as well as two assignments, which were submitted electronically to professors at the end of the tutorial by each student, and which composed 25 percent of their final mark. Feedback from both faculty and students has been overwhelmingly positive, and efforts are currently underway to adapt this tutorial to meet the needs of other student groups within Seneca College.     

Online tutorial support in open and distance learning: students' perceptions

The Open University of Hong Kong (OUHK) offers 199 courses with online features to enhance the distance learning environment. The university has arranged these courses to provide students with greater flexibility in interacting with tutors, classmates, and the content itself. Integral to learner flexibility online is access, valuing computers and online learning, endorsement, and language proficiency. The current investigation attempts to explore these issues by examining the perceptions of OUHK students enrolled in courses with online tutorial supports. The methods of questionnaire survey and semi‐structured interview were employed. Surveyed using multistage stratified sampling technique were 449 OUHK students enrolled in 18 upper level courses (9 English, 9 Chinese) at the OUHK. Forty‐two students were randomly selected for a follow‐up interview. Five major topics were explored including: (1) accessing the Internet; (2) perceptions of technology; (3) rationale for using the Internet in course work; (4) learning strategies used by the tutor online; and (5) perceptions of the online tutorial support.     

Development of a support environment for first year students taking materials science/engineering

This paper is based on the experience acquired in teaching materials science/engineering to first year university students. It has been observed that students struggle with some of the fundamental materials concepts addressed in the module/course. This applies to delivered lectures but extends to the incorporation of tutorial sessions provided after lectures. Moreover, when students miss a lecture or seminar the acquisition and application of knowledge and concepts becomes problematic. Consequently, or perhaps inevitably, these students perform poorly in their assessments and their motivation for the subject suffers. A careful analysis of this situation and of the nature of interaction and engagement was performed to gain an insight into the reasons for this lack of performance. A common factor is that students do not dedicate sufficient time for reading and consolidation using the chapters/sections prescribed after each topic. They also do not attempt solving tutorial problems outside the formal contact hours. This reflection and personal evaluation is difficult to administer, resource intensive and yet potentially enables each student to monitor and evaluate their own learning and understanding. A multimedia learning technology‐based environment was created in which students could engage. This was located within the University of Wolverhampton Virtual Learning Environment (VLE) called WOLF. The students were able to progress independently but with access to tutor and peer support, help and advice. The use of non‐text animations and structures was used and seen as fundamental by the students in enhancing the taught course and in developing a deeper understanding of complex atomic and crystal structures.