Effectiveness of software training using simulations: An exploratory study

This study was designed to explore the effectiveness in student performance and confidence of limited and full device simulators. The 30 employees from an information technology company who participated in this study were assigned to one of three groups. Each group received practice for learning a complex software procedure using traditional interactions, a limited device simulator, or a full device simulator. A training portal was created for each practice method. Measurements of performance included the number of times the participants repeated the assigned practice activity, the total time required to complete the procedure, a test score representing the number of mistakes made in the 20‐step procedure, and the average time between mouse clicks as they selected items from menus or clicked buttons. Preliminary results indicated that a limited device simulator appears to be as effective as a full device simulator. Recommendations for further research and limitations of the study are also addressed.     

The Effects of a Functional Three-dimensional (3D) Printed Knee Joint Simulator in Improving Anatomical Spatial Knowledge

In recent decades, three-dimensional (3D) printing as an emerging technology, has been utilized for imparting human anatomy knowledge. However, most 3D printed models are rigid anatomical replicas that are unable to represent dynamic spatial relationships between different anatomical structures. In this study, the data obtained from a computed tomography (CT) scan of a normal knee joint were used to design and fabricate a functional knee joint simulator for anatomical education. Utility of the 3D printed simulator was evaluated in comparison with traditional didactic learning in first-year medical students (n = 35), so as to understand how the functional 3D simulator could assist in their learning of human anatomy. The outcome measure was a quiz comprising 11 multiple choice questions based on locking and unlocking of the knee joint. Students in the simulation group (mean score = 85.03%, ±SD 10.13%) performed significantly better than those in the didactic learning group, P < 0.05 (mean score = 70.71%, ±SD 15.13%), which was substantiated by large effect size, as shown by a Cohen’s d value of 1.14. In terms of learning outcome, female students who used 3D printed simulators as learning aids achieved greater improvement in their quiz scores as compared to male students in the same group. However, after correcting for the modality of instruction, the sex of the students did not have a significant influence on the learning outcome. This randomized study has demonstrated that the 3D printed simulator is beneficial for anatomical education and can help in enriching students’ learning experience.     

A problem posing-based practicing strategy for facilitating students’ computer programming skills in the team-based learning mode

Computer programming is a subject that requires problem-solving strategies and involves a great number of programming logic activities which pose challenges for learners. Therefore, providing learning support and guidance is important. Collaborative learning is widely believed to be an effective teaching approach; it can enhance learners’ social interaction and offer a learning environment which provides rich learning experiences. However, the social interaction in collaborative learning does not occur automatically. Without proper guidance strategies or supporting tools for collaborative learning, the learning effects can be disappointing. To solve such a problem, a problem posing-based practicing strategy was proposed to support the development of a collaborative learning activity in a computer programming practice course. The students were guided to raise computer programming problems to boost the discussion among team members. The problems raised in each team were then exchanged and solved by another team to examine the coding and to provide feedback. To investigate the effectiveness of the proposed approach, an experiment was conducted in a C# programming course. Two classes of students from a university participated in the experiment. One class with 25 students was randomly assigned as the experimental group, and learned with a collaborative learning activity using the problem posing-based practicing strategy; the other class with 28 students was the control group, which learned with a conventional collaborative learning activity. The results show that the proposed strategy benefited the students in terms of improving their learning achievement, in particular, their programming skills. Moreover, it was found that the students who learned with the proposed approach had higher self-efficacy and lower cognitive load than those who learned with the conventional collaborative learning approach.     

Using software simulators to enhance the learning of digital logic design for the information technology students

Making the students understand the theoretical concepts of digital logic design concepts is one of the major issues faced by the academics, therefore the teachers have tried different techniques to link the theoretical information to the practical knowledge. Use of software simulations is a technique for learning and practice that can be applied to many different disciplines. Experimentation of different computer hardware components/integrated circuits with the use of the simulators enhances the student learning. The simulators can be rather simplistic or quite complex. This paper reports our evaluation of different simulators available for use in the higher education institutions. We also provide the experience of incorporating some selected tools in teaching introductory courses in computer systems. We justified the effectiveness of incorporating the simulators into the computer system courses by use of student survey and final grade results.     

A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students

Educational games are increasingly used in informal and formal educational settings for promoting active learning and gaining students’ interest in cognitively demanding subjects, such as programming. However, empirical studies that investigate the true impact of educational games on teaching and learning programming, especially to small aged students, are limited. This article presents the results of a pilot study that utilized the educational game Run Marco for teaching basic programming concepts to primary school students. Students’ performance was studied through specially designed worksheets, while their acceptance of the intervention was evaluated through a questionnaire that was based on the principles of the Technology Acceptance Model (TAM). The results of the pilot study showed that the educational game supported students in comprehending basic programming concepts, while the results regarding the acceptance of its usage in the learning process were quite positive. However, the game did not succeed in raising students’ interest as expected and further research is necessary in order to study the reasons for this fact and make informed choices on designing and utilizing such games.     

A blended learning approach for teaching computer programming: design for large classes in Sub-Saharan Africa

The challenge of teaching programming in higher education is complicated by problems associated with large class teaching, a prevalent situation in many developing countries. This paper reports on an investigation into the use of a blended learning approach to teaching and learning of programming in a class of more than 200 students. A course and learning environment was designed by integrating constructivist learning models of Constructive Alignment, Conversational Framework and the Three-Stage Learning Model. Design science research is used for the course redesign and development of the learning environment, and action research is integrated to undertake participatory evaluation of the intervention. The action research involved the Students’ Approach to Learning survey, a comparative analysis of students’ performance, and qualitative data analysis of data gathered from various sources. The paper makes a theoretical contribution in presenting a design of a blended learning solution for large class teaching of programming grounded in constructivist learning theory and use of free and open source technologies.     

Investigating the role of computer‐supported annotation in problem‐solving‐based teaching: An empirical study of a Scratch programming pedagogy

For more than 2 years, Scratch programming has been taught in Taiwanese elementary schools. However, past studies have shown that it is difficult to find appropriate learning methods or tools to boost students’ Scratch programming performance. This inability to readily identify tutoring tools has become one of the primary challenges addressed in Scratch programming studies. To cope with this problem, we propose an innovative approach, which combines an Annotation‐based Scratch Programming (ASP) tool with the problem‐solving‐based teaching approach in Scratch programming pedagogy. The ASP tool was developed to enable students to create, review and share Scratch programming and homework annotations. In a quasi‐experimental study, we have evaluated Scratch programming pedagogy at a North Taiwanese elementary school to investigate the effects of instructional‐tools‐supported programming instructional modes on Scratch programming performance. The experimental results show that students who received ASP tool support in conjunction with a problem‐solving‐based teaching approach performed significantly better than the other groups. Based on our findings, the innovative approach was believed to play an important role in improving the learning patterns of younger pupils. Therefore, we suggest that teachers consider incorporating the innovative method into their teaching environments in order to boost students’ learning achievements in the area of Scratch programming and the subsequent learning process.     

Enhanced teaching and student learning through a simulator-based course in chemical unit operations design

This paper illustrates a teaching technique used in computer applications in chemical engineering employed for designing various unit operation processes, where the students learn about unit operations by designing them. The aim of the course is not to teach design, but rather to teach the fundamentals and the function of unit operation processes through simulators. A case study presenting the teaching method was evaluated using student surveys and faculty assessments, which were designed to measure the quality and effectiveness of the teaching method. The results of the questionnaire conclusively demonstrate that this method is an extremely efficient way of teaching a simulator-based course. In addition to that, this teaching method can easily be generalised and used in other courses. A student's final mark is determined by a combination of in-class assessments conducted based on cooperative and peer learning, progress tests and a final exam. Results revealed that peer learning can improve the overall quality of student learning and enhance student understanding.     

Is pair programming more effective than other forms of collaboration for young students?

This study investigates differences between collaboration methods in two summer enrichment classes for students entering the sixth grade. In one treatment, students used pair programming. In the other treatment, students engaged in frequent collaboration, but worked ontheir own computer. Students in the two treatments did not differ significantly in their performance on daily quizzes or responses to attitudinal survey questions. However, the students who worked on their own computer completed exercises more quickly than those using pair programming. This study compares two learning environments with high levels of collaboration to isolate aspects of pair programming that are and are not responsible for the reported success of educational research focused on pair programming. This study expands our understanding of pair programming by moving beyond simplistic comparisons of learning environments with and without collaboration and by extending pair programming research to elementary school students.     

Exploring the effects of gender and learning styles on computer programming performance: implications for programming pedagogy

Computer programming has been taught in secondary schools for more than two decades. However, little is known about how students learn to program. From the curriculum implementation perspectives, learning style helps address the issue of learner differences, resulting in a shift from a teacher-centred approach to a learner-focused approach. This study aims to investigate the effects of gender and learning styles on computer programming performance. The Gregorc Style Delineator (GSD) was employed to measure learning styles. A test was administered to assess students' programming performance. Two hundred and seventeen secondary school students of age from 14 to 19 participated in this study. Results indicated that no gender differences in programming performance were found after controlling for the effect of student ability. Academic ability had a differential effect on programming knowledge. Sequential learners in general performed better than random learners. These results suggest the importance of the ordering dimension of the GSD in influencing programming performance. Implications of the findings in relation to programming pedagogy are discussed in this paper.     

The Validity of Value-added Estimates from Low-Stakes Testing Contexts: The Impact of Change in Test-Taking Motivation and Test Consequences

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence conditions: (a) an aggregate of test scores is used solely for institutional effectiveness purposes, (b) personal test score is reported to the student, or (c) personal test score is reported to faculty. Value-added estimates, operationalized as change in performance between two testing occasions for the same individuals where educational programming was experienced between testing occasions, were examined across conditions, in addition to the effects of test-taking motivation. Test consequences did not impact value-added estimates. Change in test-taking motivation, however, had a substantial effect on value-added estimates. In short, value-added estimates were attenuated due to decreased motivation from pretest to posttest.     

Using learning analytics in the Amazonas: understanding students’ behaviour in introductory programming

Tools for automatic grading programming assignments, also known as Online Judges, have been widely used to support computer science (CS) courses. Nevertheless, few studies have used these tools to acquire and analyse interaction data to better understand the students’ performance and behaviours, often due to data availability or inadequate granularity. To address this problem, we propose an Online Judge called CodeBench, which allows for fine-grained data collection of student interactions, at the level of, eg, keystrokes, number of submissions, and grades. We deployed CodeBench for 3 years (2016–18) and collected data from 2058 students from 16 introductory computer science (CS1) courses, on which we have carried out fine-grained learning analytics, towards early detection of effective/ineffective behaviours regarding learning CS concepts. Results extract clear behavioural classes of CS1 students, significantly differentiated both semantically and statistically, enabling us to better explain how student behaviours during programming have influenced learning outcomes. Finally, we also identify behaviours that can guide novice students to improve their learning performance, which can be used for interventions. We believe this work is a step forward towards enhancing Online Judges and helping teachers and students improve their CS1 teaching/learning practices.     

Assessing Cognitive Load Theory to Improve Student Learning for Mechanical Engineers

Abstract

A computer programming class for students of mechanical engineering was redesigned and assessed: Cognitive Load Theory was used to redesign the content; online technologies were used to redesign the delivery. Student learning improved and the dropout rate was reduced. This article reports on both attitudinal and objective assessment: comparing student performance on identical final exams and student reviews. Note is made of improved learning by female and other nontraditional engineering students. This article also reports on two additional teaching strategies that were deployed to improve learning.     

Exploring learner acceptance of the use of virtual reality in medical education: a case study of desktop and projection-based display systems

Advanced technologies have been widely applied in medical education, including human-patient simulators, immersive virtual reality Cave Automatic Virtual Environment systems, and video conferencing. Evaluating learner acceptance of such virtual reality (VR) learning environments is a critical issue for ensuring that such technologies are used to greatest effect. This research describes the use of high performance real-time interactive software (VR4MAX) to build a prototype 3D VR learning system. A questionnaire survey was distributed to 167 university students to investigate learner attitudes toward learning via VR applications. Experimental results show that immersion and imagination features of VR-mediated course contents have a positive impact on perceived usefulness, and can also predict perceived ease of use, both of which contributors to behavioral intention of learners to use VR learning systems. Overall, this research validates the relationship between three features of VR and learners' behavioral intention to use VR learning. The results could prove helpful in guiding future research related to VR learning.     

Software‐Realized Scaffolding to Facilitate Programming for Science Learning

Abstract

Programming is an activity through which students can learn about other domains, but the difficulty of programming diminishes its usefulness as a learning activity. One approach to facilitate the use of programming for learning is to view programming as a skill like those taught through apprenticeships, and to use the apprenticeship concept of scaffolding to facilitate doing and learning through programming. Scaffolding means providing modifiable support (through fading) that communicates process, coaches, and elicits articulation. Software‐realized scaffolding embeds scaffolding in a computer‐based environment. Emile implements software‐realized scaffolding to facilitate student learning of physics by facilitating students building computer‐based models and simulations. In this article, I present Emile's features as examples of software‐realized scaffolding, and I present the results of an evaluation of Emile's effectiveness. Students were able to use Emile to create fairly sophisticated programs and gained a qualitative understanding of kinematics in the process.     

The effects of goal specificity and scaffolding on programming performance and self‐regulation in game design

The purpose of this study was to investigate the influence of goal specificity and scaffolding on the programming performance and self‐regulation of elementary students engaged in learning game design. This study recruited 232 students for the experimental activities. Two levels of goal specificity were employed: specific and nonspecific. Structuring and problematizing scaffolds were also used to support students in the process of learning. Our results reveal the following: (1) nonspecific goals and structuring scaffolds led to superior comprehension of programming, (2) nonspecific goals with problematizing scaffolds led to better problem‐solving performance, (3) problematizing scaffolds were more effective than structuring scaffolds in the development of self‐regulation behavior, and (4) nonspecific goals were more effective than specific goals in the promotion of resource management associated with self‐regulation.     

Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming

New high-frequency, automated data collection and analysis algorithms could offer new insights into complex learning processes, especially for tasks in which students have opportunities to generate unique open-ended artifacts such as computer programs. These approaches should be particularly useful because the need for scalable project-based and student-centered learning is growing considerably. In this article, we present studies focused on how students learn computer programming, based on data drawn from 154,000 code snapshots of computer programs under development by approximately 370 students enrolled in an introductory undergraduate programming course. We use methods from machine learning to discover patterns in the data and try to predict final exam grades. We begin with a set of exploratory experiments that use fully automated techniques to investigate how much students change their programming behavior throughout all assignments in the course. The results show that students’ change in programming patterns is only weakly predictive of course performance. We subsequently hone in on 1 single assignment, trying to map students’ learning process and trajectories and automatically identify productive and unproductive (sink) states within these trajectories. Results show that our process-based metric has better predictive power for final exams than the midterm grades. We conclude with recommendations about the use of such methods for assessment, real-time feedback, and course improvement.     

Bridging assessment and achievement: Repeated practice of self-assessment in college english classes in Taiwan

Abstract

Grounded on the notion of observational learning in social cognitive learning theory, this study evaluated the effectiveness of repeated self-assessment on English-as-a-foreign-language learners’ oral performance and the perceptions of the students and the instructor of this practice. Ninety-seven students from three classes in a Taiwanese college participated in this study. The classes experienced five trials of self-assessment in which they used cell phones to record their oral responses. Instead of simply rating their own recordings, the students were provided questions to guide their examination of key components of their own talk. The results show that the students’ oral performance and evaluation abilities both improved over time, and they highly valued opportunities to detect their errors and observe their real learning outcomes. The findings suggest that self-assessment bridged the gap between repeated practice and English learning by allowing the students to reflect upon their performance, find their weaknesses, adjust their following talk, and recognize their learning outcomes.