Scaffolding strategies in a rubric-based intervention to promote engineering students’ ability to address wicked problems

ABSTRACT

In recent years, there has been increasing interest within the engineering education research community to prepare engineering students to address wicked problems (WPs) such as climate change, resource scarcity and violent conflict. Previous research suggests that engineering students are able to address WPs if they are given adequate support, but there is a lack of research on what kinds of support are needed. This paper aims to reduce this gap by reporting on students’ performance in, and approaches to, addressing WPs when different scaffolding strategies were used in different parts of a rubric-based intervention. The intervention aimed to provide undergraduate engineering students with an understanding of the nature of WPs and with a structured way of addressing them. For each part of the intervention, we discuss affordances for learning provided by the different scaffolding strategies. The results suggest that strong cognitive scaffolding can support students’ understanding of the nature of WPs and students’ performance in written responses to WPs, but possibly also limits deep engagement with WPs and transfer of learning to other contexts.     

Effect of continuous assessment on learning outcomes on two chemical engineering courses: case study

In this paper, the effect of continuous assessment on the learning outcomes of two chemical engineering courses is studied over a several-year period. Average grades and passing percentages of courses after the final examination are reported and also student feedback on the courses is collected. The results indicate significantly better learning results after the adoption of continuous assessment in the courses. Also student feedback suggests higher quality in teaching after the adoption of more activating teaching methods which compel students to study effectively throughout the course.     

Project-based learning as a contributing factor to graduates’ work readiness

This paper explores what work readiness means for two cohorts of graduate engineers, one from a traditional curriculum, the second from a largely project-based curriculum. Professional bodies and employers have defined a set of attributes for engineering graduates so that graduates will be ‘work ready’. Problem-based learning (PBL) is claimed to be a suitable approach to develop such skills. The graduates were interviewed some months after starting work, along with their managers. All the graduates recognised the benefits of taking PBL subjects as well as vacation work, with success in communication attributed more to PBL. Both cohorts had similar learning outcomes, high skill levels in project management, problem solving, communication skills, research and sustainability. A skills gap in ethics was identified for both cohorts of graduates and their managers. Further work is planned to link skill development with undergraduate learning experience.     

Multiprog virtual laboratory applied to PLC programming learning

This study develops a Multiprog virtual laboratory for a mechatronics education designed to teach how to programme a programmable logic controller (PLC). The study was carried out with 34 students in the Department of Industry Education and Technology at National Changhua University of Education in Taiwan. In total, 17 students were assigned to each group, experimental and control. Two laboratory exercises were designed to provide students with experience in PLC programming. The results show that the experiments supported by Multiprog virtual laboratory user-friendly control interfaces generate positive meaningful results in regard to students’ knowledge and understanding of the material.     

Reasons and motivations for the option of an engineering career in Portugal

Towards the end of their secondary education, students face significant pressures in their decision about their career plan. These pressures are internal and external, personal and social, individual and from the reference group. This paper aims at understanding the reasons driving engineering students’ choices, their perceived needs and aspirations. Moreover, it discusses how, in that process, students are constrained by family and friends and are conditioned by factors such as their socioeconomic and cultural background, employability prospects and gender. The construction of a career map/plan and the reasons and motivations for the option of an engineering career are reviewed, based on the qualitative analysis of students’ discourses. The data indicate the relevance of several criteria such as social status, intelligence, gender, competences, values and interests in the construction of career aspirations. All these levels are highly influenced by self-esteem, which is closely related to the social value of training options and career paths.     

The potential of supplemental instruction in engineering education: creating additional peer-guided learning opportunities in difficult compulsory courses for first-year students

Supplemental Instruction (SI) can be an efficient way of improving student success in difficult courses. Here, a study is made on SI attached to difficult first-year engineering courses. The results show that both the percentage of students passing a difficult first-year engineering course, and scores on the course exams are considerably higher for students attending SI, compared to students not attending. The study also shows that a higher percentage of female students attend SI, compared to male students. However, both genders seem to benefit to the same degree as a result of attending SI meetings. Also all students, independent of prior academic ability, benefit from attending SI. A qualitative study suggests that SI meetings provide elements important for understanding course material, which are missing from other scheduled learning opportunities in the courses.     

An evaluation of a project-based learning initiative in engineering education

Project-based learning (PBL) is a well-known methodology for engineering design education due to a number of benefits it is claimed to offer. This paper presents the initial offering of a first-year engineering PBL unit at Griffith University in Australia. An evaluation of student perceptions of the unit revealed that students generally enjoyed the experience, with the oral presentation aspect receiving the lowest satisfaction rating. There was no significant difference in the ratings between any demographic grouping, suggesting that all students were able to participate in, and experience, the unit in essentially the same way. The best aspects of the unit and those aspects needing improvement were similar to the findings of other investigations documented in the literature. It is proposed that future offerings of the unit will reduce the number of design projects from three to two per semester and will attempt more sophisticated individualisation of marks for group work activities.     

Explicitness of criteria in peer assessment processes for first-year engineering students

This article will outline the motives for the implementation of peer assessment as put into action at the first year of the Civil Engineering course of the University of Minho. The implementation of new assessment methods was a consequence of the successful implementation of peer assessment at other engineering courses. During the semester, three assessment moments took place, in which students assessed the work of their peers. Assessment criteria were defined in a negotiation process between students and teacher. The students subsequently graded the work of their colleagues and had to provide a clear justification for each given grade. The aim of this method is to involve students in the subject, enhance their motivation and deepen their learning. Advantages and disadvantages of peer assessment are discussed. The results that have been obtained so far draw attention to the nature of assessment criteria and the corresponding explicitness.     

Meta-assessment in a project-based systems engineering course

Project-based learning (PBL) facilitates significant learning, but it poses a major assessment challenge for assessing individual content knowledge. We developed and implemented an assessment approach and tool for a mandatory undergraduate systems engineering PBL-based course. We call this type of assessment student-oriented meta-assessment. Research participants included 131 undergraduate engineering students who carried out team projects requiring conceptual modelling of complex systems. Next, individual students assessed their peer team projects. Finally, the course staff assessed students individually, based on the content knowledge that was reflected in students’ comments to their peers, by using the new meta-assessment tool. The research findings validated the meta-assessment tool which can serve for assessing various PBL courses. Our contribution is twofold: a new approach for assessing project-based undergraduate engineering courses, and classification of meta-assessment methods into three types, where a student-oriented meta-assessment as one of the three meta-assessment methods is our newly introduced and validated method.     

A longitudinal evaluation of a project-based learning initiative in an engineering undergraduate programme

Project-based learning (PBL) is a well-known student-centred methodology for engineering design education. The methodology claims to offer a number of educational benefits. This paper evaluates the student perceptions of the initial and second offering of a first-year design unit at Griffith University in Australia. It builds on an earlier evaluation conducted after the initial offering of the unit. It considers the implementation of the recommended changes. Evaluations of the two offerings reveal that students (in both the initial and second offering) generally enjoyed the experience, but that the second offering was found to be a significantly more enjoyable learning experience. Students in the second offering also reported a significantly better understanding of what they needed to do for the design projects and where to find the requisite information. The oral presentation aspect of the initial and second offerings received the lowest satisfaction rating. The inclusion (and delivery) of the computer-aided drawing component of the unit is seen as a positive aspect by some students, but many others comment on it negatively. The best aspects of the PBL unit and those aspects needing further improvement were similar to the findings of other investigations documented in the literature.     

Using conceptual questions to promote motivation and learning in physics lectures

In the last years, science courses in higher education (HE) have been facing some problems, namely the lack of students’ motivation, the number of students’ failures and drop outs, particular in physics courses. The most probable reason, which has been mentioned in current science education research in HE, is that the level of interaction between teachers and learners in formal instructional settings is very low. In this paper, we describe changes that were introduced in lectures towards the promotion of active learning and analyse its effects in the classroom environment. The introduction of conceptual questions and peer instruction seems to motivate students in the class and help them engage in the learning process. These strategies have been used in the first year of an introductory physics course for engineering students in two different Portuguese HE institutions. The data were collected through questionnaires and student interviews.     

Curriculum assessment as a direct tool in ABET outcomes assessment in a chemical engineering programme

The chemical engineering programme at the United Arab Emirates University is designed to fulfil the Accreditation Board for Engineering and Technology (ABET) (A–K) EC2000 criteria. The Department of Chemical & Petroleum Engineering has established a well-defined process for outcomes assessment for the chemical engineering programme in order to ensure that its graduates achieve the programme educational objectives. Different direct and indirect tools are implemented in the assessment process. Among these tools, the greatest weight in the assessment process has been given to the curriculum (30%). The course and curriculum assessment usually plays an important role in improving the course content and quality; as it should provide considerable information on the effectiveness of an academic programme. This paper aims to discuss the methods used to assess the courses/curriculum of the chemical engineering programme as an important direct tool in the assessment process for ABET accreditation. Application of the curriculum assessment results in the continuous improvement of chemical engineering programmes is also addressed.     

美国“学生学习成果评估”研究评析

1980年代评估运动以来,随着学生学习成果评估在美国高等教育领域的开展,学界对这一质量保障方式的理论研究也日益丰富。研究内容主要包括学生学习成果评估相关概念的界定、学生学习成果评估的历史演进、学生学习成果评估的运行机制、学生学习成果评估的理念之争等四个方面。美国现有的学生学习成果评估研究的成果可谓卷帙浩繁,但相关理论探讨和实践摸索依旧在路上。这一方面说明学生学习成果评估正走向专业化、科学化,另一方面也说明学生学习成果评估实践为理论研究提供了丰富的研究资源。     

Adapting physics courses in an engineering school to the b-learning philosophy

In this paper we introduce the methodology that we have followed to convert traditional notes into interactive online materials. The idea behind this has been to make self-consistent and interactive online materials capable of motivating the students to get involved in the learning process. For this purpose, we have used the e-learning environment Moodle, which is a platform with a high interactivity potential. We conclude that the academic performance reaches its maximum when correctly combining self-organising with minimum teacher guidance.     

Formative assessment in mathematics for engineering students

In this paper, we present a range of formative assessment types for engineering mathematics, including in-class exercises, homework, mock examination questions, table quizzes, presentations, critical analyses of statistical papers, peer-to-peer teaching, online assessments and electronic voting systems. We provide practical tips for the implementation of such assessments, with a particular focus on time or resource constraints and large class sizes, as well as effective methods of feedback. In addition, we consider the benefits of such formative assessments for students and staff.     

加拿大高校学生学习成果评估的内容、方法及启示

作为全球第二个实现高等教育普及化的高等教育强国,加拿大高校学生学习成果评估体系富有特色:在评估内容方面,构建起了高等教育系统、院校以及学科(专业)等不同层面的学生学习成果体系;在评估方法方面,形成了由标准化测试、评价量规、表现性评估以及问卷调查等四种类型构成的多元化学生学习成果评估方法体系。其对我国的启示是:构建和完善高校学生学习成果评估的内容体系,为学生学习成果评估奠定共识基础;开发多元化的学生学习成果评估方法与工具,提高评估活动的科学性;加强以结果为导向的评估制度建设,促使学习成果评估常态化。     

Evoked prior experiences in first-year university student learning

In this article, we focus on three aspects of students' prior experiences of learning: evoked conceptions of learning, evoked motivation and evoked self-efficacy. We show how, for a first-year undergraduate population, these three aspects of evoked prior experience relate to students' approaches to learning and their perceptions of the learning environment as well as to their previous schooling, their gender and the broad discipline area in which they are studying. In doing so, we confirm that evoked prior experiences are distinct and measurable and can be used to better understand the ways in which students experience learning in higher education.     

Evaluating student perceptions of learning processes and intended learning outcomes under inquiry approaches

Inquiry-based learning (IBL) is promoted as a teaching approach that can enhance student learning outcomes. IBL can be categorised according to scale (e.g. tasks, course/module/paper, degree), mode (structured, guided, open) and framing (information or discovery-oriented). Our research used a survey instrument to determine how student perceptions of learning processes and intended learning outcomes (ILOs) varied in response to courses with different modes and framing of IBL. The survey was completed by 940 students in 15 IBL courses across a range of disciplines and levels. All types of IBL courses were well rated by students for encouraging learning processes and ILOs congruent with a well-designed inquiry experience. Regarding modes of IBL, there was a clear hierarchy from open (most highly rated) to guided and then structured inquiry. For the framing of IBL, courses using discovery-oriented IBL were more highly rated than information-oriented IBL. Overall, the most highly rated course design was open, discovery-oriented IBL, but other types of IBL remained important in terms of developing research and inquiry skills. To determine whether all types of IBL courses are promoting enhanced ILOs compared to more traditionally taught courses, a comparative study should be undertaken.     

An analysis of the effectiveness of feedback to students on assessed work

This paper presents the views of students, from a range of schools and disciplines, on the effectiveness of current assessment feedback practices at Flinders University. We also report on a workshop on feedback with teachers. Overall, individual written comments were found to be the most useful form of feedback. However, there was significant variation with the level of satisfaction with feedback and the relative usefulness of different forms of feedback across the different schools and disciplines. This research suggests both the need to improve the effectiveness of such feedback and to tailor the forms of feedback offered to students according to the distinctive teaching and learning environments in different schools and disciplines. To that end, innovation and further research on feedback are justified, and some suggestions are offered.