Meta-assessment in a project-based systems engineering course

Project-based learning (PBL) facilitates significant learning, but it poses a major assessment challenge for assessing individual content knowledge. We developed and implemented an assessment approach and tool for a mandatory undergraduate systems engineering PBL-based course. We call this type of assessment student-oriented meta-assessment. Research participants included 131 undergraduate engineering students who carried out team projects requiring conceptual modelling of complex systems. Next, individual students assessed their peer team projects. Finally, the course staff assessed students individually, based on the content knowledge that was reflected in students’ comments to their peers, by using the new meta-assessment tool. The research findings validated the meta-assessment tool which can serve for assessing various PBL courses. Our contribution is twofold: a new approach for assessing project-based undergraduate engineering courses, and classification of meta-assessment methods into three types, where a student-oriented meta-assessment as one of the three meta-assessment methods is our newly introduced and validated method.     

A longitudinal evaluation of a project-based learning initiative in an engineering undergraduate programme

Project-based learning (PBL) is a well-known student-centred methodology for engineering design education. The methodology claims to offer a number of educational benefits. This paper evaluates the student perceptions of the initial and second offering of a first-year design unit at Griffith University in Australia. It builds on an earlier evaluation conducted after the initial offering of the unit. It considers the implementation of the recommended changes. Evaluations of the two offerings reveal that students (in both the initial and second offering) generally enjoyed the experience, but that the second offering was found to be a significantly more enjoyable learning experience. Students in the second offering also reported a significantly better understanding of what they needed to do for the design projects and where to find the requisite information. The oral presentation aspect of the initial and second offerings received the lowest satisfaction rating. The inclusion (and delivery) of the computer-aided drawing component of the unit is seen as a positive aspect by some students, but many others comment on it negatively. The best aspects of the PBL unit and those aspects needing further improvement were similar to the findings of other investigations documented in the literature.     

Peer assessment in a project-based engineering course: comparing between on-campus and online learning environments

As the number of participants in online distance learning courses increases, peer assessment is becoming a popular strategy for evaluating open assignments and for breaking the social isolation surrounding distance education. Yet, the quality and characteristics of peer assessment in massive online courses has received little attention. Hence, this study was set to examine peer feedback quality and grading accuracy in a project-based course. The study applied a sequential exploratory mixed methods design. It included 339 participants who studied the same engineering course, but in three different modes: on-campus (n = 77), small private online course (n = 110), and massive open online course (MOOC) (n = 152). Content analysis of feedback comments identified four categories: reinforcement, statement, verification and elaboration, arranged in an ascending scale of cognitive ability. The findings indicated that the MOOC participants provided more feedback comments and volunteered to assess more projects than their counterparts did. However, the on-campus students provided higher quality feedback and their peer grading was better correlated with the grades assigned by the teaching assistants.     

An evaluation of a project-based learning initiative in engineering education

Project-based learning (PBL) is a well-known methodology for engineering design education due to a number of benefits it is claimed to offer. This paper presents the initial offering of a first-year engineering PBL unit at Griffith University in Australia. An evaluation of student perceptions of the unit revealed that students generally enjoyed the experience, with the oral presentation aspect receiving the lowest satisfaction rating. There was no significant difference in the ratings between any demographic grouping, suggesting that all students were able to participate in, and experience, the unit in essentially the same way. The best aspects of the unit and those aspects needing improvement were similar to the findings of other investigations documented in the literature. It is proposed that future offerings of the unit will reduce the number of design projects from three to two per semester and will attempt more sophisticated individualisation of marks for group work activities.     

Design and implementation of a project-based active/cooperative engineering design course for freshmen

A project-based active/cooperative design course is planned, implemented, assessed and evaluated to achieve several desired engineering outcomes. The course allows freshman-level students to gain professional hands-on engineering design experience through an opportunity to practise teamwork, quality principles, communication skills, life-long learning, realistic constraints and awareness of current domestic and global challenges. Throughout successive design reports and in-class assignments, the students are required by the end of the semester to communicate, clearly and concisely, the details of their design both orally and in writing through a functional artefact/prototype, a design notebook, an A0 project poster and a final oral presentation. In addition to these direct assessment tools, several indirect measures are used to ensure triangulation. Assignments are based on customer expectations using a detailed checklist. This paper shows the direct and indirect assessment tools that indicated a high level of achievement of course learning outcomes and a high level of student satisfaction.     

A comparative study on first-time and experienced project-based learning students in an engineering design module

This study aims to compare and evaluate the learning ability and performance differences between two groups of students undergoing project-based learning (PjBL), with one group having prior PjBL experience, while the other group is being freshly exposed to PjBL. More specifically, it examines if there are significant differences in knowledge score, problem-solving ability, and eventual project-deliverable outcomes between the two sets of students. Performances were compared via qualitative and quantitative analyses. Key findings have indicated a significant increase in fundamental formative knowledge; enhanced problem-solving abilities; and production of better performing artefacts with regard to the set of design skills between experienced and first-time PjBL groups. This study also highlighted that experienced PjBL students have less conflicts within their groups, and are more receptive to PjBL compared to first-time PjBL students. Results from this study provide a starting point for educators to seek new learning/facilitating strategies that are relevant based on the experience and learning styles of students.     

Case study of a problem-based learning course of project management for senior engineering students

The analysis of the current state of the Ukrainian system of engineering education indicates the prevalence of traditional teaching–learning approaches in contrast to the modern needs of the labour market. Many universities across the world use the problem/project-based learning (PBL) which is an effective approach for the development of design and management skills of engineering students. The paper describes a detailed structure of a PBL course in project management and practical experience related to its implementation in an engineering degree programme at Bohdan Khmelnytsky National University of Cherkasy. Also, the results of surveys carried out in order to study the students’ generic competences’ development and perception of the PBL process are presented. The results show that students understand the diversity of PBL aspects and the influence of the PBL approach on their professional characteristics such as teamwork, ability of self-directed learning, communication and problem-solving skills.     

Integrating problem- and project-based learning opportunities: assessing outcomes of a field course in environment and sustainability

Improving student competencies to address sustainability challenges has been a subject of significant debate in higher education. Problem- and project-based learning have been widely celebrated as course models that support the development of sustainability competencies. This paper describes a course developed for a professional Master’s program in environment and sustainability that employs such a model. Additionally, the course was designed to offer value-added opportunities by introducing attributes of interdisciplinary training, service learning, academic research, and professional practice. Results from the course assessments by students, faculty, community clients and organizational partners show this model provided a range of learning, professional and practical outcomes for course partners. The value-added benefits include strengthening sustainability competencies and professional skills for students; longitudinal research opportunities for teaching faculty; real-time assessments of farming practices for community clients; and a heightened regional profile for the non-profit biosphere reserve organization supporting course delivery.     

Effects of group reflection variations in project-based learning integrated in a Web 2.0 learning space

A Web 2.0 environment that is coupled with emerging multimodal interaction tools can have considerable influence on team learning outcomes. Today, technologies supporting social networking, collective intelligence, emotional interaction, and virtual communication are introducing new forms of collaboration that are profoundly impacting education. In this study, an empirical analysis was conducted on a Web 2.0 learning space designed to promote and support project-based group learning. Three different group reflection (GR) methods (i.e., self-reflection, GR, and instructor-supported reflection) were implemented for a micro community of undergraduate students completing a team project. Findings from this study suggest that promoting and supporting ‘deep learning’ through GR is essential for team project learning in a Web-based community. In addition, effective instructor intervention is a crucial component leading to better group performance. In terms of group learning evaluation rubrics, structural equation modeling revealed that the level of activeness in online contributions may not be as important as the evidence of collective reflection and critical thinking in team learning scenarios.     

Online reflective writing mechanisms and its effects on self-regulated learning: a case of web-based portfolio assessment system

The purpose of the present study was to design reflective writing mechanisms in a web-based portfolio assessment system and evaluate its effects on self-regulated learning. Participants were two classes of juniors majoring in data processing and taking a course called “Website design” at a vocational high school in Taiwan. One class was randomly selected and assigned as an experimental group (41 students) reflecting on learning processes through a web-based portfolio assessment system, whereas the other class was assigned as a control group (41 students) reflecting on learning processes through a paper-based portfolio. The result revealed that students who were highly satisfied with online reflective writing mechanisms significantly outperformed students who were less satisfied with online reflective writing mechanisms in self-regulated students reflecting on learning processes through a web-based portfolio assessment system significantly outperformed students reflecting on learning processes through a paper-based portfolio in self-regulated learning.     

基于项目教学法的初中英语实践案例设计与实施

用项目教学法开展初中英语实践活动,教学的项目由教师设计,学生是实施项目的主体,教师在项目实施的过程中是指导者和帮助者。项目活动的开展采取课堂与课外相结合的方式,由教师带领学生通过合作探究,开展项目活动,指导学生完成各项项目作业,从而掌握知识、开发智能、培养自主学习能力。     

Application of experiential learning to improve student engagement and experience in a mechanical engineering course

ABSTRACT

This paper introduced how a mechanical engineering course was redesigned by applying experiential learning theory to improve student engagement and learning experience. Design of machine elements has been considered by students to be a difficult course. Traditional teaching methods tend not to be effective in engaging students. Experiential learning is a philosophy of learning by doing. In applying an experiential learning approach to the course, the design project and workshop activities were restructured in such a way that students were engaged in direct experience and focused reflection to construct knowledge. By exploring a physical gearbox model, working on subtasks for the design project, having group discussions, raising questions, getting feedback, and moving forward for next subtasks, students experienced the learning cycles of ‘DO, OBSERVE, THINK, and PLAN’ many times. Course survey results showed that application of experiential learning helped to improve student engagement and learning experience significantly.     

Introducing a project-based assignment in a traditionally taught engineering course

This study seeks to explore whether a combination of traditional teaching methods with project-based learning (PBL) activities can improve the student learning experience in an engineering course of soil mechanics. As an alternative to the traditional type of assignment that consisted of several textbook problems, a project-based assignment was introduced in 2015 so that students could work on real-world geotechnical problems throughout the whole semester. Students were permitted to choose whether they would undertake the project-based assignment or the traditional one, thus forming the ‘project’ and ‘non-project’ groups, respectively. The academic performance of these two groups was compared on the basis of student marks while the student experience was evaluated through a series of interviews. The data collected over 3 years indicated that students from both groups had very similar academic performances; however, the students who completed the project-based assignment reported better engagement in the learning process as they enjoyed the opportunity to experience the practical aspects of soil mechanics. The obtained results also revealed low motivation among students to embrace new learning approaches such as PBL, as the majority of them preferred more traditional methods of teaching.     

Project-based learning in engineering design in Bulgaria: expectations,experiments and results

Using a students’ workshop as a laboratory, this article summarises the observation of three years’ implementation of a new study module for a Bachelor Program in Engineering Design (Interior and Furniture Design) at the University of Forestry, Sofia, Bulgaria. The article offers an analysis of group dynamics and the difficulties and issues observed during the process. Data from survey questionnaires are interpreted; proposals are made for future research. The conclusion of the authors includes the following points: positive response by students, important encounter with successful professionals and companies; creative fulfilment and experience of team work. On the weak side is the experienced discomfort in public presentation, lack of verbal and graphic skills, interpersonal issues and pressure of real requirements from teachers and company; lack of adequate attention by the tutors. The need of better understanding a team ‘code’ of behaviour and preparation for an active learning method was felt. A proposal leading to a mixed-team organisation for better support of first-time participants in the module is made.     

Investigating the link between self directed learning readiness and project-based learning outcomes: the case of international Masters students in an engineering management course

Modern learning approaches increasingly have fewer structured learning activities and more self-directed learning tasks guided through consultation with academics. Such tasks are predominately project-/problem-based where the student is required to follow a freely guided road map to self discovery while simultaneously achieving desired learning outcomes for a particular course. However, many international students struggle to adjust to an Australian higher learning environment where they are being increasingly encouraged to undertake self directed learning (SDL). Thus, this paper proposes the concept that international students who have higher readiness for SDL gain greater learning outcomes from project-based learning (PBL) approaches. To achieve this objective, a questionnaire survey of 26 students (65% of class) completing an engineering management course was conducted. Linear regression analysis provided evidence that SDL readiness was a key enabler for achieving learning outcomes from PBL. In particular, having high self-management skills was shown to be the most significant and reliable predictor for achieving learning outcomes from PBL. Through understanding students SDL readiness at the commencement of their engineering programmes, academics can better tailor PBL support mechanisms to achieve desired learning outcomes.     

An evaluation of the learning of structural engineering concepts during the first two years of a project-based engineering degree

In the modern working environment it is essential for a structural engineer to have an understanding of abstract concepts in structural behaviour and an ability to use them qualitatively. This paper presents the findings of a study on how effectively students acquire such conceptual understanding within a new project/design focused degree course. The new degree programme is described. The first-year students experience a mixture of learning opportunities, including model building/testing, laboratories, workshops/tutorials, and lectures. In the second year there are two design exercises but no formal structural theory course. Specific concepts-based learning material was introduced into the first-year course at mid-semester and the effectiveness of this examined by tests and interviews. The performance of the first-year students is compared to that of the second-year students. The findings show that there is good student engagement and satisfaction with the course and that basic skills are successfully being acquired throughout both years. However, the study highlights areas where concepts are not being adequately developed in the first year and subsequently show little enhancement in the second year.     

Towards characterising design-based learning in engineering education: a review of the literature

Design-based learning is a teaching approach akin to problem-based learning but one to which the design of artefacts, systems and solutions in project-based settings is central. Although design-based learning has been employed in the practice of higher engineering education, it has hardly been theorised at this educational level. The aim of this study is to characterise design-based learning from existing empirical research literature on engineering education. Drawing on a perspective that accounts for domain-specific, idiosyncratic and learner-centred aspects of design problems in the context of engineering education, 50 empirical studies on project-based and problem-based engineering education, to which the design of artefacts is central, were reviewed. Based on the findings, design-based learning is characterised with regard to domain-specificity, learner expertise and task authenticity. The implications of this study for the practice of engineering education are discussed.     

Guided portfolio writing as a scaffold for reflective learning in in-service contexts: a case study1

Language is widely recognized as an inescapable mediating tool for professional learning, and with this text we want to contribute to a better understanding of the particular role that guided writing can play in in-service professional reflective learning. We analysed one pre-school teacher’s written portfolio, the construction of which was guided to scaffold deep thinking about (and the transference of theory into) practice during participation in an in-service program about language education. Our case study shows that the writing process sustained robust learning about professional knowing, doing and learning itself: The teacher elaborated an integrative ethical understanding of the discussed theory, fully experienced newly informed practices and assessed her own learning by using theory to confront her previous knowledge and practices. Throughout the portfolio, the learning stance revealed by her voice varied accordingly. The study illustrates the potential of guided writing to scaffold reflective learning in in-service contexts.