The relationship between student-generated learning issues and self-study in problem-based learning

A major assumption of problem-based learning (PBL) is that learning issues, generated by students while discussing a problem, are used as guides for self-directed learning activities. This assumption, though basic to PBL, has never been tested. At the University of Limburg, the Netherlands, two procedures have been developed that reflect the extent to which students are able to identify important learning issues given a particular problem, and whether subsequent, independent, learning corresponds with these learning issues. The focus of the present article will be on the relationship between the two. We have explored to what extent student-generated learning issues are a major factor influencing the nature of students' self-study, or whether other factors may be involved in decisions on what to study and how much time to spend on topics selected. First, the production of learning issues was studied and represented as the percentage of overlap between learning issues raised by students and pre-set faculty objectives for each problem. The second procedure consisted of the administration of a Topic Checklist (TOC) which purports to measure students' actual self-directed learning activities. The TOC consists of a list of topics specifying the intended course content. Students were asked to indicate on a five-point Likert scale how much time they had spent studying each topic and to what degree they had mastered that topic. Third, learning issues and TOC topics were compared directly in a qualitative sense. Comparisons between the procedures revealed that a low proportion of variance of TOC scores could be predicted from the percentage of faculty objectives identified for each problem and the direct match between learning issues and TOC scores. It is concluded that scrutinizing student-generated learning issues and topics covered during self-study may provide information about what content is covered by students in tutorial groups. The discrepancy between the results of the measurements suggests, however, that learning issues produced during group discussion are not the sole source on which students base self-study decisions. Several other factors may be involved, such as tutor guidance, content already covered in previous units, issues raised during sessions with resource persons, and the nature of the learning resources available. Therefore, the relationship between learning issues and content covered during self-study is not as straightforward as is suggested.     

Effects of problem-based learning: a meta-analysis

This meta-analysis has two aims: (a) to address the main effects of problem based learning on two categories of outcomes: knowledge and skills; and (b) to address potential moderators of the effect of problem based learning. We selected 43 articles that met the criteria for inclusion: empirical studies on problem based learning in tertiary education conducted in real-life classrooms. The review reveals that there is a robust positive effect from PBL on the skills of students. This is shown by the vote count, as well as by the combined effect size. Also no single study reported negative effects. A tendency to negative results is discerned when considering the effect of PBL on the knowledge of students. The combined effect size is significantly negative. However, this result is strongly influenced by two studies and the vote count does not reach a significant level. It is concluded that the combined effect size for the effect on knowledge is non-robust. As possible moderators of PBL effects, methodological factors, expertise-level of students, retention period and type of assessment method were investigated. This moderator analysis shows that both for knowledge- and skills-related outcomes the expertise-level of the student is associated with the variation in effect sizes. Nevertheless, the results for skills give a consistent positive picture. For knowledge-related outcomes the results suggest that the differences encountered in the first and the second year disappear later on. A last remarkable finding related to the retention period is that students in PBL gained slightly less knowledge, but remember more of the acquired knowledge.     

What students learn in problem-based learning: a process analysis

This study aimed to provide an account of how learning takes place in problem-based learning (PBL), and to identify the relationships between the learning-oriented activities of students with their learning outcomes. First, the verbal interactions and computer resources studied by nine students for an entire PBL cycle were recorded. The relevant concepts articulated and studied individually while working on the problem-at-hand were identified as units of analysis and counted to demonstrate the growth in concepts acquired over the PBL cycle. We identified two distinct phases in the process—an initial concept articulation, and a later concept repetition phase. To overcome the sample-size limitations of the first study, we analyzed the verbal interactions of, and resources studied, by another 35 students in an entire PBL cycle using structural equation modeling. Results show that students’ verbal contributions during the problem analysis phase strongly influenced their verbal contributions during self-directed learning and reporting phases. Verbal contributions and individual study influenced similarly the contributions during the reporting phase. Increased verbalizations of concepts during the reporting phase also led to higher achievement. We found that collaborative learning is significant in the PBL process, and may be more important than individual study in determining students’ achievement.     

From concept to reality in implementing the Knowledge Triangle

The concept of Knowledge Triangle (KT) links together research, education and innovation and replaces the traditional ‘one way’ flow of knowledge, essentially from research to education, by a ‘both ways’ circular motion between all the corners of a triangle that, besides research and education, also includes innovation, the ‘poor relation’ of many universities. What are the main issues – barriers and drivers – and what could be done in order to make the concept of KT a strong reality in engineering education? In this paper, the authors intend to bring some answers by analysing three cases coming from actors operating at the three corners of the KT: students, academic staff and engineers in industry.     

An evaluation of a module in problem-based learning

As a result of a variety of pressures on the existing medical curriculum, the Faculty of Medicine, University of Natal, South Africa, introduced an experimental module in Problem-Based Learning. The module, which was inserted into the traditional undergraduate curriculum, ran for one month in March/April of 1994. This paper investigates the effects of the module on students and on members of the Faculty, and it outlines prerequisites for further curriculum innovation.     

Motivation to commit oneself as a determinant of achievement in problem-based learning

Problem-based learning is a constructivist approach toprofessional education stressing the use of real lifeproblems in education. Several previous attempts tounderstand the intricacies of learning in theproblem-based context have led to a causal model,elements of which were tested in the present study.The focus of the investigation was on the students' motivation to committhemselves to studying in a problem-based healthsciences curriculum, expressed in term of levels ofattendance at tutorial meetings. Data were collectedregarding functioning of the tutorial group, tutorfunctioning, level of prior knowledge, quality of theinstructional problems, time spent on individualstudy, academic achievement and increased interest.These data were analyzed using a structural equationsmodeling approach. As hypothesized, commitment appears to bea potent determinant of achievement. In fact, itrepresents one of the strongest determinants oflearning in the model tested.     

Comparing problem-based learning students to students in a lecture-based curriculum: learning strategies and the relation with self-study time

In educational theory, deep processing (i.e., connecting different study topics together) and self-regulation (i.e., taking control over one’s own learning process) are considered effective learning strategies. These learning strategies can be influenced by the learning environment. Problem-based learning (PBL), a student-centered educational method, is believed to stimulate the use of these effective learning strategies. Several aspects of PBL such as discussions of real-life problems, selecting literature by the students themselves, and formulating answers to learning issues encourage students’ use of deep processing and self-regulation. In the present study, third-year PBL law students were compared to third-year law students of a lecture-based program with respect to their learning strategies, which were measured with the Inventory Learning Styles (ILS; Vermunt in British Journal of Educational Psychology, 68, 149–171, 1998). In addition, the relation between time invested in self-study and learning strategies, when taking the instructional method into account, was explored. Results showed that PBL students reported to apply deep processing, self-regulation, and external regulation more frequently than their non-PBL counterparts. PBL seems to contribute to the use of effective learning strategies, but PBL students also relied more often on external sources for their regulation, such as teachers, course material, and assessment.     

Mining learning social networks for cooperative learning with appropriate learning partners in a problem-based learning environment

Many studies have identified web-based cooperative learning as an increasingly popular educational paradigm with potential to increase learner satisfaction and interactions. However, peer-to-peer interaction often suffers barriers owing to a failure to explore useful social interaction information in web-based cooperative learning environments. This easily leads to learners being unable to seek appropriate learning partners for facilitating effective cooperative learning. This problem frequently causes poor learning effectiveness in web-based cooperative learning environments. Generally, instructor assigned or learner selected learning peers cannot ensure to compose suitable learning partners for individual learners in cooperative learning environments. A suitable learning partner can help the learner, who is learning in the personal way and encounters the difficulty, to solve problems. Inappropriate learning partners cannot only easily lead to poor learning interaction and achievement, but can also lead to the meaning of cooperative learning being lost. Although many web-based learning systems have already been developed to assist cooperative learning, supporting peer-to-peer interaction in computer-supported cooperative learning (CSCL) is still immature. As a result, this study presents a novel scheme for recommending appropriate learning partners for individual learners utilizing mining of learning interactive social networks in a cooperative problem-based learning (PBL) environment. Results of this study show that the proposed scheme helps encourage learners to interact with learning peers more actively and positively, and facilitates learning performance in a cooperative PBL environment.     

Small-group problem-based learning as a complex adaptive system

Small-group problem-based learning (PBL) is widely embraced as a method of study in health professions schools and at many different levels of education. Complexity science provides a different lens with which to view and understand the application of this method. It presents new concepts and vocabulary that may be unfamiliar to practitioners of small-group PBL and other educational methods. This article looks at small-group PBL from the perspective of complex adaptive systems (CAS). It begins with a brief review of the current understanding and practice of PBL. Next some of the characteristics of CAS are reviewed using examples from small-group PBL to illustrate how these characteristics are expressed in that context. The principles and the educational theory in which small-group PBL are embedded are related to CAS. Implications for health professions education are discussed.     

Using problem-based learning to increase computer self-efficacy in Taiwanese students

In Taiwan, teaching focuses around lecturing, with students having little opportunity to interact with each other. Problem-based learning (PBL) is a means of instruction where students learn the subject by being active participants in the pedagogical process, with the emphasis on problem-solving. In this study, the authors investigated whether PBL would enhance self-efficacy better than common lecturing with children who had little access to technology outside of school. Two sixth-grade computer classes, both with 32 students in each and both located in the mountainous regions of eastern Taiwan, served as participants. A quasi-experimental, non-equivalent control group design was used with one class utilizing PBL principles, while the other used traditional lecturing. A pre-/posttest was administered, using the General Self-Efficacy Scale with data analysis employing the Mann–Whitney test and Pearson Goodness-of-Fit. The results indicated that PBL is superior to lecturing, with respect to an increase in computer self-efficacy.     

Inquiry learning behaviors captured through screencasts in problem-based learning

This study examined the types of learning behaviors students demonstrated while performing inquiry tasks. It also explored the relationship between the learning behaviors and students’ domain knowledge. We observed fourteen students in five groups during a ninth-grade biology course. Three types of learning behaviors (inquiry, collaborative, and minimally productive behaviors) were identified and time on each type was measured. The results suggest that students demonstrated different patterns according to the types of learning behaviors. Correlation analysis revealed that learning outcomes had a strong positive correlation with the inquiry behaviors but a strong negative correlation with the minimally productive behaviors. The results suggest that attention should be paid to facilitate the more meaningful inquiry behaviors while reducing minimally productive behaviors.     

Designing for problem-based learning in a collaborative STEM lab: A case study

Higher education institutions are using virtual telepresence systems to engage in collaborative course redesign and research projects. These systems hold promise and challenge for inter-institutional work in STEM areas. This paper describes a case study involving two universities in the 4-VA consortium, and the redesign of a shared STEM lab. The purpose of this study was to investigate pedagogical needs across related content areas, and to use findings to make informed lab design recommendations that support beliefs and best practices involving knowledge acquisition. The researchers used several data collection points involving human subjects, site visits and technology testing and evaluation. Results emphasize the need for remote presence in the student-centered and distributed space. Design recommendations are organized into the following categories: general lab space, projection and display, storage, cable management and outlets, videoconferencing, use and management of the lab, computing and mobile devices, software, and training. Further research is proposed.     

Examining barriers in technology-enhanced problem-based learning: Using a performance support systems approach

This study focused on the barriers that middle school teachers faced when implementing technology-enhanced problem-based learning (PBL) in their classrooms. Using a human performance-based model, we interviewed teachers, administrators, university faculty and technical support staff to determine the perceived importance of multiple barriers to the implementation of technology-enhanced PBL. Twenty-one teachers, two school administrators and a project manager, two faculty members, and two technical support staff participated in the study. Interview data were supported by surveys, classroom observations and researchers' reflective journals. Results suggested that lack of a clear, shared vision was the primary barrier. Additional barriers included lack of knowledge and skills, unclear expectations and insufficient feedback. Recommendations to support teachers' efforts to integrate technology-enhanced problem-based learning are presented.     

Questioning to learn and learning to question: Structure and function of problem-based learning scenarios in environmental science education

In problem-based learning, scenarios relating to real life areused as a point of departure for the learning process. Eventhough the importance of suitable cases or scenarios in bringingabout a fruitful learning process is emphasised in theliterature, few studies focus on how they actually function inthe learning process. This study focuses on how the scenariosused in a ten-week introductory course of a new four-yearundergraduate programme in environmental science functioned interms of the structure and content of the questions they evoked.Data were gathered through diary notes from nine groups ofstudents, comprising 5–8 students per group. The data weresubjected to a qualitative analysis aimed at describing thestructure and content of the questions generated by the groups.Five different kinds of questions were identified and labelled;encyclopaedic, meaning-oriented, relational,value-oriented and solution-oriented. All scenarios generated questions pertaining to all five categories in all groups, butthe emphasis varied. The results are discussed in relation to thedesign of scenarios, and in relation to students' approaches tolearning.     

Influence of problem familiarity on learning in a problem-based course

The results of an experimental study investigating the influence of problem familiarity on learning in a problem-based psychology course are presented. Participants worked with either a familiar or an unfamiliar version of the same problem. The following measurements were taken (1) a measure of problem quality as perceived by students, (2) number of explanations of the problem put forward by the students while discussing it, (3) quality of learning issues derived from the discussion, (4) amount of time spent on self-study, and (5) the amount of knowledge acquired as indicated by a test. The results demonstrate that participants in the familiar problem condition perceived the problem to be of higher quality than the participants in the unfamiliar problem condition. No significant differences in learning were found. The findings do suggest, however, that problems may be improved by making them more relevant to the everyday experience of students.     

Effect of problem-based learning in pharmacology education: A meta-analysis

A consensus is emerging for meta-analyses regarding a range of selected topics in pharmacology education. This review provides a critical overview of problem-based learning (PBL) in pharmacology education. Based on several inclusion criteria, databases were searched, and 37 controlled trial studies were identified and extracted. The meta-analysis found that PBL had a positive effect on gaining higher theoretical scores (SMD = 6.77, 95% CI [5.23, 8.31], p < 0.00,001) assessed through examinations. The results of questionnaires for students’ feedback showed that PBL was superior to conventional teaching methods in improving students’ outcomes of self-study, learning interest, team spirit, problem solving, analyzing, scope of knowledge, communication, and expression. These results suggest that PBL in pharmacology education is considered superior to traditional lecture-based learning.     

Peer versus staff tutoring in problem-based learning

Effects of student versus staff tutoring on student learning in a problem-based, health sciences curriculum were studied. Academic achievement of 334 tutorial groups guided by staff tutors was compared with achievement of 400 groups guided by student tutors. In addition, students rated their tutor's performance on four behaviors considered critical to facilitating student learning. Overall, students guided by a staff tutor achieved somewhat better. In terms of practical significance, the difference was, however, fairly small. Staff tutors were rated as more knowledgeable and their contributions as more relevant. In addition, they asked stimulating questions to a larger extent. However, an interaction effect was found between the ratings and the year of study: Peer tutors displayed the supportive behaviors more extensively in the first year, whereas staff tutors' ratings were higher as the curriculum advanced. These results were interpreted in terms of the cognitive congruence framework.Parts of this article have been presented to the Annual Meeting of the American Educational Research Association, Atlanta, GA, April, 1993.