Dynamics of undergraduate student generic problem-solving skills captured by a campus-wide study

The ability to effectively problem solve is a highly valued competency expected of university graduates, independent of their area of study. Evaluation of problem-solving skill (PSS) development is hindered by a shortage of available tools for monitoring student progress and by lack of defined instructional strategies for development of these skills. Our research is aimed at addressing these problems. We have developed an evaluation tool, which we applied to study the dynamics of undergraduate student PSS. We tested first- and upper-year students from 26 different courses (total enrollment of 2229 students). Overall improvement of PSS was detected for the first-year students over their first term of study. There were no significant differences between the PSS of first- and upper-year students, and no improvement was detected over a single term by measuring PSS in upper-year students. Only three courses were effective at facilitating PSS. Our data indicate that most of the standard lecture approaches do not develop undergraduate student PSS and that universities and individual instructors must take active steps to advance this critical skill set in university students.     

Non-linear improvement in generic problem-solving skills of university students: a longitudinal study

ABSTRACT

Problem solving has been characterized as one of the ‘employability skills’ due to the high demand for such abilities in a modern workplace. Most universities do not monitor progress of the generic problem-solving skills (PSS) of their students due to a lack of available assessment tools. We used previously reported 15-min tests to measure the generic PSS of students over the first three years of university. More than 600 students participated in this study, including 144 who wrote PSS tests in Year 1 and then again in Year 3 of their studies. Two versions of the PSS test were administered in September and December of both years. We observed a non-linear increase in PSS test scores with a significant growth during the first three months of Year 1, a similar increase over the next 21 months, then no change during the first three months of Year 3. Further studies are necessary to pinpoint the instructional techniques and situational factors facilitating the PSS development of students over the first three years of studies. Moreover, the plateau we observe in the third year indicates that proactive steps by universities and individual instructors are required to advance this important skill set in upper-year students.     

Comparison of student marks obtained by an assessment panel reveals generic problem-solving skills and academic ability as distinct skill sets

Generic problem-solving skills have been identified as one of the key competencies valued by professional programmes, university students and their future employers. A lack of widely available and simple testing tools prevents assessment of the development of student problem-solving skills. As part of a research study, a generic problem-solving test was administered to 130 third-year science students during three consecutive years. A comparison between the scores students achieved in this test with their six academic marks obtained in this course showed no significant correlation. Lack of correlation between the problem-solving skill test scores and academic marks of students was confirmed in a larger population of students participating in a campus-wide study of generic problem-solving skills (n = 830). Problem solving and academic performance may represent two independent skill sets of students; testing problem-solving skills of students could be introduced to achieve a more comprehensive evaluation of undergraduate student progress and achievement.     

Improvement in Generic Problem-Solving Abilities of Students by Use of Tutor-less Problem-Based Learning in a Large Classroom Setting

Problem-based learning (PBL) was originally introduced in medical education programs as a form of small-group learning, but its use has now spread to large undergraduate classrooms in various other disciplines. Introduction of new teaching techniques, including PBL-based methods, needs to be justified by demonstrating the benefits of such techniques over classical teaching styles. Previously, we demonstrated that introduction of tutor-less PBL in a large third-year biochemistry undergraduate class increased student satisfaction and attendance. The current study assessed the generic problem-solving abilities of students from the same class at the beginning and end of the term, and compared student scores with similar data obtained in three classes not using PBL. Two generic problem-solving tests of equal difficulty were administered such that students took different tests at the beginning and the end of the term. Blinded marking showed a statistically significant 13% increase in the test scores of the biochemistry students exposed to PBL, while no trend toward significant change in scores was observed in any of the control groups not using PBL. Our study is among the first to demonstrate that use of tutor-less PBL in a large classroom leads to statistically significant improvement in generic problem-solving skills of students.