Exploring the Impact of Assessment on Medical Students’ Learning

Abstract

What and how students learn depend largely on how they think they will be assessed. This study aimed to explore medical students’ perception of the value of assessment and feedback on their learning, and how this relates to their examination performance. A mixed methods research design was adopted in which a questionnaire was developed and administered to the students to gain their perceptions of assessments. Perceptions were further explored in focus group discussions. Survey findings were correlated with students’ performance data and academic coordinators’ perceptions. Students’ perceptions of the level of difficulty of different assessments mirrored their performance in examinations, with an improvement observed in clinical assessments as students progressed through their degree. Students recognised that feedback is important to allow improvements and seek more timely, better quality and personalised feedback. Academic coordinators identified that some of the students’ suggestions are more realistic than others. Students had a positive attitude towards assessment, but emphasised the need for educators to highlight the relevance of assessment to clinical practice.     

Computer-based learning of spelling skills in children with and without dyslexia

Our spelling training software recodes words into multisensory representations comprising visual and auditory codes. These codes represent information about letters and syllables of a word. An enhanced version, developed for this study, contains an additional phonological code and an improved word selection controller relying on a phoneme-based student model. We investigated the spelling behavior of children by means of learning curves based on log-file data of the previous and the enhanced software version. First, we compared the learning progress of children with dyslexia working either with the previous software (n = 28) or the adapted version (n = 37). Second, we investigated the spelling behavior of children with dyslexia (n = 37) and matched children without dyslexia (n = 25). To gain deeper insight into which factors are relevant for acquiring spelling skills, we analyzed the influence of cognitive abilities, such as attention functions and verbal memory skills, on the learning behavior. All investigations of the learning process are based on learning curve analyses of the collected log-file data. The results evidenced that those children with dyslexia benefit significantly from the additional phonological cue and the corresponding phoneme-based student model. Actually, children with dyslexia improve their spelling skills to the same extent as children without dyslexia and were able to memorize phoneme to grapheme correspondence when given the correct support and adequate training. In addition, children with low attention functions benefit from the structured learning environment. Generally, our data showed that memory sources are supportive cognitive functions for acquiring spelling skills and for using the information cues of a multi-modal learning environment.     

Updated generic search filters for finding studies of adverse drug effects in Ovid medline and Embase may retrieve up to 90% of relevant studies

Background

The most current objectively derived search filters for adverse drug effects are 15 years old and other strategies have not been developed and tested empirically.

Objective

To develop and validate search filters to retrieve evidence on adverse drug effects from Ovid medline and Ovid Embase.

Methods

We identified systematic reviews of adverse drug effects in Epistemonikos. From these reviews, we collated their included studies which we then randomly divided into three tests and one validation set of records. We constructed a search strategy to maximise relative recall using word frequency analysis with test set one. This search strategy was then refined using test sets two and three and validated on the final set of records.

Results

Of 107 systematic reviews which met our inclusion criteria, 1948 unique included studies were available from medline and 1980 from Embase. Generic adverse drug effects searches in medline and Embase achieved 90% and 89% relative recall, respectively. When specific adverse effects terms were added recall was improved.

Conclusion

We have derived and validated search filters that retrieve around 90% of records with adverse drug effects data in medline and Embase. The addition of specific adverse effects terms is required to achieve higher recall.     

Predicting and explaining students’ stress with the Demand–Control Model: does neuroticism also matter?

University students often report high stress levels, and studies even suggest a recent increase. However, there is a lack of theoretically based research on the structural conditions that influence students’ perceived stress. The current study compared the effects of Karasek’s demand–control dimensions with the influence of neuroticism to address environmental and individual characteristics related to stress. Two points of measurement were included: T1 in the middle of the term and T2 during the examination period. Participants were 146 psychology students at two German universities (M_age = 22.6 years). We applied an adapted version of Karasek’s Job Content Questionnaire, a self-developed stress scale, and the 21-item Big-Five-Inventory. At T1, both neuroticism and demands significantly predicted stress (total adjusted R² = .40), although relative weights analyses indicated that the contribution of demands was more pronounced (relative importance: 63%). Longitudinally, controlling for stress at T1, the demand–control dimensions explained additional variance in the increased stress level at T2, whereas neuroticism did not contribute additionally (R² = .52). Results indicate that self-reports on stress among university students are not only a reflection of underlying negative affectivity. We conclude that perceived stress can be explained by structural conditions rather than personality, providing opportunities to reduce stress among students.     

Can wisdom and psychosocial growth be learned in university courses?

ABSTRACT

This study explored whether three-dimensional wisdom and psychosocial growth, defined as increases in psychological well-being (PWB), spirituality, and death acceptance, can be learned in university courses. Specifically, the study examined whether courses that tried to engage the whole person rather than only the intellect and/or courses that included a service learning component (growth classes) fostered greater wisdom and psychosocial growth than regular sociology or religion courses (control classes). Results of repeated measure MANOVAs showed that, on average, the 165 students who were enrolled in 12 growth classes significantly increased in wisdom, PWB, spirituality, and death acceptance between the beginning and the end of the semester, whereas the 153 students who attended eight control classes significantly decreased in wisdom and did not change significantly in PWB, spirituality, and death acceptance. It appears that it is indeed possible to learn wisdom and psychosocial growth in university courses.     

From PISA to national branding: exploring Finnish education®

Since the recent global paradigm shift in the governance of higher education toward business and marketing, internationally competitive education is increasingly considered as an asset for governments. Consequently, governments started to invest in education branding and marketing their educational systems. In Finland, national interest in education branding rose especially since the country's success in the programme for international student assessment studies created a positive reputation of its basic education. In this article, the authors investigate how this reputation is transformed into a general Finnish education brand, based upon Finland's official Country Brand Report (2010). The governmental discourse on Finnish education reveals a fusion of education and national branding, which is why the authors suggest to discuss the Finnish education brand as Finnish education®. The article provides an analysis of the elements constituting the brand and opens up a critical discussion on the ethics of branding education through cultural and national characteristics.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Knowledge Cultures and the Shaping of Work-based Learning: The Case of Computer Engineering

This paper examines how the knowledge culture of computer engineering – that is, the ways in which knowledge is produced, distributed, accumulated and collectively approached within this profession – serve to construct work-based learning in specific ways. Typically, the epistemic infrastructures take the form of information structures with a global outreach that both hinge on and generate standardization and codification. At the same time, computer engineering implies extensive engagements with technological objects that are open-ended and in constant transformation, such as systems, programs and codes. The professional domain is thus characterised by a richness of what may be termed ‘epistemic objects’, that is, objects marked by their unfolding and question-generating qualities. The paper reveals how these features involve engineers in multiple and coexisting dynamics of objectual practice that provide and constitute opportunities for learning. The paper concludes by discussing some implications of this knowledge culture for individuals and communities alike.