Diagnostic online assessment of basic IT skills in 1st-year undergraduates in the Medical Sciences Division, University of Oxford

Attitude, experience and competence (broadly covered by the European Computer Driving Licence syllabus) in information technology (IT) were assessed in 846 1st-year Medical Sciences Division undergraduates (2003–06) at the start of their first term. Online assessments delivered during induction workshops were presented as an opportunity for self-evaluation and to provide performance-related recommendations for training. Results were consistent over 4 years. There was no difference in attitude between years or programme of study and the majority selected 'competent to use a range of applications'. Nor were there any differences in competence between all students in any year; however, male Medical Science students performed significantly better than females (2006). Students with a recognised IT qualification also did significantly better than those without. There was a discrepancy between measured skill and individual self-evaluation of competence; in particular, weaker students overestimated their competence. In all years, some students showed a fundamental lack of understanding of basic IT skills. Introducing online diagnostic testing raised the profile of the importance of IT skills to both academic staff and students.