Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics

Electronic portfolios (E-portfolios) are crucial means for workplace-based assessment and feedback. Although E-portfolios provide a useful approach to view each learner’s progress, so far options for personalized feedback and potential data about a learner’s performances at the workplace often remain unexploited. This paper advocates that E-portfolios enhanced with learning analytics, might increase the quality and efficiency of workplace-based feedback and assessment in professional education. Based on a 5-phased iterative design approach, an existing E-portfolio environment was enhanced with learning analytics in professional education. First, information about crucial professional activities for professional domains and suited assessment instruments were collected (phase 1). Thereafter probabilistic student models were defined (phase 2). Next, personalized feedback and visualization of the personal development over time were developed (phase 3). Then the prototype of the E-portfolio—including the student models and feedback and visualization modules—were implemented in professional training-programs (phase 4). Last, evaluation cycles took place and 121 students and 30 supervisors from five institutes for professional education evaluated the perceived usefulness of the design (phase 5). It was concluded that E-portfolios with learning analytics were perceived to assist the development of students’ professional competencies and that the design is only successful when developed and implemented through the eyes of the users. Feedback and assessment methods based upon learning analytics can stimulate learning at the workplace in the long run. Practical, technological and ethical challenges are discussed.     

Adding a design perspective to study learning environments in higher professional education

How to design learning environments leading to learning-, thinking, collaboration- and regulation skills which can be applied to transferable, knowledge oriented learning outcomes is still controversial. We studied the designs of learning environments in innovative higher professional education more closely. To characterize learning environments we identify designable elements and position them on a scale ranging from specified, to emergent elements. Next, the main problems with the designs are identified. We introduce adaptive elements as a potential solution. We observed participants adapting such elements to suit their own needs or the needs of others. The designable and adaptive elements fulfill a dual function: they should offer contextual clues that would be available in professional practice and scaffold learners in need of support.     

Accountability,transparency, redundancy: Academic identities in an era of ‘excellence’

Higher education institutions (HEIs) in the UK and elsewhere are having a hard time, pushed into the marketplace with the turn to ‘academic capitalism’ and now suffering the effects of the economic downturn. Increasingly, the discourse of ‘excellence’ is being invoked as HEIs are held to account and public funding for research is predicated on the basis of ‘impact’. What effect is this having on the long‐established ideals appealed to in the idea of a university (if such an idea can be said to exist)? This paper adopts an autoethnographic approach in order to examine the ways in which dominant discourses are operationalised in the university through everyday communications and how, in turn, this impacts on the development of academic identities. The aim of this paper then is to examine the often uncomfortable point of insertion between the personal and the institutional in and through which subjectivities and identities are constituted as a means to understand the state we're in.     

Embedded yet separate: tensions in voluntary sector working to support mental health in state‐run schools

The policy agenda of the UK government has repositioned the voluntary sector as a key player in the delivery of locally responsive, ‘bottom up’ services to address the complex problems of social exclusion, reaching out to sectors of the community which are beyond the grasp of traditional state or market providers. This has drawn many voluntary sector organizations into new forms of partnership with statutory bodies. This article draws from a Scottish study to explore the role of voluntary sector organizations working in schools to support the mental well‐being of children and young people. A framework to interrogate the data from case studies is provided by the Scottish Executive, who rehearse four main advantages of such partnerships between state and the voluntary sector. The article concludes that whilst voluntary sector organizations can and do deliver support to children and young people in innovative ways on the margins of school life, the power differential within the school structure makes their position too vulnerable to bring about quick or substantial change.     

Discourses of ‘indiscipline’: a Foucauldian response

Abstract

A recent editorial in the Scottish Educational Journal, the publication of the teacher trade union the Educational Institute of Scotland, headed 'More action, not words needed on discipline', condemned the level of indiscipline, violence and aggression in Scottish schools - in particular that directed against teachers - and criticized the government for its lack of action in tackling the problem. This article examines the way arguments such as this position the individual as 'deviant’ within educational systems. It discusses the importance of metaphor in organizing our perceptions and suggests that an analysis of power relations in schools could give rise to alternative metaphorical concepts that may help to promote the inclusion of children whose behaviour is deemed to be unacceptable.     

Preservice Teachers' Attitudes Toward Inclusion and Toward Students with Special Educational Needs from Different Ethnic Backgrounds

Drawing on social cognition frameworks, we experimentally examined preservice teachers' implicit attitudes toward students with special educational needs (SEN) from different ethnic backgrounds and preservice teachers' explicit attitudes toward inclusive education. Preservice teachers (N = 46) completed an evaluative priming task and questionnaires. Results showed indifferent implicit attitudes toward students with SEN with immigrant backgrounds and positive implicit attitudes toward those without immigrant backgrounds. Furthermore, participants reported a high motivation to act without prejudice toward minorities but held less favorable explicit attitudes toward inclusion of students with SEN, especially students with behavioral problems. Differential patterns of implicit and explicit evaluations could bias teachers' interactions with students. Findings are discussed with respect to implications for educational practice and research.     

Accuracy of teachers’ tracking decisions: short- and long-term effects of accountability

Bias in teachers’ judgment formation and decision making has long been acknowledged. More specifically, studies have repeatedly demonstrated discrepancies between teacher ratings of minority and majority students with similar academic profiles. Studies have also demonstrated that increasing accountability reduced bias. Little is known, however, about the effect of accountability and bias on the accuracy of decisions. This study investigated the short- and long-term effect of accountability priming on the accuracy of transition decisions. It considered both the extent to which teacher decision accuracy differed for minority and majority students with similar academic profiles (accuracy bias) and differences in levels of confidence for accurate versus erroneous decisions (metacognitive judgment bias). In a longitudinal experimental design, we presented 38 primary school teachers with 9 student vignettes at 3 points in time (baseline, post priming, and 6-month follow-up), varying students’ ethnic background, and asked them to make a school tracking decision for each student. We measured decision accuracy as well as teachers’ level of confidence for each decision. Accuracy and confidence levels were combined to provide two indices of metacognitive judgment accuracy. Results confirmed the hypothesis that accuracy of decisions would improve as a result of increased level of accountability. More specifically, we found that teachers made more accurate decisions after priming, whereby ethnic background differences disappeared. In addition, teachers’ metacognitions varied, whereby after priming decision accuracy was better matched with teachers’ confidence levels. Although accuracy levels were still higher at follow-up than at pre-test, the ethnic bias recurred. This study shows that increased levels of accountability are associated with not only increased decision accuracy but also reduced metacognitive judgment bias, especially in regard to minority students. It also demonstrates accountability may be an effective way of reducing systematic errors in decision making. Findings are discussed in terms of theory and current changes in educational practice.     

Teachers’ information processing and judgement accuracy: effects of information consistency and accountability

European Journal of Psychology of Education - Research has shown that teachers are able to adapt their processing strategy of student information to situational demands, whereby they flexibly use...     

Perspectives on Age and Continuing Professional Development for Nurses: A Literature Review

The need for nurses to participate in continuing professional development (CPD) is growing to keep abreast of rapid changes in nursing care. Concurrently, the nursing workforce is growing older. Ageing leads to changes in biological, psychological, and social functioning. Little is known about the effects of age-related changes on nurses’ CPD. A literature review was conducted to examine whether and how CPD differs across age groups. A framework with five perspectives on age was used in an attempt to distinguish factors contributing to these age differences. Given the limited research on this topic with respect to nurses, we also included studies of workers in general. The literature search revealed 27 relevant studies. In general, older workers appeared less likely to participate in CPD, when considering formal learning activities and late-career workers (older than 50/55 years). We found no clear age patterns for motivation to participate in CPD, for learning outcomes, and for participation in informal and non-formal learning activities. The study showed that more nuanced results are found when studies distinguish at least three age groups. By using different perspectives of age, a comprehensive overview of age-related factors in CPD was generated and gaps in current research were identified. Recommendations for further research are discussed, such as the need for research on whether the types of learning activities that nurses undertake change with ageing.     

Learning analytics: challenges and limitations

Learning analytic implementations are increasingly being included in learning management systems in higher education. We lay out some concerns with the way learning analytics – both data and algorithms – are often presented within an unproblematized Big Data discourse. We describe some potential problems with the often implicit assumptions about learning and learners – and indeed the tendency not to theorize learning explicitly – that underpin such implementations. Finally, we describe an attempt to devise our own analytics, grounded in a sociomaterial conception of learning. We use the data obtained to suggest that the relationships between learning and the digital traces left by participants in online learning are far from trivial, and that any analytics that relies on these as proxies for learning tends towards a behaviorist evaluation of learning processes.