The role of hybrid learning spaces in enhancing higher education students’ employability

Graduate employment rates and self-reported employability are increasingly a feature of higher education funding measures. However, graduate outcomes do not denote the whole learning experience of the student nor is the student experience reducible to a single statistic. This paper discusses a design-centric approach to employability development which was enacted within a hybrid learning space. The study engaged 52 final-year speech pathology students, their lecturer, the lead researcher and a career practitioner (advisor) at an Australian university. Students first created personalized employability profiles using an established online self-reflection tool. The online tool produced a personalized report and enabled students to access developmental resources relating to employability and student success. The project team used anonymized student data to transform a previously generic “careers” workshop into a targeted workshop in which students explored individual and cohort findings and participated in developmental activities informed by the data. The initiative’s contribution to learning space research is in its composition as a hybrid learning space in which educators and students engaged as learners and developers of their online learning spaces, and educators collaborated to analyze student data and inform learning and teaching enhancements within the same study period. It is anticipated that the data from subsequent years will inform the curricular review, particularly if subsequent student cohorts express similar concerns. Implications for higher education policy and practice are discussed.     

Staff student partnership in assessment: enhancing assessment literacy through democratic practices

In recent years, research and practice focused on staff and students working in partnership to co-design learning and teaching in higher education has increased. However, within staff–student partnerships a focus on assessment is relatively uncommon, with fewer examples evident in the literature. In this paper, we take the stance that all assessment can be oriented for learning, and that students’ learning is enhanced by improving their level of assessment literacy. A small study in a Scottish university was undertaken that involved a range of different adaptations to assessment and feedback, in which students were invited to become partners in assessment. We argue that a partnership approach, designed to democratise the assessment process, not only offered students greater agency in their own and their peers’ learning, but also helped students to enhance their assessment literacy. Although staff and students reported experiencing a sense of risk, there was immense compensation through increased motivation, and a sense of being part of an engaged learning community. Implications for partnership in assessment are discussed and explored further. We assert that adopting staff–student partnership in assessment and more democratic classroom practices can have a wide range of positive benefits.     

Peer Learning and Assessment

Various forms of peer, collaborative or cooperative learning, particularly small group activities, are increasingly used within university courses to assist students meet a variety of learning outcomes. These include working collaboratively with others, taking responsibility for their own learning and deepening their understanding of specific course content. The potential benefits of peer learning have long been recognised and are especially relevant today. However, many existing assessment practices act to undermine the goals of peer learning and lead students to reject learning cooperatively. If assessment gives students the message that only individual achievement is valued, and that collaborative effort is akin to cheating, then the potential of peer learning will not be realised. Inappropriate assessment practices may also lead to unhelpful forms of competition within and between groups that prevent groups functioning effectively. This paper examines some of the main assessment issues in connection with peer learning and suggests ways in which the benefits of this approach can be maintained while still meeting the formal assessment requirements of the course. It discusses the use of group assessment, peer feedback and self‐assessment, assessment of participation and negotiated assessment and concludes with the identification of a number of issues which remain to be addressed.     

Formative Assessment: Assessment Is for Self-regulated Learning

The article draws from 199 sources on assessment, learning, and motivation to present a detailed decomposition of the values, theories, and goals of formative assessment. This article will discuss the extent to which formative feedback actualizes and reinforces self-regulated learning (SRL) strategies among students. Theoreticians agree that SRL is predictive of improved academic outcomes and motivation because students acquire the adaptive and autonomous learning characteristics required for an enhanced engagement with the learning process and subsequent successful performance. The theory of formative assessment is found to be a unifying theory of instruction, which guides practice and improves the learning process by developing SRL strategies among learners. In a postmodern era characterized by rapid technical and scientific advance and obsolescence, there is a growing emphasis on the acquisition of learning strategies which people may rely on across the entire span of their life. Research consistently finds that the self-regulation of cognitive and affective states supports the drive for lifelong learning by: enhancing the motivational disposition to learn, enriching reasoning, refining meta-cognitive skills, and improving performance outcomes. The specific purposes of the article are to provide practitioners, administrators and policy-makers with: (a) an account of the very extensive conceptual territory that is the ‘theory of formative assessment’ and (b) how the goals of formative feedback operate to reveal recondite learning processes, thereby reinforcing SRL strategies which support learning, improve outcomes and actualize the drive for lifelong learning.     

Promoting assessment efficacy through an integrated system for online clinical assessment of practical skills

This paper presents evaluation outcomes from an externally funded research project involving the online clinical assessment of practical skills (eCAPS) using web-based video technologies within a university medical programme. eCAPS was implemented to trial this web-based approach for promoting the efficacy of practical skills assessment in knee joint examinations for a pre-clinical cohort of second year medical students. eCAPS involves a progressive organisation of online video experiences and task expectations for formative and summative assessments of selected competencies. Data are presented from semi-structured interviews with the medical students (N?=?40). eCAPS successfully supported students’ skill development in knee joint examinations on fellow students and allowed remote assessment of candidates’ performances by clinicians experienced in musculoskeletal examinations. An ‘indicative standard’ paradigm, involving formative assessment of one randomly selected performance from the submission of all students’ responses within a small group, offered an efficient and efficacious avenue for providing consolidated feedback to students and promoted desirable learning behaviours. Overall, there was evidence of reciprocal learning benefits to the ‘blending’ of an online learning and assessment approach with an existing face-to-face environment. The medical students were able to successfully engage online with high quality and consistent practical skill-based materials in a flexible, independent and individual manner.     

The relationship between students’ perceptions of portfolio assessment practice and their approaches to learning

This study focuses on students’ learning approaches in the context of a competency‐based program on Applied Sciences, with portfolio assessment as its core mode of assessment. The study examines students’ perceptions of these assessment practices and the relationships to their learning approaches. Additionally, differences in perceptions and learning approaches between first‐year students and second‐year students, who already have one year of experience with the portfolio assessment practice, are investigated. A total of 110 students completed two questionnaires at the end of the academic year: the Revised SPQ (Study process questionnaire) was used to measure their approaches to learning and the AEQ (Assessment experience questionnaire) was used to measure their perceptions of the assessment practice. The results indicate that, when implementing portfolio assessment, feedback is essential. Moreover, it seems not to be the assessment design, but rather how it is implemented, and how students’ learning is stimulated through the assessment, that influences the quality of learning.     

Enhancing professional writing skills of veterinary technology students: linking assessment and clinical practice in a communications course

Veterinary technology is an emerging profession within the veterinary and allied animal health fields in Australia and affords graduates the opportunity to contribute to the small but growing body of literature within this discipline. This study describes the introduction of a contextualised assessment task to develop students’ research capability, competence and confidence in professional writing, and to engage them with the academic publishing process. Students worked in self-selected dyads to author a scientific case report, of publishable standard, based on authentic cases from their clinical practicum. Intrinsic to the task, students attended a series of workshops that explored topics such as critiquing the literature, professional writing styles and oral presentation skills. Assessment was multi-staged with progressive feedback, including peer review, and culminated with students presenting their abstracts at a mock conference. Students reported the task to be an enjoyable and valuable learning experience which improved their competence and confidence in scientific writing; supported by a comparison of previously submitted work. Linking scientific writing skills to clinical practice experiences enhanced learning outcomes and may foster the professionalisation of students within this emerging discipline.     

Good CoPs and bad CoPs: facilitating reform in first-year assessment via a Community of Practice

The idea and implementation of learning communities are gaining favour in higher education institutions. In particular, there are a number of successful examples to emerge of the application of the Community of Practice (CoP) framework proposed by Wenger [(1998). Communities of practice: Learning, meaning, and identity. Cambridge, MA: Harvard Business School Press] for fostering a learning environment for academics around their teaching practice. In this paper, we describe and reflect on the efficacy of a CoP process that was implemented within our university. The purpose of this CoP was to provide a space for academics to focus on assessment practices for first-year courses and identify opportunities for professional development in this area. For a variety of reasons detailed in the paper, the efficacy of this CoP was limited, and we conclude that in the current higher education environment in Australia, success with CoP approaches to improve learning and teaching outcomes may prove limited.     

Facilitating Student Learning,the Assessment of Learning,and Curricular Improvement Through a Graduate Social Work Integrative Seminar

Social work programs undertake to educate competent professionals and to promote critical thinking among students who are expected to become lifelong learners. In addition, programs are called on to develop reliable and valid measures for assessing student learning outcomes and to use assessment results to reflect upon and strengthen curriculum. This study explores the use of a graduate integrative seminar to accomplish these goals. The authors describe the learning and assessment processes of the seminar. The authors used a mixed-method research design to analyze data from students over a 3-year period regarding the effectiveness of the seminar as well as from graduate faculty regarding student achievement of curricular objectives. Results indicate that formative assessment processes promote student learning in a manner that mobilizes students to strive for excellence, and that an embedded measure of learning outcomes in the form of a final integrative project may serve as a rigorous assessment tool.     

Creating Communities of Shared Practice: The challenges of assessment use in learning and teaching

Teachers and researchers in the field of educational assessment have a strong professional interest in evaluating practices that constitute effective educational assessment at the classroom level. In pursuing these goals it is fundamental for teachers and pupils to grow in a community of shared practice where nothing in the assessment process is hidden and students become assessors of their own learning. The challenge for students and teachers within present-day classrooms is understanding and learning how these communities are created. This paper is based on action research carried out to investigate our own teaching of the subject of assessment at postgraduate level. The focus of the research was to integrate current research evidence within educational assessment into our own professional practice. Such research suggests that to improve learning and indeed teaching, educational assessment must be formative in both function and purpose and must put the student at the centre of the assessment process. The paper describes the processes and procedures by which common meanings of published criteria and assessment quality for masters level coursework held by one community of assessors were shared and interpreted by students to enable them to articulate their own learning through student-self assessment.     

Differences in personalized learning practice and technology use in high- and low-performing learner-centered schools in the United States

The Every Student Succeeds Act supports personalized learning (PL) to close achievement gaps of diverse K-12 learners in the United States. Implementing PL into a classroom entails a paradigm change of the educational system. However, it is demanding to transform traditional practice into a personalized one under the pressure of the annual standardized testing while it is unclear which PL approaches are more likely to result in better academic outcomes than others. Using national survey data of ELA teachers in identified learner-centered schools, this study compared high and low-performing learner-centered schools (determined by their standardized test results) in terms of their use of five PL features (personalized learning plan, competency-based student progress, criterion-referenced assessment, project- or problem-based learning, and multi-year mentoring) and their use of technology for the four functions of planning, learning, assessment, and recordkeeping. Generally, teachers in high-performing schools implemented PL more thoroughly and utilized technology for more functions than those in low-performing schools. Teachers in high-performing schools more frequently considered career goals when creating personal learning plans, shared the project outcomes with the community, and assessed non-academic outcomes. They stayed longer with the same students and developed close relationships with more students. Also, they more frequently used technology for sharing resources and reported having a more powerful technology system than those in low-performing schools. This study informs educators, administrators, and researchers of which PL approaches and technology uses are more likely to result in better academic outcomes measured by standardized assessments.

     

Exploring the Dimensions of Medical Student Engagement with Technology-Enhanced Learning Resources and Assessing the Impact on Assessment Outcomes

Anatomy curricula are becoming increasingly populated with blended learning resources, which utilize the increasing availability of educational technology. The educational literature postulates that the use of technology can support students in achieving greater learning outcomes by increasing engagement. This study attempts to investigate the dimensions of student engagement with technology-enhanced learning (TEL) resources as part of a medical program’s anatomy curriculum using exploratory factor analysis. A 25-item five-point Likert-based survey was administered to 192 first-year medical students, with three emergent factors discerned: satisfaction, goal setting and planning, and physical interaction. The three factors closely aligned with the existing literature and therefore additional nonparametric analysis was conducted that explored the levels of engagement across three custom-made anatomy TEL resources, including: (1) anatomy drawing screencasts; (2) an eBook; and (3) a massive open online course (MOOC). Usage data indicated that the most popular resource to be accessed across the cohort was the anatomy drawing screencasts via YouTube, with the MOOC being used least. Moreover, some evidence suggests that those students who utilized the MOOC were more engaged. Generally, however, no correlations were observed between the levels of engagement and TEL resource usage or assessment outcomes. The results from this study provide a clear insight into how students engage with TEL resources, but do not reveal any relationship between levels of engagement, usage, and assessment outcomes.     

Assessment for equity: learning how to use evidence to scaffold learning and improve teaching

Abstract

This article examines evidence regarding the assessment learning of preservice teachers (PTs) in a new Master of Teaching designed to prepare teachers to address the less than equitable outcomes of certain groups of students in New Zealand. The assessment curriculum was integrated across all of the courses and the in-school experiences as one of six interconnected facets of practice for equity. Evidence about the assessment learning of 27 preservice teachers was collected using a survey, interpretive analysis of three assignments and a focus group interview. The findings demonstrated that preservice teachers combined theory and practice encountered in many contexts to build the assessment understanding and competence needed to address equity issues. We argue that this was facilitated by incorporating the assessment curriculum within each course, intertwining university and school experiences, and the specific focus on addressing equity throughout the programme.     

Speaking the unspoken in learning analytics: troubling the defaults

Abstract

Assessment and learning analytics both collect, analyse and use student data, albeit different types of data and to some extent, for various purposes. Based on the data collected and analysed, learning analytics allow for decisions to be made not only with regard to evaluating progress in achieving learning outcomes but also evaluative judgments about the quality of learning. Learning analytics fall in the nexus between assessment of and for learning. As such it has the potential to deliver value in the form of (1) understanding student learning, (2) analysing learning behaviour (looking to identify not only factors that may indicate risk of failing, but for opportunities to deepen learning), (3) predicting students-at-risk (or identifying where students have specific learning needs), and (4) prescribing elements to be included to ensure not only the effectiveness of teaching, but also of learning. Learning analytics have underlying default positions that may not only skew their impact but also impact negatively on students in realising their potential. We examine a selection of default positions and point to how these positions/assumptions may adversely affect students’ chances of success, deepening the understanding of learning.     

Assessment at the boundaries: Service learning as case study

This article explores the value systems which inform assessment practices in higher education, specifically how particular forms of knowledge valued in the curriculum shape and constrain assessment practices. The data for this article is drawn from two courses which participated in a service learning research and development project at the University of Cape Town. Drawing on Pierre Bourdieu and Basil Bernstein, the article argues that the location of these courses—within the field of higher education and a particular kind of institution, faculty and department—shapes their assessment systems, practices and outcomes in certain ways. What is valued in this field (Bourdieu) is a form of knowledge production which requires students ‘to step out of the particularities’. This form of knowledge operates as a regulative discourse, constituting what counts as legitimate. Using the assessment system as a ‘window’, this article explores how these service learning courses constitute and are constituted by the regulative discourse of the field. While the constraints of the field are powerful, this project offers some hopeful signs of forms of curriculum, pedagogy and assessment that, at the very least, name and challenge these underlying value systems.     

Students’ experience of team assessment with immediate feedback in a large accounting class

Team assessment has been suggested as a competency-based collaborative learning technique. Critical to the success of an assessment for learning, in competency-based education, is the use of formative feedback. This study reports on the development of, and the students’ experience of, a Team Assessment with Immediate Feedback (TAIF), in which immediate formative feedback is provided to the students by their peers and the assessment instrument (the IF-AT^® form). Results of the quantitative and qualitative data, collected in a survey, suggest that the majority of the students experienced the TAIF positively. Many students highlighted that they had constructed new knowledge and understanding of the content and practiced numerous skills during the team assessment. The learning benefits of the immediate feedback component of the team assessment were widely acknowledged by the students. The study also provided some initial evidence that team assessment in a culturally diverse student cohort may enhance intercultural collaboration. Team assessment may also contribute towards re-establishing the link between professional accounting education and practice.     

Considerations in the identification,assessment, and intervention process for deaf and hard of hearing students with reading difficulties

Problematic assessment and intervention issues present substantial challenges when making educational decisions for deaf or hard of hearing (D/HH) students who are experiencing reading difficulties. These students present a diverse set of language acquisition skills, hearing ability, and orientation to early school learning activities that are different from the hearing student population. Given the importance of selecting assessment approaches that lead to effective interventions for D/HH students, three assessment procedures for identification of at‐risk children and learning disabilities within the D/HH population are examined. Assessments reviewed are teacher referral, norm‐referenced testing, and student response to intervention. Challenges to each process and the need for additional assessment and empirically validated treatment options are discussed. Finally, a case example is presented to illustrate a framework that may help school psychologists promote early identification of learning problems and outline interventions that meets a D/HH child's unique needs by focusing on reading outcomes in the curriculum. © 2008 Wiley Periodicals, Inc.     

Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment

This study aims to provide a greater insight into how formative assessments are experienced and understood by students. Two different formative assessment methods, an individual, written assessment and an oral group assessment, were components of a pathology course within a medical curriculum. In a cohort of 70 students, written accounts were collected from 17 students and group interviews were carried out to explore the students’ experiences of these two forms of assessment. All students were engaged in both assessment methods, which were conducted a few weeks apart, and data were collected soon after each assessment. Our findings suggest that formative assessments motivate students to study, make them aware of what they have learned and where they need to study more. Thus, formative assessment can act as a tool for learning, contributing to the process and outcomes of learning. A closer look at students’ experiences of each form of assessment reveals interesting differences.