Assessment of Student Engagement: An analysis of trends

Quality is a multi-dimensional concept and embraces all functions and activities of higher education (academic programs, research, and community services) in all their features and components. Traditionally quality was a measure of resources and reputation. In recent years there has been a shift in emphasis to institutional best practices such as setting high expectations, providing involving settings, inclusive learning environments and forms of pedagogy that enhance student learning and development. The concept of student engagement is thus receiving increased attention globally as it is viewed as an important element in assessing and improving institutional effectiveness. Trend and longitudinal analyses, as employed in this study, allow an institution to monitor change or stability in performance over time. They assist in determining whether a certain policy or initiative prompted desirable change and in assessing the impact of improvement initiatives such as accreditation.     

Guiding a diverse mix of first-year business students: implications for university administrators,instructors and students

This article describes a collaborative research project by the institutional research group and a team of faculty members at a Canadian university. In response to an increasingly diverse mix of students, the researchers set out to develop an understanding of relationships between student characteristics, categorized as demographic differences, personal attributes and academic preparedness, and student outcomes measured by both grades and student perceptions. Significant differences were found in grades outcomes based on characteristics such as international status, secondary school grades, study habits and writing skills. However, these differences were not evident in student perceptions of course value or learning achievement. This study has important implications for university administrators (recruiting, intake assessment and student support), instructors (understanding of diversity characteristics and how students perceive learning experience) and for students, who can be given an opportunity to better understand how their own personal characteristics might affect their learning experiences and outcomes.

     

Linking student evaluations to institutional goals: a change story

For the past 30?years, beginning with the seminal work of Herbert Marsh in Australia and New Zealand, institutions of higher education have developed internal practices and procedures to collect and analyse student evaluations of teaching and learning. However, the question remains: has this development resulted in the achievement of institutional goals that maximise learning across all teaching contexts? As is the case in many other countries, a recent review of Australian national student evaluation data failed to conclude that student evaluations have improved overall teaching. However, these data have made student perceptions of teaching and learning more salient in the minds of tertiary educators. Certainly, teaching staff are aware of the impacts of student evaluations on informed decision-making, such as the continuation or discontinuation of courses, and on their promotion processes. This paper will review student evaluation practices according to criteria used in change theories, such as the transtheoretical change model (TTM). TTM construes organisational change as a process involving progress through a series of five stages: precontemplation, contemplation, preparation, action and maintenance. This paper will focus on organisational and behavioural outcomes that can be linked to the use of student data. It will recommend strategies for better aligning evaluation results to the stages of change.     

The assessment of learning skills in nursing student selection: A scoping review

Abstract

Higher education student selection has significant societal, institutional and individual impacts. Thousands of applicants apply only for nursing, one of the major higher education disciplines. As the nursing profession is characterised by cognitive requirements, higher education institutions assess the learning skills of nursing applicants. However, there has been no comprehensive analysis of learning skills assessment for nursing student selection. The purpose of this scoping review was to describe the assessment of learning skills in undergraduate nursing student selection. Five databases were systematically searched, and 24 studies published between 2006 and 2016 were included. Learning skills were most commonly assessed using standardised tests in the areas of language and communication, reasoning, mathematics and natural sciences. Overall scores of onsite selection methods were found to best predict future academic performance. The results indicate that higher education institutions may benefit from comprehensive assessment of learning skills in their selection processes. This assessment should focus on a wider range of cognitive aptitudes, including reasoning skills. This review focussed on nursing education, but the results may benefit other higher education disciplines due to the generic nature of learning skills and similar cognitive requirements of higher education studies. The results support the development of more comprehensive and valid methods for assessing learning skills.     

Academic development by way of student affairs: reflections from the first fifty days on the job

ABSTRACT

This reflection on practice describes the first fifty days of a professional transition from student affairs into academic development. Campus collaborations, educational experiences, and holistic student learning are identified as professional parallels between these two institutional divisions. Professionals from student affairs can uniquely contribute to academic development because of their ability to view the campus as a working system and the student as a whole person. This reflection describes how a student affairs background can be a valuable addition and asset to academic development teams.     

Marketing graduate employability: understanding the tensions between institutional practice and external messaging

ABSTRACT

Do the narratives of employability constructed by higher education institutions for marketing purposes differ from the conceptualisation and/or the realisation of employability within those institutions? The study reported here drew on interviews with 16 senior academic and student support staff who were tasked with developing student employability at one of nine institutions in Australia, Canada and the UK. We employed Holmes’ conceptions of employability as possessional, positional or processual to analyse how the interviewees conceptualised employability and the presentation of employability on the institutional websites. We found that most institutions’ employability marketing narratives were inconsistent with the institutional practice reported by staff. We explain this tension in the context of two competing characterisations of higher education: a university-student transaction view; and a learning view. We emphasise the need for internal and external narratives to align and advocate the need for engagement in a constructive and critical dialogue involving all stakeholders.     

The Antiracism Field Assignment

Abstract

As a second article in a series devoted to an ongoing evaluation of our antiracism field project, a controversial assignment rooted in our Smith College School for Social Work's antiracism commitment, this paper focuses on the review of 128 assignments completed between September 1998-August 2000. A thematic analysis of these projects revealed interesting findings regarding the types of projects, population served, race of student, institutional receptivity, factors that enhanced or impeded student learning, obstacles encountered and degree of collaboration. Specific case examples are included that illuminate the complexity of the processes involved in learning skills utilized in antiracism work.     

A Conceptual Change Approach to Learning Science

Summaries

English

Learning science is complex‐‐a student has at different times to acquire new information, reorganize existing knowledge and even discard cherished ideas. In addressing this issue, the analogy between individual learning and conceptual change in scientific disciplines has been fruitful in providing aspects of a suitableframework for analysing science learning. In this paper a model of learning as conceptual change is developed. It investigates the conditions under which an individual holding a set of conceptions of natural phenomena, when confronted by new experiences will either keep his or her conceptions substantially unaltered in the process of incorporating these experiences, or have to replace them because of their inadequacy. The model illuminates the importance of addressing an individual's existing conceptions. It also pinpoints the importance of an individual's metaphysical commitments in influencing scientific learning.     

Short‐term policy support for long‐term school change: a dilemma for reform‐minded practitioners

This paper questions the ability of a reform policy of five years’ duration to create the conditions necessary for practitioners to sustain change. California's school restructuring initiative challenged schools to transfer authority to teachers and to demonstrate that every student could succeed in learning. Analysis of this progressive policy is based upon the ‘best‐case’ experiences of an exemplary elementary school staff. After five years, the teachers are just developing the ability to confront the volatile issues of race and social class that surfaced in their inquiries into persistent disparities in student achievement. Using theories from institutional analysis of organizations, the paper argues that withdrawal of policy support means weakening of the regulative, cognitive and normative legitimacy for the goals and processes of change. Fixed‐term policies which invite radical reform thus leave schools vulnerable to the tradition‐reinforcing institutions that remain after the initiative has ended.     

What motivates higher education educators to innovate? Exploring competence,autonomy, and relatedness – and connections with wellbeing

ABSTRACT

Background: High quality tertiary teaching is important for maximising the impact of tertiary education for students, employers and society, as well as for institutional reputation and accountability. Varied interpretations exist regarding what counts as ‘innovative’ tertiary teaching.

Purpose: This study sought to explore the deeper drivers of motivations of tertiary educators to initiate and implement teaching innovations.

Method: Drawing from the data from semi-structured interviews from a wider study into innovative teaching in a tertiary education institution in Aotearoa New Zealand, we analysed the rationale of 13 expert tertiary educators for teaching in novel ways. The framework for analysis was based on Self-Determination Theory: data were analysed in relation to three basic psychological needs known to impact on motivation and wellbeing – competence, autonomy and relatedness.

Findings: Our analysis suggests that tertiary educator motivation to innovate in their teaching is related to feelings of all three needs. Findings suggest that innovative pedagogical change was linked to educators’ need for feelings of competence in relation to subject area content, pedagogy and developing student competence. Enhancing autonomy for the educators themselves, or for their students, was also an important factor motivating innovative practice. Developing relatedness between students, between themselves and students, and between students and society were reported as motivations for innovative teaching. Some teaching innovations were motivated by the educator’s desire for greater personal or student wellbeing.

Conclusions Educators’ motivations for being innovative in their tertiary pedagogical practice encompassed content, pedagogical, personal and social dimensions. None reported that their innovation was motivated by institutional policy or expectations. The reported challenges to innovative teaching practice, including institutional structures and processes, lack of access to specific technologies, and the time needed to develop and implement changed practice, indicate that educators must be strongly committed to making change in their practice to sustain the effort required.     

Starting Secondary School: The Parents' Perspective

A student led Iraq war protest in a Fresh Start school provides a case study for examining the relationship between political literacy and institutional change. Pragmatic and creative management of the protest encourages a democratic problem-solving process, which contributes to mutual respect and sustained trust between pupils, and staff and pupils. There is evidence to suggest that this democratic experience within the school has the potential to bring a democratic problem solving ethos into the classroom, where learning may increasingly become characterized by individuals achieving autonomy with and for each other.     

A Community of Learners: promoting teachers to become learners

Abstract

This paper describes how the use of video helped us create dialogic intersub‐jective educational spaces in which transformative learning can take place. Focusing simultaneously on two learning contexts: action research and teacher‐student conferencing, it shows how the development of a dialogical space between researchers and teachers in action research enhances the development of such a space between teachers and students in classrooms. In addition, it describes how the participatory research relationship helped illuminate both for teachers and for students what they implicitly know is important to change, as they become aware of new possibilities for pedagogical improvement. Most of all, dialogic video viewing helped them step outside of themselves in order to see each other and return to look at themselves as others’.

     

A Theory of Motivation and Ontological Enhancement: The role of disability policy in student empowerment and institutional change

As debate continues around the nature and values of education, it is important to ask the question of what factors motivate a student to engage with the ends of an educational institution. In this paper, a broad, holistic view of learner motivation, derived from Aristotelian ethics, is used to provide a model to drive institutional change.

Focussing on the approach of one Higher Education institution to the particular accommodations required for students with disabilities, the paper identifies three factors which motivate students, a failure to engage with the aims and ends of the educational project, a failure to see that a particular learning aim is worth attaining, and a simple lack of will‐power to attain it. To each of these failures a social cause is identified, and a change in both the institutional culture and the individual learner's approach to their education is suggested.     

本土化学生学习调查工具的开发初探

当前我国高校内部评价体系中普遍缺少直接针对学生学习的评估。为此,国内院校有必要构建本土化的学生学习调查。学生学习调查作为院校研究范畴内学生学习评估最常用的范式,无论在理论上还是实践上都已经十分成熟。本研究通过借鉴美国的相关经验,从院校研究的角度出发,利用社会科学的研究方法,构建出符合自身发展需要的学生学习调查问卷,为调查后续的构建工作打下良好的基础。     

USING COMPUTER CONFERENCING IN TEACHING

For 3years, I have been teaching neuroscience courses by using computer conferencing to complement the traditional lectures. Typically, the conferencing involved local, on‐campus students, although one semester the class was combined from on‐campus and off‐campus students. For most of my 33‐year teaching career, I had used the teaching approach that most professors use, which is what educational theorists call “instructivist.” Critics call that “stand and deliver.” Lecturing is an efficient way to dispense organized information, but it does not ensure learning nor is it very effective in showing students how to learn on their own.

Instructivism can be enriched by complementing it with “constructivist” approaches. Constructivists argue that there is a direct relationship between the amount of learning that occurs and the extent to which the environment provides a rich source of engaging experiences in which students construct their own knowledge and understanding. I have found that such an environment is readily provided by computer conferencing.

In my teaching of neuroscience, I have used a network software system (FORUM) for small student groups to conduct a variety of constructivist learning activities. Within weekly deadlines, students worked in groups at their own pace and time of convenience. My impression of the advantages of such conferencing for constructivist activities include the promotion of socialization in “cyberspace,” providing an environment for team learning, the reduction of social problems in face‐to‐face instruction, increased teaching and learning efficiency, more comprehensive means for assessing student learning, and improved quality of student work.     

Overarching professional identity themes in student teacher workplace learning

ABSTRACT

This study reports on how student teachers learn in the workplace. Data from 10 student teachers were collected by means of digital logs and in-depth interviews. By reconstructing data into stories and unravelling these stories, it became clear that the learning process of each student teacher was dominated by one specific theme, such as student-centred teaching or creating a positive learning climate. These themes could be typified as professional identity themes, because all appeared to be both personal and professional. Five student teachers experienced their workplace learning process as continuous: they integrated their teaching experiences relatively easily into their personal conceptual framework. The other five experienced their workplace learning process as discontinuous: they experienced tensions caused by frictions between personal and professional aspects of becoming a teacher. Both types of learning can stimulate and hinder student teachers’ professional development. The findings indicate that reconstructing data into stories and unravelling these stories is a useful technique for understanding student teacher workplace learning as a result of the interaction between personal and professional aspects of becoming a teacher.     

Improving the Research Climate in Social Work Curricula

Abstract

Research courses are associated with performance anxiety and educational insecurity for many social work students. This paper makes the case that student anxiety associated with research courses is rooted in the history of the social work profession, and this history sheds light on the present day climate of research in social work education. The authors suggest that improvement to the research climate in social work education requires an “institutional” response. To that end, this paper describes a committee process that resulted in changes to one school's curriculum policy by revamping student learning objectives for a sequence of five research courses that spanned BSW and MSW programs. The committee produced a continuum of student learning expectations based on Bloom's taxonomy, which represents a logical progression of knowledge and skill competencies as students advance through their course work.     

Online Learning Readiness

ABSTRACT

This paper examines the relationship between student characteristics of online learning readiness and student outcomes in online courses at two higher educational institution. Data were collected from student surveys (student characteristics of readiness and outcomes) and merged with institutional student information systems data (e.g., demographics and course grades). Multiple regression analyses revealed that several student characteristics of online learning readiness significantly influenced student outcomes. MANOVA analyses were conducted to examine between group differences of each student characteristics among underrepresented student groups. Significant findings are reported for minorities and for students with disabilities.