Qualitative variation in constructive alignment in curriculum design

Constructive alignment has emerged as a powerful curriculum design idea, but little is known of the extent to which the effectiveness of this idea is a function of qualitative variation. This article introduces a model of qualitative variation in constructive alignment, and uses the results from known alignment studies to test the model. The research reviewed reveals that university teachers have at least two qualitatively different experiences of the core elements of constructive alignment. The teachers who describe their approaches to teaching as involving conceptual change/development intentions with student-focused strategies were found to be likely to see the intended learning outcomes for students in more holistic terms, and assessment as an integral part of that teaching approach. When teachers had more of an intention to transfer information using teacher-focused strategies, they saw the object of study more in terms of parts (concepts, definitions, formulae) with assessment focused on those parts. The implications of this qualitative variation in constructive alignment for curriculum design and for the quality of the outcomes of student learning is discussed.     

Creating high challenge/high support academic environments through constructive alignment: student outcomes

Higher education needs to provide challenging yet supportive learning environments catering for students with diverse academic needs. There is also an emphasis on using student-driven outcome measures to determine teaching effectiveness. How can these measures be used to reflect upon and evaluate teaching initiatives? Using an undergraduate occupational therapy programme as the site for exploration, this article reports on an application of constructive alignment principles and describes how available empirical data were used to explore student outcomes. A comparison was made between student evaluations and academic grades prior to, and after the implementation of the initiative. Results provide evidence of improvement in student satisfaction and academic grades as a result of implementing constructive alignment. Whilst it is acknowledged that changes in academic grades and student evaluations can be attributed to a number of factors, findings of this study support a view that constructive alignment facilitates students' learning and experiences.     

Challenges of adopting constructive alignment in action learning education

This paper will critically examine how the two influential pedagogical approaches of action-based learning and constructive alignment relate to each other, and how they may differ in focus and basic assumptions. From the outset, they are based on similar underpinnings, with the student and the learning outcomes in the center. Drawing from experiences of developing an action-based master program in management with the integration of constructive alignment in its curriculum, the purpose is to reflect on what difficulties emerge when adopting both perspectives simultaneously. Constructive alignment works under the premises that the learning goals can and should be decided beforehand in order to align them with learning activities and examination forms. This view brings a challenge for programs where the means of the learning process is provided, while it is much up to the students’ own responsibilities to drive the learning toward some self-governing and internalized learning outcomes.     

The use of scoring rubrics for formative assessment purposes revisited: A review

The mainstream research on scoring rubrics has emphasized the summative aspect of assessment. In recent years, the use of rubrics for formative purposes has gained more attention. This research has, however, not been conclusive. The aim of this study is therefore to review the research on formative use of rubrics, in order to investigate if, and how, rubrics have an impact on student learning. In total, 21 studies about rubrics were analyzed through content analysis. Sample, subject/task, design, procedure, and findings, were compared among the different studies in relation to effects on student performance and selfregulation. Findings indicate that rubrics may have the potential to influence students learning positively, but also that there are several different ways for the use of rubrics to mediate improved performance and self-regulation. There are a number of factors identified that may moderate the effects of using rubrics formatively, as well as factors that need further investigation.     

从建构到一致:学习理论在高等教育领域的发展与实践

建构主义学习理论旨在强调知识是个人主观的建构,学习是主动发生的过程。它在应用到高等教育领域时,受到杜威哲学思想中意图和活动相互联系的信念影响。一致性建构的理念则改变了建构主义仅仅停留在认识论上的思维模式,在本体论范畴强调意义的建构,并有效地诠释了教与学活动、学习评价如何与预期学习成效保持一致。这一理念指导下的以成效为本的教与学是学习理论在高等教育中的实践与应用。从建构走向一致的过程,充分表明高等教育的教与学需要回归到以学生学习成效为本的根本出发点上。     

Implementing constructive alignment in higher education – cross-institutional perspectives from Australia

ABSTRACT

Constructive alignment (CA) has become internationally established as an educational approach linking strategic planning and corporate policy to discipline and course teaching and learning practice. The literature to date has focused predominantly on either single institutional or specific discipline settings and curriculum level initiatives. This research study seeks to broaden the conceptual and methodological perspective on constructive alignment with a cross-institutional study from two Australian universities. The case study learnings from a top-down institutional implementation of CA at one university and the bottom-up teaching and learning approach within the other have been jointly investigated. By mapping the implementation process of constructive alignment, the key strengths and constraints for both approaches have been identified. These findings offer new insights for institutional managers as well as academics and teaching and learning professionals. In addition, a potential ‘gap in the middle’ at faculty level is highlighted. It is within this nexus that the transitions from institutional policy and targets to successful discipline-specific teaching and learning practices and outcomes are shaped. This research seeks to raise the awareness that CA design, planning and implementation should be conceptualised from the outset as a dynamic, multi-directional and iterative process, irrespective of whether a predominantly top-down or bottom-up approach for implementation is chosen.     

Teaching and Assessing Critical Thinking Abilities as Outcomes in an Informal Logic Course

I provide a theoretical framework to show that courses in informal logic can be taught developmentally to focus on a critical thinking practical component. However, efforts must be made to state clear outcomes, such that the content and processes of the course are tailored to achieve the outcomes, and clear criteria are provided for students' learning and assessment of their performance. This framework is an attempt to respond indirectly to the distinction between informal logic and critical thinking, and the concern that informal logic courses only teach abstract principles of reasoning and do not focus on requisite critical thinking abilities, which are contextualised to subject matter. I suggest a plausible connection between critical thinking and informal logic: that learning logical principles of reasoning is necessary, but not sufficient to think critically; there is an extra element which involves learning to apply the principles to various contexts.     

The use of scoring rubrics: Reliability, validity and educational consequences

Several benefits of using scoring rubrics in performance assessments have been proposed, such as increased consistency of scoring, the possibility to facilitate valid judgment of complex competencies, and promotion of learning. This paper investigates whether evidence for these claims can be found in the research literature. Several databases were searched for empirical research on rubrics, resulting in a total of 75 studies relevant for this review. Conclusions are that: (1) the reliable scoring of performance assessments can be enhanced by the use of rubrics, especially if they are analytic, topic-specific, and complemented with exemplars and/or rater training; (2) rubrics do not facilitate valid judgment of performance assessments per se. However, valid assessment could be facilitated by using a more comprehensive framework of validity when validating the rubric; (3) rubrics seem to have the potential of promoting learning and/or improve instruction. The main reason for this potential lies in the fact that rubrics make expectations and criteria explicit, which also facilitates feedback and self-assessment.     

A study of sustainable assessment theory in higher education tutorials

A study of sustainable assessment theory in nine tutorial courses at four colleges demonstrated that three long-term learning outcomes improved: Independence, Intellectual Maturity and Creativity. Eight of 10 traits associated with these outcomes were validated through internal reliability, faculty and student rubrics, and faculty case studies reporting pedagogic innovations and improvements of student abilities in self-assessment. The findings suggest that sustainable assessment theory should be applied using methods encompassing a strong commitment to equity, including shared criteria for long-term learning outcomes and faculty and student monitoring of student progress towards outcomes through periodic rubrics and reflective sessions.     

An exploration of Biggs’ constructive alignment in course design and its impact on students’ learning approaches

This paper investigates whether instructors’ adoption of constructive alignment has any impact on university students’ learning approaches, which are highly correlated with students’ achievement of learning outcomes. A multi-method model with a combination of qualitative and quantitative design was adopted, using document analysis, interviews and survey. The analysis of covariance results suggested that regardless of individual differences, students would adjust their learning approaches and study behaviours in response to the classroom teaching and learning environment. Students in more ‘constructively aligned courses’ were more likely to adopt deep learning approaches and less likely to use surface learning approaches in their study of a particular course.     

Transitioning to learning outcomes at the coalface: An academic’s quantitative evaluation at the course level

Implementation of learning outcomes in Universities has not been seamless – their alignment with assessments requires faculty to specify learning outcomes and show transparent evaluation of this alignment. Difficulties arise transitioning from grading within a range of pre-existing assessment formats to grading common learning outcomes across those different formats. Experiencing this, we performed a quantitative evaluation of students completing an academic literacy course. We aimed to see if student achievement was determined by assessment format or by learning outcomes, and then to identify whether achievement of a learning outcome was equivalent across assessment formats. A twostep cluster analysis identified three clusters of students: high, medium, and low achievers. Strongest predictors of cluster-membership were learning outcomes assessed in the written essay, however scores for each learning outcome when assessed across assessment formats correlated poorly. Faculty should ensure consistent standards in learning outcomes achievement when assessed across different formats, or clearly separate learning outcomes.     

Graduate attributes as a focus for institution-wide curriculum renewal: innovations and challenges

Curtin University's Curriculum 2010 (C2010) initiative aimed at ensuring degree programs were excellent and sustainable. Before C2010, graduate attributes were not universally emphasised and indicators showed room for improvement in generic skills. C2010 focused on embedding graduate attributes through three strategies. The first was embedding graduate attributes in degree programs and mapping for constructive alignment of outcomes and assessments. The second strategy was related: programs were reviewed drawing on evidence including perspectives of graduates, employers and program teams on the relative importance of graduate attributes and the extent to which they were generally demonstrated or developed. The third strategy was a university-wide eportfolio system enabling students' self- and peer-assessment of graduate attributes. Since completion of C2010, proxy indicators show improvement. However, this paper highlights the challenges associated with graduate attributes and renewal. These include: academic staff engagement, the time needed for innovations to come to fruition and evidencing achievement of graduate attributes.     

Bridging the implementation gap: a teacher‐as‐learner approach to teaching and learning policy

A major dilemma facing higher educational institutions around the world is how to achieve quality outcomes for students in an increasingly internationalised and competitive environment. To effect change in teaching and learning, we advocate a teacher‐as‐learner approach to the implementation of teaching and learning policy. Our approach has been influenced by approaches to change management as well as contemporary educational theories, such as constructive alignment and deep and surface approaches to learning. In this paper we use these approaches to evaluate the success of a policy initiative designed to encourage subject coordinators to use a faculty‐endorsed template to embed graduate attributes into their subject outlines. The difficulties experienced by teachers at the disciplinary level in using the subject outline template illustrate how a seemingly positive and well‐intentioned initiative can have a potentially minimal effect on teaching and learning practice and, as a consequence, student learning. We suggest that the Course Experience Questionnaire provides a useful model for evaluating not only teaching but also the management of teaching. As teachers responsible for the implementation of teaching and learning policies, we hope our views will provide a more integrated approach to teaching and learning changes in the higher educational context.     

The coming and going: the work of educational developers when admission criteria and desired outcomes change simultaneously

Higher education is facing a conundrum relevant to the field of educational development: expectations regarding entrance criteria and graduation attributes are changing simultaneously. Biggs' model of constructive alignment can be used to analyze the challenges presented by these shifts in expectation and help educational developers understand their pedagogical implications. In the present article, an expanded model is proposed in which entrance requirements are added to Biggs' original conceptualization. In so doing, the length of the “learning journey” – from entrance to outcomes – can be charted. When entrance requirements and graduate attributes change simultaneously, higher education must accommodate learning journeys of varying lengths and nature. Moving targets such as these can engender a sense of frustration, if not helplessness, for academic staff responsible for curricular and pedagogical enhancement. However, rather than responding with a sense of helplessness, the educational developer should see these shifts as a real opportunity to support the implementation of a broader range of student-centred teaching/learning activities. Recommendations related to educational development consultations are offered.     

Rubrics for developing students’ professional judgement: A study of sustainable assessment in arts education

The participation of students in assessment is known to generate higher-order learning outcomes. This study aims to determine the usefulness of rubrics in aiding the incorporation of undergraduate students into assessor teams for developing their professional judgement. A quasi-experimental study examined the effects of a brief training programme on the use of rubrics, and of the participation of students in rubric creation and moderation discussions. We calculated Cronbach’s alphas, and intraclass correlation coefficients in order to examine the intra- and inter-rater reliability between all the members of the assessor teams. The results demonstrate that only participation in the rubric design and in the moderation discussions regulating their use helped undergraduate students to develop sound assessment skills. We infer that rubrics can help to promote professional judgement if they are conceived as instructional resources for defining and supporting the processes of negotiation and agreement that characterize an assessment culture.     

Passive,active, and constructive engagement with peer feedback: A revised model of learning from peer feedback

To deepen understanding of learning through peer feedback, the current study investigated the relationships between different peer feedback activities (organized into constructive vs active activities) and learning (i.e., transfer to new tasks), examining the nature of activities within provided feedback, received feedback, and revisions in response to feedback. Across five US high schools, 367 students in Advanced Placement classes participated, implementing common assignments and peer assessment rubrics. Provided/received comments and revisions in one assignment, and writing improvements observed in a second assignment were exhaustively coded and subjected to hierarchical model regression analyses. Results showed that constructive activities (providing explanations and making revisions after receiving explanations or providing suggestions) were consistently associated with learning, whereas passive (e.g., receiving feedback without making revisions) or active activities (e.g., implementing specific suggestions) were not. Further, the effects of received feedback on learning were mediated by the number of revisions. Theoretical and practical implications of the findings are discussed.     

Assessment as learning: Enhancing discourse,understanding, and achievement in innovative science curricula

An assessment‐oriented design‐based research model was applied to existing inquiry‐oriented multimedia programs in astronomy, biology, and ecology. Building on emerging situative theories of assessment, the model extends prevailing views of formative assessment for learning by embedding “discursive” formative assessment more directly into the curriculum. Three twenty‐hour curricula were designed and aligned to content standards, and three levels of assessments were developed and used to assess and enhance learning for each curriculum. These assessments included three or four informal “activity‐oriented” quizzes and discursive formative feedback rubrics supporting collective discourse, a “curriculum‐oriented” examination of individual conceptual understanding, and a “standards‐oriented” test measuring aggregated achievement of targeted standards. After two design‐research cycles, worthwhile scientific argumentation and statistically significant gains were attained for two of the three packages on the exam and test. Achievement gains were comparable to or larger than those of students in comparison classrooms. Many existing innovations could be enhanced and evaluated in this fashion; designing these strategies directly into innovations could have an even greater impact on discourse, understanding, and achievement. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1240–1270, 2012