Formative assessment of teachers in the context of an online learning environment

This case study looked at how an assessment strategy designed for an online learning environment can support teachers’ professional development. More specifically, we intended to evaluate how a particular online assessment design can help the participating in-service teachers to recognize the added value of formative assessment, and promote their own use of formative assessment in their professional classroom practices. The presented assessment design consists of a combination of different, non-standard assessment methods in an online environment. We analysed data from 494 questionnaires, the participants’ critical reflections about their learning and the participants’ produced artefacts. The findings illustrate the participants’ recognition of the formative character of the proposed assessment design, reflected not only by the high scores reported in seven of the eight themes explored, but also from the qualitative analysis of the participants’ reflections and artefacts. Suggestions are offered for the improvement of the proposed assessment design, so as to better promote the formative character of assessment. In particular, implications for the development of formative assessment in online professional development are discussed taking into account its potential to promote the participants’ self-regulatory learning processes.     

Windows into teaching and learning: professional growth of classroom teachers in an online environment

The Windows into Teaching and Learning (WiTL) project was developed by researchers at one large urban institution in the southeast region of the United States as a way to facilitate online clinical experiences for content area methods students during summer coursework. Utilising both synchronous and asynchronous elements, WiTL addressed the issue of students gaining meaningful clinical experiences in coursework offered during the summer. Though the purpose of WiTL was initially for methods students to engage in observations of and conversations with practising classroom teachers, an unanticipated outcome occurred. In this paper, the authors describe the WiTL process and discuss the impact it had on the professional growth of the practising classroom teachers. The results indicate that WiTL encouraged teachers to utilise reflective practice in rethinking their pedagogy and used technology to facilitate professional learning community among classroom teachers.     

Building an online community to support the professional development of casual teachers

Abstract

With the burgeoning casualisation of the higher education workforce, the precarious nature of casual teaching has become increasingly well documented. Universities are recognising that enhancing quality learning and teaching must include attention to the provision of services, support, and professional development for teachers employed on a sessional or casual basis. This paper presents a study investigating an online course for supporting and connecting dispersed and diverse casual teachers at an Australian university. The study explores the role of community and the impact of professional development for casual teachers across discipline boundaries in an institution-wide online course.     

Facilitating flexible learning by replacing classroom time with an online learning environment: A systematic review of blended learning in higher education

Higher education institutions are trying to provide more flexibility and individualization, which is mainly realized through the use of new technologies and implemented in online or blended learning designs. This systematic review aims to investigate the impact of replacing classroom time with an online learning environment. The meta-analysis (k = 21 effect sizes) applied strict inclusion criteria concerning research design, measurement of learning outcomes and implementation of blended learning. The estimated effect size (Hedge's g) was positive, although not significantly different from zero and the confidence interval [-0.13, 0.25], suggesting that overall differences between blended and conventional classroom learning are small, and, at best, very small negative or moderate positive effects are plausible. This means that despite a reduction in classroom time between 30 and 79 per cent, equivalent learning outcomes were found. Consequently, blended learning with reduced classroom time is not systematically more or less effective than conventional classroom learning.     

Instructor-provided summary infographics to support online learning

Infographics are a visualisation tool that can be used to improve retention, comprehension and appeal of complex concepts. The rise of infographic use in education has facilitated new forms of application and design of these tools. Instructor-provided summary infographics are a new form of infographic, whereby key learning objectives and content are summarised in graphical form at the end of a lesson. However, it is unknown whether these types of infographics can support learning in online environments. This exploratory research investigates student perceptions, retention, applications and activity generation of instructor-provided summary infographics in a massive online learning environment. Using both post-course learner survey data (n = 1,899) and text mining analysis (n = 72,490 words), results present how learners perceived instructor-provided summary infographics as useful and appealing for retaining, clarifying and understanding learning concepts. The research contributes a novel understanding of summary infographics in online learning environments, and supports their use as a design tool for educational delivery in the online space.     

Supporting computer-mediated learning: A case study in online staff development and classroom learning environment assessment

The rapid growth of online learning has led to the development of staff inservice evaluation models that are geared towards improving degree programs. Based on best practices in student online assessment, the Online Faculty Development and Classroom Learning Environment Assessment course was designed to serve the dual purpose of staff development and classroom learning environment assessment. Results of analyses showed that the course maximised the potential of online staff development for encouraging staff to reflect on Curriculum and Teaching Capacities (CTC). Implications are discussed in terms of emphasising the process of online CTC learning and incorporating perspectives to capture a comprehensive view of staff teaching attitudes and their association with student perceptions of the classroom learning environment.     

Effects of feedback on collaborative writing in an online learning environment

The need for supporting student writing has received much attention in writing research. One specific type of support is feedback—including peer feedback—on the writing process. Despite the wealth of literature on both feedback and academic writing, there is little empirical evidence on what type of feedback best promotes writing in online environments. This article reports on research that tries to determine what type of feedback best improves the quality of collaborative writing and what the effects of feedback are on student learning in an environment based on asynchronous written communication. The results reveal that concerning the type of feedback, epistemic feedback or epistemic and suggestive feedback best improve the quality of collaborative writing performance. The nature of the feedback-giver (whether teacher feedback or teacher and peer) makes a difference to the final text only when the feedback is epistemic, or epistemic and suggestive.     

Committing to quality learning through adaptive online assessment

With advances in computer‐based technologies and the emergence of e‐learning, there are unprecedented opportunities to reconsider assessment of learning (and, axiomatically, of teaching) and how this can be undertaken. One approach is adaptive assessment. Although it has existed in the tertiary environment since the time of the oral examination, advanced technologies allow much fuller exploitation of the possibilities inherent in a dynamic system of testing that responds to the user. Having described the characteristics of adaptive assessment, this paper considers how it can achieve significant pedagogical aims within the sector. The paper differentiates between adaptive assessment to assist learning and adaptive assessment to assess achievement. How adaptive assessment can be put in place and salient issues, such as security and system integrity, when such assessment is used for credit, are then discussed. The paper concludes that the capability exists but it has yet to be exploited within higher education as a viable approach to assessment and as a contributor to quality learning.     

Using Facebook groups to support social presence in online learning

Building interpersonal connections in asynchronous online learning is important, but it is harder to achieve compared to face-to-face learning experiences due to its mostly text-based nature. Facebook is a popular social media platform and has been used as an outside-class communication space in formal learning contexts to supplement cognitive and affective aspects of learning. In this study, we used Facebook groups as supplemental social spaces in two asynchronous online master’s-level courses to understand if it impacted students’ perceptions of social presence (i.e., copresence, immediacy, and intimacy), learning interaction with faculty and peers, as well as sociability of the online learning environment. The results indicated that students felt more positively about social presence and learning interactions with other classmates and their instructor and perceived the course as having more sociability after they joined the class Facebook group. Findings have implications for supporting social impression formation in online learning.     

Using a wiki to facilitate an online professional learning community for induction and mentoring teachers

The purpose of this case study was to report on the use of a wiki as a tool for conducting online professional learning communities (OLCs) with 26 induction and mentor teachers. Data sources include teachers’ wiki postings and teacher interviews. Results indicate that: (a) Web 2.0 tools may be most effective in OLCs when the social features are utilized in addition to the features that enable task completion; (b) Using Web 2.0 tools restrictively, and without consideration of their affordances, may inhibit the success of OLCs; (c) Online learning communities for induction teachers may be most effective when supplemented with face-to-face discussion; and (d) A task-driven environment in OLCs can encourage professional dialogue and reflection, but may make induction teachers feel isolated and unsupported.     

Post-secondary educators' professional development: Investigation of an online approach to enhancing teaching and learning

Faculty in post-secondary institutions must continually reassess, refine, and revise their teaching, yet it is a challenge for them to gain this professional development with heavy teaching responsibilities and high demands on their time. Creating Optimum Learning Environments (CREOLE) is a collaborative project between one community college and one university to develop an online training program for post-secondary education faculty on the basic principles of teaching and learning and the development of online courses. Four independent modules were developed and taught in a one semester format for educators throughout the U.S. The goal of this research was to identify the strenghts and challenges of this course; determine the changes in pedagogical practice of the participating faculty members; and to examine the resulting changes in participants' course materials to reflect learning and motivation theories, and appropriate online learning strategies. Methods included pre- and post-surveys of the participants, interviews, document analysis, and instructors' reflections. Results demonstrated high expectations from all participants, difficulty in forming a sustained learning community, continuing challenge in technological aspects, and requirement for intense instructor involvement to maintain morale.     

Analysing feedback processes in an online teaching and learning environment: an exploratory study

Within the constructivist framework of online distance education the feedback process is considered a key element in teachers’ roles because it can promote the regulation of learning. Therefore, faced with the need to guide and train teachers in the kind of feedback to provide and how to provide it, we establish three aims for this research: identify the presence of feedback according to the regulation of learning required; characterise this feedback according to content (i.e. the meaning of feedback); and, finally, to explore possible relationships between feedback and the results of the teaching and learning process (i.e. students’ satisfaction and final grades). The results for a sample of 186 students, taking nine courses at the Open University of Catalonia, are discussed in the light of feedback, which is considered a central element in university teaching practice in online environments. We conclude that, in general, the presence of feedback is associated with improved levels of performance and higher levels of satisfaction with the general running of the course.     

Modeling collective attention in online and flexible learning environments

Understanding how collective attention flow circulates amid an over-abundance of knowledge is a key to designing new and better forms of online and flexible learning experiences. This study adopted an open flow network model and the associated distance metrics to gain an understanding of collective attention flow using clickstream data in a massive open online course. Various patterns and dynamics of attention flow were identified and are discussed here in relation to learning performance. The results show that the effective accumulation, circulation, and dissipation of attention flow are important contributors to academic attainment. Understanding the patterns and dynamics of attention flow will allow us to design cost-effective learning resources to prevent learners from becoming overloaded.     

Transforming professional learning and practice in assessment for learning

Assessing student learning is a complex process requiring teachers to have deep knowledge of the curriculum, assessment, and pedagogy. Changing political climates mean that teachers are expected to respond to new approaches or systems and adjust their classroom practice accordingly. Teachers often engage in professional learning (PL) to assist their knowledge and classroom practice, but what impact does PL have on their assessment practice as well as student learning and achievement?

This paper examines optimal PL principles, the New Zealand assessment policy context, and application of assessment for learning principles in a nation-wide PL programme. Empirical data presented in relation to the five levels of Guskey's (2002) Guskey, T. R. (2002). Does it make a difference? Evaluating professional development. Educational Leadership, 59(6), 45–51.[Web of Science ®] , [Google Scholar] model evaluating PL indicate successful outcomes at the classroom level. However, application of Carless’ (2005) Carless, D. (2005). Prospects for the implementation of assessment for learning. Assessment in Education: Principles, Policies & Practices, 12(1), 39–45.[Taylor & Francis Online] , [Google Scholar] theoretical framework on embedding PL changes in schools reveals an area of neglect: attending to system (macro) level needs. Collaborative partnerships between schools and the wider community are posited as essential determinants of assessment literacies and transformational PL in times of political change.     

Towards flexible learning for adult learners in professional contexts: an activity-focused course design

This article argues for a flexible model of learning for adults which allows them to make choices and contextualise their learning in a manner appropriate to their own professional practice whilst also developing as a member of a learning community. It presents a design based around online ‘learning activities’ which draws on ideas of constructivism, collaborative learning and reflective practice. The model was developed for adult learning in Higher Education, and has been adapted and extended to a number of different programmes. Implementation of the model for the Teaching Qualification (Further Education) has been the subject of an interpretative evaluation using a multiple methods approach. Learners' experiences of this programme together with issues associated with the application of the model to other programmes are discussed.     

Teacher professional standards to support teacher quality and learning in Estonia

In the modern world, teachers are expected to be ‘learning professionals’ who constantly expand their knowledge and skills and share both practical and theoretical insights in a community of colleagues. Teacher professional competence‐based standards could be an instrument to support teachers' professional learning if they are integrated with broader assessment and evaluation frameworks and if their evaluation, professional development and career advancement are in line with the standards. In Estonia, teacher professional standards were first developed in 2005. Currently, they support initial teacher education, the evaluation of teacher competences and the design of continuous professional learning. They also allow teachers to progress to the senior teacher and master teacher qualification level. According to our findings, the standards are successfully used to design pre‐service education and award certificates at the end of the studies. However, they do not support building the teachers' career ladder and only in some schools do they support planning of professional learning. In this article, we give an overview of the changes in the professional standards of teachers in Estonia and analyse why they have not found the desired degree of use in teachers' career advancement and professional development in the school context and why they have not had a significant effect on teacher status in society.     

Supporting writing for assessment in online learning

This article explores some specific issues involved in online learning and assessment. It draws on data from a postgraduate course for professional educators, delivered globally online, and highlights the relationship between students’ online discussion and their written assessed work, arguing that we need to focus on both of these in terms of the writing demands they make on students. In so doing it utilizes a theoretical framework which conceptualizes writing as contextualized social practice. The paper illustrates the complexity of the rhetorical demands being made on students in these new environments of teaching and learning and, in focusing on writing, complements present approaches to online learning which have, to date, tended towards collaborative and constructivist perspectives. The article highlights the relationship between pedagogy, technology and assessment. It concludes with a discussion of the design of an online writing resource to support student writers on this particular masters programme.     

Exploring educators’ professional learning ecologies in a blended learning environment

In recent years the concept of learning ecology has been interpreted in different ways to highlight its potential for learning and professional development. However, there are several aspects that still deserve to be understood such as, eg, the role that the different contexts come to play within a learning ecology. For this purpose, this paper presents and discusses the results of a study exploring the learning ecologies of educators in a blended programme delivered in higher education. The participants in the study were 85 professionals in the field of education aged between 28 and 58 years. The research design adopted here can be defined as a convergent mixed method where both quantitative and qualitative data were collected through an e-portfolio. The study found that educators in the sample had different postures, of whom some more aware of their professional roles or Self than others. Moreover, different professional identities seemed to be linked to different learning ecologies, where elements like formal or informal education, cultural artefacts, personal experiences, colleagues or work experiences played a different role. Formal education emerged as having a questionable function, while colleagues came up as a crucial resource.