Measuring the Results of Performance Improvement Interventions

In this study, a web‐based questionnaire was used to measure attitudes of members of a professional performance improvement organization relative to adoption and implementation of Level 4 or results‐oriented evaluation. Participants were 274 members of the International Society for Performance Improvement (ISPI). It was expected that frequency of Level 4 evaluation use could be explained by innovation diffusion or change variables. Findings suggest that the adoption of effective performance improvement measurement systems and processes at the organizational level is relatively low compared to other types of evaluation. This level of adoption is impacted by a complex array of factors. Stakeholder participation in the adaptation of evaluation systems to increase their compatibility with current practices, and experimentation with this type of evaluation on a limited or trial basis may increase the rate of adoption. Management support of the development and adaptation of a results‐oriented evaluation system is seen as providing the opportunity for the change process to move forward. Implications for diffusion of this type of evaluation within organizations will be discussed within the context of a HPT Change framework.     

An investigation on the correlation of learner styles and learning objects characteristics in a proposed Learning Objects Management Model (LOMM)

The issues of accessibility, management, storage and organization of Learning Objects (LOs) in education systems are a high priority of the Thai Government. Incorporating personalized learning or learning styles in a learning object management system to improve the accessibility of LOs has been addressed continuously in the Thai education system. A proposed Learning Object Management Model (LOMM) is discussed in this paper which aims to adapt and optimize the learning process based on characteristics of the individual learners. This study aims to find the correlation between learning styles and LOs characteristics in the LOMM. Decision Tree and Apriori algorithms were used to generate a predictive model for the classification of learners. Development of the predictive model was based on survey results from 1,586 high school students in Nakhon Ratchasima province, Thailand. The diverse LOs characteristics were analyzed in order to find the correlation with learning styles of the learners. The classification model consists of 24 sub-models used to predict a learner’s class based on 8 groups of LOs characteristics. The best accuracy obtained in the study was 80.23%. Finally, for the next phase this approach has been designed to support the proposed LOMM and it is expected that it could be readily applied to other e-learning systems and digital repositories.     

Theoretical Frameworks of Performance‐Based Models

The purpose of this article is to highlight theories that support the functions of performance‐based design models and to discuss the implications of integrating divergent models into the system‐oriented human performance technology (HPT) and performance improvement (PI) disciplines. HPT, PI, and instructional systems design (ISD) share a systems framework, along with the influence of common theories such as performance theory, learning theory, adult learning, cognitive psychology, and behavioral psychology (Foshay, Villachica, & Stepich, 2014). This article focuses on the role of theory as a tool in the practitioner's toolbox and as a connection point when working with teams and organizations that have different theoretical orientations. Performance‐based ISD models are discussed, including Robinson and Robinson's (1989) Training for Impact, Brethower and Smalley's (1998) Performance‐Based Instruction, and Bradford and Boler's (2015) Horizon Model. Allen and Sites's (2012) successive approximation model (SAM) retains elements of ADDIE as a process, but the model is iterative rather than systematic in design.     

An instructional model for web-based e-learning education with a blended learning process approach

Web‐based e‐learning education research and development now focuses on the inclusion of new technological features and the exploration of software standards. However, far less effort is going into finding solutions to psychopedagogical problems in this new educational category. This paper proposes a psychopedagogical instructional model based on content structure, the latest research into information processing psychology and social contructivism, and defines a blended approach to the learning process. Technologically speaking, the instructional model is supported by learning objects, a concept inherited from the object‐oriented paradigm.     

An architectural specification for a system to adapt to learning patterns

There has been numerous developments in education disciplines, which set fundamental approaches to support experiential learning indexes. On the other hand, learning technology research efforts have been largely focusing on containing education into reusable templates. This paper elevates this reusability quest to map advocated patterns of learning which have proven their pedagogical effectiveness, to guide domain learning-providers meeting dynamic learning profiles. In doing so, we identify sound techniques for learner-profiling based on recommended standards and propose an integration of learner attributes into a learning design model which encapsulates best practice instructional patterns. Taking their roots from behavioral learning discipline, these learning patterns mold contents as a separate process in learning production workflows. The goal of this paper is to form pedagogical pattern specification and design courseware by composing patterns. We suggest a semantic Web implementation of the proposed learning design approach and evaluate its usability and learning performance based on a prototyped framework.     

Design and Validation of MAPS for Educators: A Performance Support System to Guide Media Selection for Lesson Design

The importance of adopting technology‐supported performance systems for on‐the‐job learning and training is well‐recognized in a networked economy. In this study, we present a performance support system (PSS) designed to support technology integration for lesson design. The goal is to support educators in the development of appropriate and effective technology integration strategies for learning and training events. The system is based on the PSS design architecture created by Hung and Chao (2007) called Matrix‐Aided Performance System (MAPS). MAPS was created to minimize navigational confusion and enhance users' comprehension and synthesis of information gathered from the PSS. Fifteen educators and instructional technologists were invited to evaluate the system's readiness as well as to identify potential practical constraints that might hinder its use in a real‐world setting. Findings from a perception survey and focus group interviews confirm the beneficial effects of the unified interface on navigation and orientation of content materials. Feedback provided by participants to improve the system interaction and functionality are also reported to further validate the design architecture of MAPS.     

Supporting Student Teachers' Professional Learning with Standards‐Referenced Assessment

Professional standards in teaching are developed in many education systems, with professional learning and quality assurance being the central purposes of these standards. This paper presents an initiative in developing a professional development progress map (hereafter, progress map) within a learning‐oriented field experience assessment (LOFEA) framework. The article examines the use of a progress map to support professional learning in teaching supervision in the field experience of a teacher education programme. Views of users, including 16 tertiary supervisors and 21 teacher participants of the in‐service programmes, were collected. Issues relating to supporting student teachers' professional learning with standards‐referenced assessment, are discussed around four themes, namely intention, instrumentation, interpretation and implementation.     

Implementing a case‐based e‐learning environment in a lecture‐oriented anaesthesiology class: Do learning styles matter in complex problem solving over time?*

This study explores how students' learning styles influence their learning while solving complex problems when a case‐based e‐learning environment is implemented in a conventional lecture‐oriented classroom. Seventy students from an anaesthesiology class at a dental school participated in this study over a 3‐week period. Five learning‐outcome tests and two course‐satisfaction surveys were implemented during the case‐based instruction using a blended approach (online and face‐to‐face). The results of one‐way ANOVAs with repeated measures revealed that the four learning styles (active–reflective, sensing–intuitive, visual–verbal, sequential–global) did not influence students' learning experience and learning outcomes during the implementation of case‐based e‐learning. However, the pattern of the students' performance graph and further analysis with a liberal approach implied that the active–reflective learning style may influence learning outcomes slightly at an earlier time during the case‐based learning implementation; however, as time passed, this learning style no longer influenced their learning at all. Thus, learning styles may not be considered important or may be considered only during the early stages of instructional implementation in order to facilitate the students' transition to the new case‐based learning environment. It is more efficient to encourage students to adapt to different learning environments than to design adaptive systems in order to embrace diverse learning styles.     

基于Struts架构的固定资产系统设计

研究并设计了一个基于Struts架构的固定资产管理系统。系统设计与实现过程表明,Struts架构能显著提高应用系统的开发效率,使系统具有较高的重用性和可扩展性。     

Design and usability assessment of a dialogue‐based cognitive tutoring system to model expert problem solving in research design

Technology provides the means to create useful learning and practice environments for learners. Well‐designed cognitive tutor systems, for example, can provide appropriate learning environments that feature cognitive supports (ie, scaffolding) for students to increase their procedural knowledge. The purpose of this study was to conduct a series of usability tests of a dialogue‐based design framework for the presentation of domain knowledge and assess how it can be used to actively engage learners in learning about research methods. Three formal usability assessments and an instructor adoption assessment were conducted during the development of the tutoring system. Each usability assessment employed diverse data collection methods to ensure broad and in‐depth coverage of findings. The findings revealed that the dialogue metaphor enabled natural and participatory interactions between the system and users. The feedback prompts or hints and support resources provided opportunities for learning during the process of problem solving. Future research to extend the support of usability assessments is also discussed.     

Evaluating a method for eliciting children's voice about educational support with children with speech,language and communication needs

This article reports the development and evaluation of a toolkit‐based approach to eliciting children's experiences of educational support, where the children in question experience speech and communication needs. The ‘Your Voice Your Choice’ approach was evaluated using a cross‐case analysis methodology, which represents a novel approach to critical examination of the effectiveness of such resources. We explored seven case studies within a critical realist framework. We found that the toolkit was effective at supporting most (although not all) of the children with speech and communication needs to explore their school learning and support experiences through a scaffolded emotion‐based ‘dialogue’, which was corroborated by observations and other data sources. The toolkit facilitated access to children's voice as they revealed how they felt across a number of relational, learning and support areas, which could be used by services to focus provision and consider how to better support children's social and emotional needs.     

学习设计和学习管理系统的新发展

内容对象(ContentObject)和活动/过程对象(Activity/ProcessObject)是当前e-Learning关注的两大领域,基于后者展开的学习设计已成为e-Learning学习平台研究的热点和方向。本文首先剖析了目前主流的基于内容的学习管理系统的缺陷和不足,在此基础上阐述了学习设计(LearningDesign)的核心理念,即要“为学习而设计”,注重学习活动序列的建立和个性化学习路径的设计,而不仅仅是关注学习内容的创建,并简要分析了学习设计同教学设计的关系及其对学习管理系统的影响。随后重点介绍了作为学习设计重要标准的IMS学习设计规范的基本框架,并对当前国内外学习设计支持系统和工具做了简要的分析和对比,从中我们可以看出当前学习设计管理系统领域整体的发展现状和趋势。     

A framework to design open educational resources-integrated online courses for undergraduate learning: A design-based research approach

Open Educational Resources (OER) integrated online courses provide a rich and a flexible learning environment to acquire knowledge and skills among undergraduates. A significant issue with OER-integrated online courses is the poorly addressed instructional design features. Instructionally rich online courses will have a greater impact on both teaching and learning. This study is aimed at exploring different support systems in relation to the undergraduate learning process through the design of OER-integrated online courses. It explored design features under four main Instructional Design (ID) aspects, being: Information Design, Instruction Design, Interface Design and Interaction Design. The study adopted a Design-Based Research approach through analysis, design, development, implementation and evaluation of an intervention in multiple phases, using mixed methodologies. This resulted in a design framework with reusable design principles for OER-integrated online learning. The outcomes of this study will contribute to enhance OER-integrated course design and to develop undergraduate education.

     

LO + EPSS = just‐in‐time reuse of content to support employee performance

Those involved in training know that creating instructional materials can become a tedious, repetitive process. They also know that business conditions often require training interventions to be delivered in ways that are not ideally structured or timed. This article examines the notion that learning objects can be reused and adapted for performance support systems. By doing so, a performance technologist can develop content for just‐in‐case training and reuse it for just‐in‐time performance support.     

Boundary interaction: Towards developing a mobile technology‐enabled science curriculum to integrate learning in the informal spaces

This paper explores the crossover between formal learning and learning in informal spaces supported by mobile technology, and proposes design principles for educators to carry out a science curriculum, namely Boundary Activity‐based Science Curriculum (BAbSC). The conceptualization of the boundary object, and the principles of boundary activity as the key elements to fuse the merits of learning in informal spaces with formal learning, are discussed and elaborated. The key elements of BAbSC are further articulated to provide the framework for curriculum design and development from a holistic perspective. The proposed principles and framework will reinforce the theoretical underpinnings of mobile technology‐enabled curriculum design and development, and can be used to guide teachers to implement curriculum in a more principle‐based and structured manner.     

Assessment of Student Performance: a framework for improving practice

Assessment of student performance and the evaluation of courses and teaching are critical elements in the teaching‐learning environment and are central to each higher education institution's mission of preparing students for the future. There are increasing internal and external pressures for institutions to review and improve their practice in this area. While a vast knowledge‐base exists to inform good practice in assessment of student performance, change in practice seems to be slow. A framework for improving assessment practice, based on a simple quality management model, is provided as are some examples which illustrate application of the model/framework. Some suggestions are also made about support mechanisms and resources required for effecting significant improvement to practice.     

An interactive learning and course development environment: Context,theoretical and empirical considerations

In this contribution, a theoretical and empirical framework based on work carried out at the Open universiteit (Ou) for a new approach towards the design, production and delivery of flexible, interactive learning materials for distance education is presented.

In the Research and Development centre of the Ou, a project has concentrated on the innovation of current approaches. This framework can also be considered as an advance organizer to reading the remaining articles from the Open universiteit in this issue of Distance Education.

A key feature of the innovation is that during the design phase, course developers have to define ‘models’ of the materials to be developed: a content model, a support model, a student model and the learning path. From a flexibility point of view especially, the ‘student model’ is of importance since it defines the student variables that will be taken into account when developing/ presenting alternative materials (basic content and/or embedded support). A computer‐based system, the ‘Interactive Learning and Course Development Environment (ILCE)’, was developed to support the work of course development teams and tutors on the one hand, and students on the other hand. The development system supports the work of the developers; the delivery system supports the study process of students. The delivery is realised as an on‐line course, on the World Wide Web.

Students start working with the ILCE‐system by following an intake procedure. They can make choices in relation to student variables that have been defined in the student model (profession, study intentions, context, etc.). Next, they can ‘on the fly’ generate a course. Rom the large repository of learning materials only those materials are selected and compiled that are in line with the student model of this specific student Furthermore, they can choose to study the materials on screen and/or make prints of the materials. Of course, in printing the materials they lose the interactive and dynamic possibilities of the computer learning environment     

Finding an Educational Perspective for Object‐Oriented Development

The object‐oriented model has become exceedingly attractive as the best answer to the increasingly complex needs of the software development community. The initial boasts regarding quality, reuse, concurrency, and scalability are now being substantiated by documented software development experience. It is certainly appropriate, then, for educators who teach computer science (the current preparation for emerging software developers) to examine where object‐oriented development best fits into the computer science curriculum. How much of the paradigm‐‐language, analysis, design, management‐‐ought to be addressed? At what level in an undergraduate program are object‐oriented techniques appropriate? What are the risks involved? How is the object‐oriented approach effectively taught?.     

Preparing CBI print‐based support material: an information/instructional design perspective

Computer‐based instructional (CBI) materials are frequently accompanied by student study guides. This report details Grant MacEwan Community College's experience in producing print‐based material to support its computer‐managed learning (CML) system. Thus the report is written from a CBI perspective, and attempts to place emphasis on the recognition of cognitive processes in the development of CBI and related materials. Grant MacEwan material has been developed using the instructional design principles promoted by Gagne and Briggs (1979). The first part of this report focuses on content organization. The ideas presented may be applicable to any setting requiring the development of independent study print support material.