Instructional design project success factors: An empirical basis

Instructional design and development (ID) projects are undertaken every day, with project stakeholders attempting to concentrate their efforts and resources on the factors leading to a successful project. What are the factors that contribute to ID project success? Are they equally important to all stakeholders in an ID project? This article addresses these questions regarding ID project success. Using a variety of data-gathering techniques and incorporating the perspective of four stakeholder groups, this study identified twenty-three ID project success factors that were grouped into four categories. Data analysis revealed significant differences among: (a) the four stakeholder groups in terms of the importance they attached to the factors; and (b) the four success factor categories in terms of their importance to ID project success. Also, an interaction was found between stakeholder groups and success factor categories.     

Peer to peer support: the disappearing work in the doctoral student experience

This paper reflects on the importance of study groups in contributing to a positive postgraduate experience and explores specific concepts, such as ‘disappearing behaviours’ in contrasting the ‘official’ languages of universities with the beneficial behaviours found through study groups. Additionally the paper advocates the systematic inclusion of strategies such as study groups in the postgraduate experience. Funding arrangements and research frameworks for higher education in Australia focus on student progress and completion, as well as comparison of research quality within and between universities. As a result, there is a significant emphasis on timely completion of postgraduate degrees. This paper posits that there is an apparent contradiction between the indicators of success in this area, such as completion rates and annual progress reports and the positive contribution that study groups can make to the doctoral student experience.     

ECVET and ECTS credit equivalency in higher education – A bridge too far?

The implementation within Europe of a credit system for vocational education and training known as ECVET is a European Commission priority. The potential for permeability between the ECVET and European Credit Transfer and accumulation System (ECTS) was foreseen in the Recommendation to establish ECVET in 2009, while the Bruges Communique of 2010 called for the promotion of flexible links between vocational and higher education and increased coherence between ECVET and ECTS. To this end a significant number of EU-funded projects were undertaken to explore compatibility between ECVET and ECTS. This article reviews the findings of these projects and reflects on their success in terms of achieving this policy goal. These bridging projects identified several points of compatibility between the two credit systems and produced valuable tools and frameworks to facilitate such permeability. Achieving credit equivalency between ECVET and ECTS does not appear feasible, rather the evidence points to using a learning outcomes-based equivalency framework. However, this article calls into question the sustainability of these project results with regard to the lack of success in translating these findings into practice and the lack of co-ordinated efforts to implement these findings at a national or pan European level.     

Considerations for the Occasional Project Manager

Performance improvement professionals who occasionally manage projects can benefit from applying the discipline of project management. This article offers a checklist of proven techniques that lend themselves to most projects. Many techniques are applicable even in organizations lacking a project management culture. These techniques do not assume formal project management training. The checklist draws on common elements identified through a review and analysis of key sources that outline the ingredients for project success, such as communication, stakeholder engagement, executive support, and risk management.     

Project-Based Learning Communities in Developmental Education: A Case Study of Lessons Learned

This case study tracks the application of project-based learning (PBL) during four separate college terms at Portland Community College in Portland, Oregon. Each term follows a different learning community of first-term college students enrolled in a program of developmental education (DE), reading, writing, math, and college survival and success (CSS) courses. The study documents the journey from a pilot PBL model to the improved model used today, focuses on each term's PBL goal of increasing student success, and outlines how the PBL succeeded or failed based on student demonstration of their learning community's intended core outcomes. Whereas the initial two terms’ projects were unsuccessful, the framing of a new question and the addition of service learning in the next two terms’ projects made a significant improvement in student self-motivation and helped students achieve intended core outcomes by their own agency. Such active learning and self reliance increased students’ confidence as it challenged them to use their new course skills to create a project they were proud to present to a wide audience. This study then explores the challenges and benefits of integrating the two curricular frameworks, learning communities and PBL, within interdisciplinary courses that include service learning. Considering the already established literature on the success of learning communities and the continually growing literature on the implementation of PBL, this study ultimately demonstrates how to arrive at a project that invigorates a learning community of students, whether the learning community is in one course or spread throughout several interdisciplinary courses.     

绩效考核下高校研究生教改项目研究——以上海高校为例

随着教学改革的不断深入,当前大部分高校都十分重视教改项目的立项工作,但对项目的过程、结题及推广管理却重视不足。由于教改项目管理流程不规范、过程监控体系不健全、项目评价指标不合理等,教学改革的进程中逐渐凸显绩效不达标、项目无法结题等问题。文章以上海高校为例,围绕高校研究生教改项目的现状,分析目前教改项目存在的问题,并且就高校研究生教改项目的改革创新提出若干思考。     

Informal learning in the workplace

This paper focuses mainly on theoretical frameworks for understanding and investigating informal learning in the workplace, which have been developed through a series of large‐ and small‐scale projects. The main conclusions are included but readers are referred to other publications for more detailed accounts of individual projects. Two types of framework are discussed. The first group seeks to deconstruct the ‘key concepts’ of informal learning, learning from experience, tacit knowledge, transfer of learning and> intuitive practice to disclose the range of different phenomena that are embraced by these popular terms. The second group comprises frameworks for addressing the three central questions that pervaded the research programme: what is being learned, how is it being learned and what are the factors that influence the level and directions of the learning effort?     

开放远程学习质量评价指标

评价指标是用来表明某种水平状态、测量某项活动进展的专业术语。开放远程学习是面向大众传播课程的新兴模式,其质量评价的范围主要包括开放远程学习的办学机构、学习项目、资源和接受者4个方面。各评价范围之内分别包含具体的评价指标,如学习项目包括规划、课程与教学、课程传输和评价等,每一项评价指标对应于具体的评审内容。这对实践者具有指导价值,有利于开放远程办学的规范化和学习质量的提升。在使用评价指标进行开放远程学习质量的评价时,不仅仅要注重定量分析,还需要特别关注定性判断。     

SWOT Criteria for the Strategic Evaluation of Work Integrated Learning Projects

Abstract

Work integrated learning (WIL) is an integral part of the curriculum in higher education institutions (HEIs). WIL project leaders require a strategy to evaluate the success of WIL projects. This article reports on the evaluation criteria used in assessing the strengths, weaknesses, opportunities and threats (SWOT) identified in WIL projects. This multi-qualitative research was conducted to determine and confirm the SWOT criteria deemed significant for WIL project evaluation. Feedback was collated from 12 WIL specialists, representing the major HEIs in South Africa. The Delphi technique and inductive content analysis formed the basis of the research method. The key finding revealed that the strengths of WIL projects should be evaluated by measuring how well the WIL project maintains a competitive advantage and has a strong financial budget. Major weaknesses of WIL projects are a lack of strategic direction and the HEI’s lack of sound academic offerings and reputation.     

Post-secondary education for young people with intellectual disabilities: A systematic review of stakeholders’ experiences

Post-secondary education (PSE) is an important option in the educational and employment paths of students with intellectual disabilities (ID). However, PSE for young adults with ID is not in wide use across the world. Different issues might affect the geographical spread of PSE programmes. Some of these are related to the attitudes, expectations and/or funding for those programmes. In this systematic review, the PSE experiences of different stakeholder groups (young adults with ID, their parents, PSE staff and students without a disability) were examined by reviewing findings across 22 studies that investigated PSE for students with ID. This examination encompassed attitudes and motivation to engage with PSE, as well as stakeholders’ perceived barriers and facilitators in accessing and remaining in the three PSE models (separate, inclusive and mixed). Students with ID and their parents were the stakeholder groups least represented in the available evidence. Findings suggested that most stakeholder groups reported positive experiences of PSE derived mostly from gains in social skills and independence. Several barriers to accessing PSE were reported by each group, namely physical and academic barriers by students with ID, an understanding of the PSE system by their parents, and the lack of training by PSE staff. Evidence from the present review seems to indicate that inclusive PSE models were associated with a more positive experience across stakeholder groups.     

Scientific knowledge and attitude change: The impact of a citizen science project

This paper discusses the evaluation of an informal science education project, The Birdhouse Network (TBN) of the Cornell Laboratory of Ornithology. The Elaboration Likelihood Model and the theory of Experiential Education were used as frameworks to analyse the impact of TBN on participants’ attitudes toward science and the environment, on their knowledge of bird biology, and on their understanding of the scientific process. The project had an impact on participants’ knowledge of bird biology. No statistically significant change in participants’ attitudes toward science or the environment, or in participants’ understanding of the scientific process, could be detected. The results suggest that projects must make explicit to participants the issues that they are experiencing. In addition, the results suggest that more sensitive measures need to be designed to assess attitude change among environmentally aware citizens.     

A methodological framework to analyze stakeholder preferences and propose strategic pathways for a sustainable university

Building sustainable universities calls for participative management and collaboration among stakeholders. Combining analytic hierarchy and network processes (AHP/ANP) with statistical analysis, this research proposes a framework that can be used in higher education institutions for integrating stakeholder preferences into strategic decisions. The proposed framework is applied to a private university in Turkey as a case study through a survey of 30 participants, representing key internal stakeholder groups. The present research extends the literature by adding a statistical analysis component involving a diverse sample of stakeholders, while previous applications of AHP/ANP in higher education involve a single or a few decision makers. The survey demonstrates stakeholder priorities with respect to sustainability performance indicators and a set of investment projects as well as how they change under low, medium and high financial constraints. The study finds that, while stakeholders have varying opinions regarding sustainable development, generally their highest priority is teaching, followed closely by research. Further, although stakeholders assign a high priority to environmental initiatives when the concern is service and social responsibility, they do not consider such investments profitable. Lastly, it appears that “high visibility” projects gain priority as the level of financial constraint increases.     

Evaluating child and family demonstration initiatives: lessons from the comprehensive child development program

The Comprehensive Child Development Program (CCDP) was a demonstration project designed to test a specific model of service delivery for young children and families in poverty. Following the evaluation’s failure to show strong impacts, early intervention has come under fire from opponents in the popular literature and in Congress. We conclude that shortcomings in both implementation and evaluation contributed to the failure to demonstrate effectiveness. Lessons learned from the CCDP are articulated, addressing the roles of demonstration projects and their evaluations, the problems associated with evaluating programs early in their implementation, the importance of assuring appropriate treatment quantity and quality, and the judicious use and interpretation of large-scale randomized evaluations.     

Trade-Offs, Biases, and Uncertainty in Project Planning and Execution: A Problem-Based Simulation Exercise

The ability to plan and execute projects is a fundamental skill required among managers and business school graduates. In the opening phase of a project, the project team makes decisions about the relative priority of project time, cost, and performance objectives, oftentimes without complete information about customer and stakeholder requirements. Existing project management curriculum assists in developing skills to decide among these priorities in the abstract through paradigms such as the time–cost–performance triangle, with limited attention to the improvement of skills required to develop solutions to these trade-offs, particularly in uncertain and ambiguous project environments. Further, there is often an underlying bias in project teams toward consideration of the project task and project deliverables and reduced attention to time and cost objectives. This study demonstrates the benefits of a balanced approach to setting project time, cost, and performance objectives using a goal-based simulation exercise entitled "The Bridge to Project Leadership." Results for 124 project teams illustrate the tendency to ignore this balanced approach, resulting in reduced project performance, even among experienced project managers.     

A reflexive model for teaching instructional design

Although there are numerous models to practive instructional design (ID), few instructional models to teach instructional design have been documented. This article documents a five-year study of two instructors who collaborated on formally studying their teaching of a master's level instructional design course. A reflexive instructional approach was used, in which the teachers examined their teaching while students were being prompted to reflect on their learning of instructional design through a course-long ID project. In this article we summarize our views on learning, teaching, and instructional design. A design and development framework from developmental research (Richey & Nelson, 1996) was used to describe our teaching in terms of the design decisions, model implementation, and model evaluation across six deliveries of the ID course from 1994–1998.     

A meta-look at meta-studies of the effectiveness of development assistance to education

What insights and generalisations can be drawn from looking across the work of multiple governmental and non-governmental organisations aimed at supporting basic education in low and medium income countries? To address this question, this study analysed findings of nine evaluation meta-studies completed by international assistance organisations, each of which was examining the effectiveness of their work in basic education over a multi-year period. The value of the underlying project activities reviewed in these evaluations represents $6–$6–8 billion. Studies analysed with respect to (a) the criteria each used to judge success of their underlying projects, (b) the extent to which these studies focused on outcomes and impacts, (c) the extent to which projects were judged sustainable, (d) the adequacy of the project-level evaluations being reviewed, (e) what the underlying projects accomplished, (f) weaknesses identified in underlying project designs and (g) cost. A major weakness identified in almost all of the meta-studies reviewed was the paucity of evidence regarding the impact of the project activities in promoting student learning outcomes.     

The third generation Logical Framework Approach: dynamic management for agricultural research projects

Abstract

The Logical Framework Approach (LFA) is a project design and management tool which has been used by many foreign assistance agencies during the past 20 years. Recent innovations in LFA theory and practice have led to a Third Generation of LFA use resulting in its increased effectiveness and practicality as a tool for designing, implementing and evaluating agricultural research projects. Amongst these innovations are: 1) team-based (or participatory) use of the LFA; 2) guidelines for applying the LFA to research projects; 3) LFA software, enabling much more dynamic use of the approach; 4) better integration of the LFA with other project implementation tools; 5) better understanding of practical indicators for project performance and supporting monitoring and evaluation methods and; 6) a better understanding of the critical success factors required for sustainable and effective LFA use within institutions. Lessons are derived from efforts to introduce the Third Generation LFA to the National Institute for Agricultural Research (INRA) in Morocco.     

Effect of sex,class standing,and academic performance on perceived importance of teacher behaviors

An implicit assumption made in most teaching evaluation instruments is that teaching behaviors are equally important to students. Using specific teacher behaviors which have appeared in a number of teaching assessment devices, the importance of teacher behaviors questionnaire (ITB) was constructed to measure students' perceptions of the importance of selected teacher behaviors. Data collected from 105 college students were utilized in the present study for the following purposes: (a) to determine if there are differences among students' ratings of teaching behaviors in terms of importance and (b) to determine if the ratings of importance given to selected teacher behaviors vary according to students' sex, class standing, or academic performance. Results of the study indicated that there were significant differences in perceived importance of selected teacher behaviors. Furthermore, it was found that ratings of some of these behaviors tended to vary across sex groups. Implications for utilizing importance information as a weighting component in teaching evaluations are discussed.     

Identifying a K-10 Developmental Framework for Teaching Philosophy

Abstract

The intention of the study was to identify predictable opportunities for teachers to scaffold middle year students’ philosophical learning. Such opportunities were identified in terms of students’ readiness to learn certain behaviours in the context of a ‘community of inquiry’. Thus it was hoped that the project would provide a useful resource for the teaching of philosophy to middle year students by ascertaining how amenable philosophical learning was to this approach. The study investigated the following questions: (i) what are the indicators of the development under the influence of the COI?; (ii) do these indicators cluster in any particular way? and (iii) is it possible to identify any clustering of indicators that suggests developmental bands?