Towards an understanding of instructional design heuristics: an exploratory Delphi study

Evidence suggests that experienced instructional designers often use heuristics and adapted models when engaged in the instructional design problem-solving process. This study used the Delphi technique to identify a core set of heuristics designers reported as being important to the success of the design process. The overarching purpose of the study was: (1) to examine and describe the heuristics that guided instructional designers’ practice and (2) to identify the relationship between these heuristics and key competencies of the discipline, as outlined by the International Board of Standards for Training, Performance, and Instruction. Sixty-one heuristics were ultimately identified (reached consensus). All 61 aligned with at least one of the four categories of IBSTPI, with some aligning with more than one. More specifically, 17 heuristics aligned with Professional Foundations competencies, 17 aligned with Planning and Analysis competencies, 18 aligned with Design and Development competencies and 10 aligned with Implementation and Management competencies. By examining instructional design heuristics, we hope to better understand the potential genesis and/or future application of each heuristic. Results provide insights into the specific heuristics experienced designers perceive as being effective during the ID process.     

Instructional design and project management: complementary or divergent?

This paper reports the results of a study to identify the extent to which organizations that develop educational/training products are committed to project management, as measured by their project management implementation maturity, as a methodology that is separate and distinct from the processes of instructional design. A Web survey was conducted among 103 public and private sector organizations worldwide that develop educational/training products. Results show no significant difference by project management maturity level in the roles of instructional designer and project manager, although there is some relationship between maturity level and how organizations perceive the skills/competencies of project managers versus those of instructional designers. Further, organizational decision-makers have very specific expectations about the formal education and training of educational/training product development project leaders. The findings should be of value to institutions of higher education in evaluating programs that prepare students for careers in instructional design.     

Examining Instructional Design Principles Applied by Experienced Designers in Practice

There has been ongoing debate regarding the efficacy of teaching instructional design models to novice designers given that experienced instructional designers often use principles and adapted models when they engage in the instructional design problem‐solving process. This study utilized the Delphi technique to identify a core set of guiding principles used by designers in their practice. The purpose of this study was (1) to examine and describe the principles that guided instructional designers’ practice and (2) to identify the extent to which participants’ frames of reference included components of the ADDIE instructional design model. Sixty‐one principles were ultimately identified (reached consensus among the Delphi panel members). Thirty‐two of the principles aligned with the primary components of the design process (e.g., analysis, design, development, and evaluation). Additional principles (n = 29) related to other characteristics of design such as communication, project management, and design characteristics.     

Developing competence profiles for educators in environmental education organisations in the Netherlands

This qualitative study explores the meanings and possible merits of introducing competence profiles for enhancing professional development in the environmental education sector in the Netherlands. It presents the three most important environmental education jobs and their underlying competencies alongside their core professional challenges, as identified by environmental educators and experts in the Netherlands. The jobs are: education practitioner, programme leader, and organisational manager. The core professional challenges for the education practitioner entail: developing demand‐driven instructional programmes and spontaneous, ad‐hoc programmes, and addressing task and goal orientations. For the programme leader, they are acquisition of new projects, quality assurance, and project management; and for the organisational manager, they are human resource management, financial management, representing the organisation and showing its performance. The results of the study should inform educational institutions how to develop relevant programmes for future environmental educators, and for the professional development of environmental educators in environmental education organisations.     

Instructional Design Competencies for Online High School Teachers Modifying their own Courses

This study identifies competencies specific and beneficial to online high school teachers that are modifying their own courses. Existing instructional design standards, available to guide online teachers, are not only too numerous, they are also inconsistent. Moreover, a lack of clarity exists about which specific standards benefit this emerging professional group in the process of developing and revising their courses. The Delphi design enabled participants in related fields and separated by physical distance to make and refine judgments without stress and with anonymity, to achieve consensus on specific competencies. Based on this consensus, online high school educators now have a clearly defined set of instructional design competencies that will support modifying learning objects within their classes.     

Management of non-consensually shared youth-produced sexual images: A Delphi study with adolescents as experts

There is an increased availability of online child abuse images, a proportion of which is created by young people in coercive and non- coercive relationships (sexting).ObjectivesThis Delphi study with adolescents as "experts" who had taken and shared sexual images, was conducted to identify appropriate responses to sexting where images are shared without consent and identify indicators of distress and ways to facilitate disclosure when the sharing of images causes anxiety or is associated with further victimization.Participants and setting124 adolescents from the United Kingdom completed an online survey. All self-identified as taking and sharing sexual images of themselves. 45 provided full survey responses (73% female; mean age 16.24) and of these 23 completed the second round. Recruitment was through social media and local schools.MethodsAn online two-round Delphi method was completed using a vignettes-based questionnaire. To assess consensus, a defined average percentage agreement (80% cut-off) was used. Qualitative content analysis identified relevant themes in responses to Round 1 which informed the Round 2 items.ResultsIn the first round 60 items were identified that endorsed views of problem identification, facilitation of disclosure, proportionate responding, and problem management. Overall, participants agreed that the clear majority of statements identified in Round 2 were important and thus achieved consensus.ConclusionsThis study represents a novel and inclusive approach through the formation of an expert panel of young people. These views may inform appropriate victim-centered management of cases where images have been shared without permission.     

Career counselling issues in Canadian counsellor education

The purpose of this project was to examine the preparation of counsellors, with particular concern for the development of competencies in career guidance. It used a structured interview to survey faculty members involved in counsellor education in faculties of education offering graduate programs. It found increased awareness of career development in terms of increase in the number of graduate courses offered. It also found emphasis upon the consullative role for counsellors, vocational theories of Super and Holland, and continued interest in the development of career counselling competencies.Submitted to the Ninth International Round Table for the Advancement of Counselling,Submitted to the Ninth International Round Table for the Advancement of Counselling,     

Do Principals Affect Student Outcomes: An Organizational Perspective

This research study investigated the principal's role as instructional manager, its relationship to student achievement, and how principals influence teachers to accomplish the school's goal of increasing student learning. Conceptually, principal instructional management includes those processes, both mental and physical, that the principal uses which result in other people executing formal and informal duties to achieve organizational goals. It deals mainly with planning, organizing and controlling teacher behavior to achieve organizational goals, but also includes monitoring and controlling resources. Subjects for the study included elementary school (K‐8) principals and teachers in 27 schools. Student achievement gain was determined by regression analysis where current achievement was regressed on prior achievement and SES for two years of data. Principal instructional management behavior was measured by a modified form of the Instructional Management Rating Scales, or IMRS (Hallinger, 1983). The results from the study question whether principals should be led by researchers and policymakers into thinking that increasing their instructional management behaviors will turn ineffective schools into effective ones. School improvement is a complex process that involves a host of factors which principals can influence, but not control. While principals play an important role as part of the schools' efforts in school improvement, the role of the principal in school improvement, must be placed in its proper perspective.     

Validating teaching competencies for graduate teaching assistants: A national study using the Delphi method

In this study the Delphi Method was used to validate teaching competencies of graduate teaching assistants (TAs). Through the use of expert opinion, a panel of national leaders in teaching assistant support and training validated twenty six competencies as important in the preparation of teaching assistants. Feedback from panelists suggested that some instructional competencies depend on the specific responsibilities that are assigned to an individual TA.Ronald D. Simpson is Director of the Office of Instructional Development at The University of Georgia, where he also is professor of Higher Education and Science Education. He holds degrees from The University of Tennessee and The University of Georgia. Kathleen S. Smith is Coordinator of Teaching Assistant Support at The University of Georgia, Office of Instructional Development. She holds graduate degrees from The University of Georgia and has served as Administrative Coordinator and Acting Head of The University of Georgia's intensive English program. Her research and teaching focuses on the development and administrative support of teaching assistants with emphasis on International Teaching Assistants.     

Enhancing instructional design efficiency: Methodologies employed by instructional designers

Instructional systems design (ISD) has been frequently criticised as taking too long to implement, calling for a reduction in cycle time—the time that elapses between project initiation and delivery. While instructional design research has historically focused on increasing learner efficiencies, the study of what instructional designers do to increase efficiency during the design of instruction, including web‐based training, has not yet been fully examined. The purpose of this qualitative developmental study was to identify and understand the methodologies used by experienced instructional designers to increase the efficiency of the instructional design process. Data were gathered from 11 instructional designers working within two business and industry consulting firms that provide learning solutions to global clients. Results revealed 47 efficiency methodologies found within the four categories of design model, instructional design team member roles, instructional design processes and instructional design tools. Additionally, 14 supporting instructional designer competencies were found within the category of instructional designer knowledge, skills and attitudes.     

Relative Importance of the Institute of Food Technologists (IFT) Core Competencies—A Case Study Survey

ABSTRACT: Nearly 90% of graduating seniors from the Food Science program at Purdue University gain employment in the food industry. Ensuring the program is meeting employers' needs is one mission of our curriculum committee with input from an Industrial Advisory Board (IAB). In light of the recent outcomes-based assessment requirements outlined by IFT, feedback from our IAB members regarding the relative importance of the core competencies was needed. The objective of this study was to survey the IAB members regarding relative importance of each of the 46 core competencies. Each competency was ranked using a Likert scale from 1 = not important to 5 = very important. Statistical analysis was conducted using the Mann-Whitney nonparametric test. Significant differences (P = 0.05) were found between several of the five content categories with Success Skills scoring highest (4.35 out of 5) on relative importance followed by Applied Food Science Knowledge (4.02 out of 5). Also, significant differences (P = 0.05) were found between competencies within each content category. Overall, the results suggest that the 46 core competencies should not be given the same instructional weight within a curriculum. One option for addressing the variation in importance could be to include some planned redundancy within the curriculum for those core competencies that were ranked the highest. In addition, part of the outcomes-based assessment process should include measures of the level of competency being achieved by graduates. By considering relative importance and competency achieved by graduates, important areas for improvement can be identified.     

An international study of the changing nature and role of school curricula: from transmitting content knowledge to developing students’ key competencies

The primary purpose of this study is to investigate how key competencies can be incorporated into school curricula, what relevant instructional methods are needed and what institutional support is required to make school curricula based more on key competencies. For this, the study uses qualitative data from three schools (one each in South Korea, Australia, and New Zealand). The results indicate that a transformative approach, not an additive approach, is required. That is, teachers tend to restructure existing curricula to develop students’ key competencies instead of considering the latter as a new teaching component. In terms of instructional methods, teachers are likely to believe that more engaging and participatory instructional methods would help their students to practice and develop diverse aspects of their competencies. Further, the principal’s efforts to enhance communication and interaction with teachers is crucial to constructing local definitions of key competencies and shared visions for integrating such competencies with school curricula and instruction. The results indicate a need for redirecting the role of school curricula from transmitting content knowledge of academic subjects to developing students’ key competencies.     

Developing Web-based Interdisciplinary Modules to Teach Solid Waste/Residue Management in the Food Chain

ABSTRACT: A Web-based interdisciplinary instructional resource was developed to provide information that will increase food science educators' knowledge of waste management in the food chain. The 4 modules are: legal implications for management of wastes/residues; identification, quantification, and characterization of wastes/residues; management of wastes/residues; and economic ramifications of wastes/residues. Instructional materials are available for faculty and GTAs for use in teaching the 4 modules. Food science educators can use this Web-based instructional tool as an educational resource in their undergraduate classes to enhance students' knowledge and ability to solve critical environmental problems in the food chain. See http://www.oznet.ksu.edu/swr/home/welcome.htm     

Identification of Core Competencies for an Undergraduate Food Safety Curriculum Using a Modified Delphi Approach

Identification of core competencies for undergraduates in food safety is critical to assure courses and curricula are appropriate in maintaining a well‐qualified food safety workforce. The purpose of this study was to identify and refine core competencies relevant to postsecondary food safety education using a modified Delphi method. Twenty‐nine experts representing food safety professionals in academia, government, and industry were given 2 rounds of questionnaires that specified initial food safety competencies, core domains, and subdomains. Competencies were defined as a set of skills, knowledge, and abilities that correlate to success of a trainee. The framework for which competencies were classified consisted of (1) core domains, defined as broad food safety subjects; and (2) subdomains, or more specific food safety subjects. The expert panel used a 5‐point Likert scale with an acceptance criterion, or consensus, of 75%, with a rating of “4” or greater. After 2 rounds of questionnaires and revisions from the expert panel, 5 core domains were established: (1) Food Production, Manufacturing, Retail, and Consumer; (2) Foodborne Hazards; (3) Public Health; (4) Legislation and Policy; and (5) Communication and Education. Specific responses from the experts highlighted areas in which further curriculum revision would be beneficial. This study provides a framework for the development of a vetted, standardized undergraduate food safety curriculum. The Delphi method, with its inclusion of professionals representing various sectors of food safety, provided relevant perspectives for curriculum design, and also allowed participants the opportunity to contribute to the education of future food safety professionals.     

教育技术项目的矩阵式组织结构及设计原则

组织是一切管理活动取得成功的基础.教育技术项目管理作为教育技术领域一种新型的管理方式,其组织结构与传统组织有不同之处.以"项目经理"为矩阵式组织结核心的"矩阵式项目组织结构"能够有效避免传统职能型组织的缺点.教育技术项目组织设计应遵循权变原则和责权对称原则.     

A review and new framework for instructional design practice variation research

This article reviews practice variation in the field of instructional design. First, it compares instructional designer practice as reported or observed in several classic research studies. This analysis is framed by the standards established by the International Board for Training, Performance, and Instruction competencies for planning and analysis, design and development, implementation, and management. Although no certain causal linkages exist, we briefly review some of the reasons posited in the literature to explain instructional design practice variation (lack of time and resources, control in decision making, the designer's perception of a task, underlying philosophical beliefs, and designer expertise). Limitations of the literature base are explored, followed by a proposal for an alternative view of instructional design practice variation and recommendations.     

优秀软件项目开发团队建设浅论

软件项目开发队伍是项目型软件企业生存和发展的基础,企业高层、中层和项目经理直接影响项目开发团队的建设。其中,项目经理起决定作用,项目经理要保持与上级领导及客户有良好的沟通,要建立合适的项目管理架构、项目管理制度及项目开发规范和流程等。     

浅议如何做好施工项目经理工作

在现今企业界,项目经理是一个非常重要的职业岗位,更是一个头衔,还是一个领导者,这就要求在一个具体项目中集权、责、利于一身的项目经理需要具备领导能力,管理能力,沟通能力。在合谐社会的大背景下。项目经理还必须要学会和谐管理。     

If You Don't Know,Ask! Using Expert Knowledge to Determine What Content Is Needed in an Undergraduate Food Quality Management and Control Course

Quality management and quality control of food products are critical to producing food that is safe to consume and has consistent quality and sensory attributes. The extent to which undergraduate students are equipped with competencies in quality management/control, in theory, has a direct connection with their career potential to ensure food products and/or services meet the expectations of consumers and society. However, the most important quality management/control competencies for undergraduate food science students have yet to be identified. The objective of this study was to determine key knowledge and skills in quality management/control needed by food science graduates. A modified Delphi method was used to gather consensus on these knowledge and skills from experts in food quality management/control. Surveys were used to establish a framework of the most relevant quality management/control concepts for undergraduate food science students to learn and organize these concepts into core domains according to their relative importance. A course outline for teaching an undergraduate course on food quality management/control was developed that detailed relevant topics and depth of coverage for each of these topics. The needs assessment method used in this study to align course content with food industry's needs may be used for a wide variety of course topics.