How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

Instructional design and project management: complementary or divergent?

This paper reports the results of a study to identify the extent to which organizations that develop educational/training products are committed to project management, as measured by their project management implementation maturity, as a methodology that is separate and distinct from the processes of instructional design. A Web survey was conducted among 103 public and private sector organizations worldwide that develop educational/training products. Results show no significant difference by project management maturity level in the roles of instructional designer and project manager, although there is some relationship between maturity level and how organizations perceive the skills/competencies of project managers versus those of instructional designers. Further, organizational decision-makers have very specific expectations about the formal education and training of educational/training product development project leaders. The findings should be of value to institutions of higher education in evaluating programs that prepare students for careers in instructional design.     

Erratum to: Effect of Current Electricity Simulation Supported Learning on the Conceptual Understanding of Elementary and Secondary Teachers

This study examined the impact of computer simulation and supported science learning on a teacher’s understanding and conceptual knowledge of current electricity. Pre/Post tests were used to measure the teachers’ concept attainment. Overall, there was a significant and large knowledge difference effect from Pre to Post test. Two interesting interactions were observed during the data analysis. The first was the difference between Elementary and Secondary teachers. Both groups had significant gains, with large effect sizes, but the Elementary teachers (Pre-Mean = 3.70, Post-Mean = 7.51) started lower and ended higher exhibiting a significantly larger gain than the Secondary teachers (Pre-Mean = 4.96, Post-Mean = 6.71). The second interaction was the impact of gender. Both groups showed significant gains, with large effect sizes, but females (Pre-Mean = 3.90, Post-Mean = 7.21) gained significantly more than males (Pre-Mean = 5.13, Post-Mean = 7.01). These results confirm that computer simulation supported science learning can have a positive effect on concept attainment in teachers.     

Intrinsic Factors for Continued ERP Learning: A Precursor to Interdisciplinary ERP Curriculum Design

Unilateral enterprise resource planning (ERP) curriculum improvements from the instructor's perspective are likely to generate only limited success. Understanding student motivations and beliefs with ERP systems is the missing link to effective ERP education. Relatively little attention in the ERP literature has been given to student learning associated with ERP experience, and almost none to factors influencing current and expected student beliefs and behaviors relative to ERP. The complexity of ERP systems demands that beliefs and behaviors be considered when planning ERP curricula. In the present study, the Theory of Planned Behavior was extended to examine students’ intentions to explore additional aspects of ERP after their class exercises. When considering all students, attitude and subjective norm had positive and significant effects on intentions to continue ERP learning. Subjective norm also affected attitude, and availability of support materials had a positive effect on subjective norm. Distinctive patterns are found for the construct relationships between student groups who valued ERP education (the engaged) and those who placed little or no value on ERP education (the undecided). Results from competing model analyses indicate that support materials influenced the engaged and undecided groups differently. Strategies for ERP curriculum design are provided.     

高职园林工程技术专业“园林树木学’’课程改革初探

为适应城市建设和房地产行业的迅猛发展,作为园林工程技术专业（园林规划设计方向）的核心课程《园林树木学》的课程教学必须进行迅速而深刻的改革,应结合国内园林专业学生就业形势以及高职教育的本身特点,改革教学内容、更新教学方法,建立适应市场需要的人才培养新模式,采用多元化考核评定方式,以培养有人才市场、有竞争优势、服务于园林建设行业的专业人才。     

Unfolding Case‐Based Practicum Curriculum Infusing Crisis,Trauma, and Disaster Preparation

The authors evaluated an unfolding case‐based approach to a practicum in counseling course infusing crisis, trauma, and disaster preparation for changes in students’ crisis self‐efficacy across a semester. The course, informed by constructivist‐developmental pedagogy and centered on the unfolding case, resulted in significant increases in students’ crisis self‐efficacy.     

Winning the Battle,Losing the War: Bilingual Teachers and Post-Proposition 227

The implementation of Proposition 227 has created chaos, uncertainty, and a hostile environment for bilingual education teachers. This study describes the experiences of 20 bilingual education teachers in Southern California. In in-depth interviews, teachers speak out about the challenges, frustrations, fears, and the increasing animosity they face on a daily basis, and how they resist and contest the language enforcer role in various ways. Out of the chaos that has been created by Proposition 227, these bilingual teachers have emerged as the language civil rights activists of the new millennium.     

Evaluating a technology supported interactive response system during the laboratory section of a histology course

Monitoring of student learning through systematic formative assessment is important for adjusting pedagogical strategies. However, traditional formative assessments, such as quizzes and written assignments, may not be sufficiently timely for making adjustments to a learning process. Technology supported formative assessment tools assess student knowledge, allow for immediate feedback, facilitate classroom dialogues, and have the potential to modify student learning strategies. As an attempt to integrate technology supported formative assessment in the laboratory section of an upper‐level histology course, the interactive application Learning Catalytics^TM, a cloud‐based assessment system, was used. This study conducted during the 2015 Histology courses at Cornell University concluded that this application is helpful for identifying student misconceptions “on‐the‐go,” engaging otherwise marginalized students, and forming a new communication venue between students and instructors. There was no overall difference between grades from topics that used the application and grades from those that did not, and students reported that it only slightly helped improve their understanding of the topic (3.8 ± 0.99 on a five‐point Likert scale). However, they highly recommended using it (4.2 ± 0.71). The major limitation was regarding the image display and graphical resolution of this application. Even though students embrace the use of technology, 39% reported benefits of having the traditional light microscope available. This cohort of students led instructors to conclude that the newest tools are not always better, but rather can complement traditional instruction methods. Anat Sci Educ 10: 328–338. © 2016 American Association of Anatomists.