From course assessment to redesign: a hybrid-vehicle course as a case illustration

Assessment has become a central aspect of engineering education for evaluating student learning, attaining accreditation, and ensuring accountability. However, the final step of the assessment process, which requires assessment results be used to redesign courses and programmes, is appreciably underdeveloped in the literature. As such, this work suggests a process, based on the engineering problem-solving method, to analyse and act on problems and successes identified in the assessment results. The process is illustrated through an application to Colorado State University's new programme for Hybrid-Electric Vehicle Engineering, for which the redesign process was originally created. Readers will benefit by simplifying and systematising the essential aspect of the assessment process – application to course redesign – for use in both research and practice applications.     

Book Review: SOAR to College Success and Beyond

Educational Psychology Review -     

Applying cognitive load theory to the redesign of a conventional database systems course

Cognitive load theory (CLT) was used to redesign a Database Systems course for Information Technology students. The redesign was intended to address poor student performance and low satisfaction, and to provide a more relevant foundation in database design and use for subsequent studies and industry. The original course followed the conventional structure for a database course, covering database design first, then database development. Analysis showed the conventional course content was appropriate but the instructional materials used were too complex, especially for novice students. The redesign of instructional materials applied CLT to remove split attention and redundancy effects, to provide suitable worked examples and sub-goals, and included an extensive re-sequencing of content. The approach was primarily directed towards mid- to lower performing students and results showed a significant improvement for this cohort with the exam failure rate reducing by 34% after the redesign on identical final exams. Student satisfaction also increased and feedback from subsequent study was very positive. The application of CLT to the design of instructional materials is discussed for delivery of technical courses.     

Computer-based course evaluation: an extended technology acceptance model

This study explored the antecedents of students’ intention to participate in computer-based course evaluation. The study proposed an extended Technology Acceptance Model (TAM) that integrated subjective norm and perceived relevance into TAM. Based on the responses from 149 business school students in Macao, the study identified the direct and indirect effects of subjective norm and perceived relevance on perceived ease of use, perceived usefulness and students’ intention to participate in computer-based course evaluation. The results of structural equation modelling showed that subjective norm had a positive, strong and significant effect on perceived relevance that in turn affected perceived ease of use and perceived usefulness. Besides, subjective norm and perceived usefulness had direct effects on students’ intention to participate in computer-based course evaluation. Thus, subjective norm played a major role in affecting Chinese students’ participation in course evaluation.     

航海实训课程评估项目微课化探讨

航海实训项目的最大特点就是利于微课化教学和翻转课堂教学,若是把模拟器教学内容制作成微课供学生使用是最好不过的。部分航海实训内容需要以微课教学的方式去摸索,我们也要对航海实训评估项目进行分解,对航海实训课程评估项目的微课制作方法、后期的加工、视频的转码以及网络共享等诸多问题进行了深入分析与了解。     

Bridging the gap: an alternative tool for course evaluation

The increasing perception of students as customers of services puts a stronger focus on improving the quality of the student experience. Satisfaction with aspects of service, such as access, flexibility and fitness for purpose can be assessed through student feedback questionnaires. The results of these surveys may not immediately suggest strategies for making improvement. How to bridge any gaps between what students look for and what they experience requires knowledge of student expectations and experiences separately. This paper describes an alternative evaluation tool, QUEST, based on a service template approach and explains how it has been used for evaluating the level of student satisfaction with HE distance education courses. QUEST is web‐based and produces a measure of satisfaction for a range of service quality aspect of the course provision. The results can be interrogated at several layers of detail to produce a clear picture of where issues arise and to identify how they might be addressed. The paper describes how these outputs from an evaluation might be interpreted to suggest strategies for improving the fit between what students look for from a particular course of study and what they experience.     

Instructional redesign: Developing learning communities in academia

Traditionally, learning is provided in a unidirectional manner from instructor to learner. This practice can be limiting to all individuals involved in the learning process. To develop quality instructional materials, the learning team can participate in instructional design and development (ID) as partners. This article discusses a proposed learning community to be created during the process of course redesign. Human performance technology and ID professionals who use learning community practices can improve their designs by including all relevant stakeholders.     

Faculty ratings of course evaluation items

Instructors whose teaching was evaluated by students were given the opportunity to rate how applicable the evaluation items were to their classes. This study examined the kinds of items which instructors felt to be applicable or inapplicable, the relationships between the student ratings and the instructor applicability ratings, and the effect on an overall evaluation score of using the instructor applicability judgments as weights.Results generally support the consensus procedure of establishing rating forms; they suggest that the common criticism that faculty judgments of item applicability are influenced by anticipation of student ratings may be true for specific items and that while weighting composite evaluation scores by means of faculty applicability judgments does not affect those overall scores, the distributions of certain items may be altered.     

Online vs. offline course evaluation revisited: testing the invariance of a course evaluation questionnaire using a multigroup confirmatory factor analysis framework

Educational Assessment, Evaluation and Accountability - Survey-based formats of assessing teaching quality in higher education are widely used and will likely continue to be used by higher...     

Freshman perceptions of instructor fairness and expertise: A problem in course evaluation

This paper reports a study based on Bruner, Shapiro and Tagiuri's conception of lay personality theory. The trait implication questionnaire adapted from Bruner et. al. was used to investigate the way in which freshmen students make inferences about instructor fairness and expertise. Results are discussed in light of their implications for the use of student course evaluations.     

Responding to student expectations: a partnership approach to course evaluation

This paper presents a study that used newly developed instruments to investigate student expectations at two points in a semester‐based course. Course convenors were able to make some changes in response to the feedback, explain to students how the feedback had informed the course processes, and work with tutors on delivery enhancements. The administration of these instruments, a partnership approach involving students, tutors and lecturers, contributed to the creation of a responsive teaching and learning environment. In addition to enabling real‐time changes to be made, evaluation of the total teaching and learning experience ensured that improvements were made to subsequent offerings of the same course. Also, insights from one course were evaluated in terms of applicability to other courses offered within the same academic discipline. The study finds that establishing student expectations provides a framework for developing a responsive and iterative approach to achieving excellence in teaching and learning.     

Teaching English grammar in initial teacher training: a course evaluation

The article evaluates a course in English grammar taught to a group of secondary PGCE students specializing in English with Drama. The course concentrated on parts of speech, morphology and syntax but also included sessions on 'applied' grammar. The students' knowledge and understanding were assessed in an initial audit at the beginning of the course and in a test at the end to try to establish how much they had learned. Students' opinions of the course were also elicited. Results were mixed. Although all students improved their knowledge (some dramatically so), and expressed satisfaction with the course, approximately one-third failed to reach the required standard. The implications of this for course planning are discussed.