Leveraging competency framework to improve teaching and learning: A methodological approach

A number of engineering education programs have defined learning outcomes and course-level competencies, and conducted assessments at the program level to determine areas for continuous improvement. However, many of these programs have not implemented a comprehensive competency framework to support the actual delivery and assessment of an individual course. This paper highlights how a competency framework can be used across the life cycle of a course to effectively deliver and assess course content, and give valuable, timely feedback to students thus, improving teaching, student motivation and learning. A framework for leveraging course competencies during course design and delivery is presented, and addresses the following five phases of a course, namely, content design, assessment design, content delivery and assessment, assessment results analysis and feedback, and content review. Using a large first-year core course of the BSc (Information Systems Management) program, at School of Information Systems, Singapore Management University, Singapore—called Information Systems Software Foundation (ISSF)—as an example, this paper shows how course competencies support the framework’s five phases. Data from a student survey indicates that the framework has contributed to enhancing their motivation to learn, provides enhanced learning experiences in terms of helping students prepare for each assessment, providing better feedback by raising awareness of what they know and do not know, and revisiting topics that relate to competencies that have not been fully acquired. Results from interviewing instructors revealed that the competency framework provides valuable and timely feedback on how students are performing, and additionally what changes are required to both the content and method of delivery in order to improve teaching. This contributes towards more effectively closing the “teaching and learning loop”.     

Facebook-Induced Motivation Shifts in a French Online Course

This study explores the effects of instructor’s self-disclosure using the Facebook social networking online platform on students’ motivation types in an online language course. The participants were 104 beginning French students enrolled in an online French course at a major research university in the southeast U.S. The participants were divided into a Facebook group, where they could access the instructor’s Facebook profile throughout the semester, and a control group. The Academic Motivation Scale (Noels, Pelletier, Clement, & Vallerand, 2003) was used for determining whether the participants were intrinsically or extrinsically motivated, anchoring this research within the Self-Determination Theory model (Deci & Ryan, 1985). Post-treatment results indicated that participants assigned to the Facebook group experienced a significant shift in motivation type that research has determined as being beneficial for language learning (Gardner, 1985). No such shift occurred in students assigned to the control group. This shift is of particular importance in an online course environment where the instructor’s Facebook profile was the only means of teacher’s self-disclosure unlike a face-to-face environment where teacher self-disclosure can occur spontaneously.     

The relationship between student learning process,study success and the nature of assessment: A qualitative study

Assessment has an important role in affecting students’ learning, but qualitative studies regarding this relationship are rather scarce. In addition, course grades do not necessarily reflect the quality of learning outcomes. The aim is to qualitatively examine why high and low achieving students in the same course study differently according to the assessment method and how they explain their behaviour. Altogether 24 students were interviewed in this study. Analyses were conducted with inductive content analysis. The results indicate that course grades do not necessarily reflect qualitative learning outcomes due to the nature of the assessment. In addition, the present study suggests that self-regulation and motivation are important factors in studying and might prevent the negative effect of inappropriate assessment.     

Students’ characteristics,self-regulated learning,technology self-efficacy,and course outcomes in online learning

The purpose of this study was to examine the relationship among students’ characteristics, self-regulated learning, technology self-efficacy, and course outcomes in online learning settings. Two hundred and fifty-six students participated in this study. All participants completed an online survey that included demographic information, the modified motivation strategies learning questionnaire, the online technology self-efficacy scale, the course satisfaction questionnaire, and the final grades. The researchers used structural equation modeling to examine relationships among student characteristics, self-regulated learning, technology self-efficacy, and course outcomes. Based on the results from the final model, students with previous online learning experiences tended to have more effective learning strategies when taking online courses, and hence, had higher levels of motivation in their online courses. In addition, when students had higher levels of motivation in their online courses, their levels of technology self-efficacy and course satisfaction increased. Finally, students with higher levels of technology self-efficacy and course satisfaction also earned better final grades. Based on the findings, we recommend that instructors design courses in a way that can promote students’ self-regulated learning behaviors in online learning settings and that students in online classes, as in traditional classes, set aside a regular time to concentrate on the course. Also, institutions should provide user-friendly online learning platforms and workshops for instructors and students to facilitate the teaching and learning experiences.     

Taiwan college students' self-efficacy and motivation of learning in online peer assessment environments

Online peer assessment is an innovative evaluation method that has caught both educators' and practitioners' attention in recent years. The purpose of this study was to develop relevant questionnaires for teachers to understand student self-efficacy and motivation in online peer assessment learning environments. A total of 205 college students with experience in online peer assessment participated in this study. Two questionnaires measuring students' online peer assessment self-efficacy (OPASS) and their motivations in online peer assessment learning environments (MOPAS) were developed. The former included three self-efficacy scales: evaluating, receiving and reacting. The latter included two scales: intrinsic motivation and extrinsic motivation. Through factor analysis, both revealed highly satisfactory validity and reliability in assessing students' self-efficacy and motivation in online peer assessment learning environments. Moreover, the students' responses also showed that they were highly confident and strongly intrinsically motivated when participating in an online peer assessment learning environment. Finally, the interplay between the scales of OPASS and those of MOPAS was explored and the reciprocal relationship between students' self-efficacy and motivation in an online peer assessment learning environment was also highlighted.     

英语戏剧表演课程探究

英语戏剧表演课作为英语专业学生的选修课开设是一次外语教学的积极探索。对英语戏剧表演课三年来的教学实践做了阶段性总结并对其教学模式、内容、评估体系以及对英语语言学习的促进作用等进行了探讨,英语戏剧表演课对语言学习者语言能力和语言学习动力具有明显的促进作用。     

How Undergraduate Students Learn

The prime purpose of an educational institution is to prepare graduates for both industrial and research-oriented employment. In each case, the graduate must have a capacity for lifelong learning. The course content and process are interlinked parts of learning. Three standard questionnaires were used to assess how students learn. The ‘study process questionnaire’ (SPQ) showed that there was a significant proportion of surface learners but thai this percentage can be modified by adopting certain teaching methodologies. The ‘course experience questionnaire’ (CEQ) indicated that a good memory is not sufficient to pass examinations, but also showed that the workload was too heavy and that assessment methods tend to control the approaches to learning adopted by students. The ‘learning style inventory’ (LSI) showed that students have adapted their learning style to match course emphases. To accommodate the different types of learner, lecturers need to change their teaching paradigm from one where lecturers stand outside the students' learning context, to one where lecturers are intimately involved in the learning context.     

Effects of concept-mapping-based interactive e-books on active and reflective-style students’ learning performances in junior high school law courses

Researchers have pointed out that interactive e-books have rich content and interactive features which can promote students’ learning interest. However, researchers have also indicated the need to integrate effective learning supports or tools to help students organize what they have learned so as to increase their learning performance, in particular, for abstract and complex learning content such as that in law courses. In this study, a concept-mapping-based interactive e-book learning mode was proposed. To understand the learning effects, a quasi-experimental design was used to compare the learning achievement and motivation of the students learning with the proposed approach (experimental group) and those learning with conventional interactive e-books (control group) in a junior high school fundamental law course. Meanwhile, the learning achievement and motivation of the students with different learning styles were also explored. The experimental results showed that the proposed approach significantly improved the students’ learning achievement, especially for the active-style students; moreover, it was found that the lead-in of concept mapping did not affect the students’ learning motivation. Factors that might affect the students’ learning achievement and motivation with the concept-mapping-based interactive e-book approach are discussed accordingly.     

Integrator element as a promoter of active learning in engineering teaching

In this paper, we present a teaching proposal used in an Introductory Physics course to civil engineering students from Porto's Engineering Institute/Instituto Superior de Engenharia do Porto (ISEP). The proposal was born from the need to change students’ perception and motivation for learning physics. It consists in the use of an integrator element, called the physics elevator project. This integrator element allows us to use, in a single project, all the content taught in the course and uses several active learning strategies. In this paper, we analyse this project as: (i) a clarifying element of the contents covered in the course; (ii) a promoter element of motivation and active participation in class and finally and (iii) a link between the contents covered in the course and the ‘real world’. The data were collected by a questionnaire and interviews to students. From the data collected, it seems that the integrator element improves students’ motivation towards physics and develops several skills that they consider to be important to their professional future. It also acts as a clarifying element and makes the connection between the physics that is taught and the ‘real world’.     

Understanding effects of COVID-19 on undergraduate academic stress,motivation and coping over time

The rapid and unprecedented shift from face-to-face instruction to remote online learning as a consequence of the COVID-19 pandemic had a substantial impact on teaching and learning in Higher Education: students had to adapt to a new way of learning, away from typical campus settings and their peers, and to new forms of assessments. This study examined academic stress, learning strategies, motivation and ways of coping from a sample of 177 unique students from a large London university, collecting primary data via survey at three time points during the academic year 2020/21 when teaching was remote and online only. Our findings show how patterns in academic stress, learning strategies, motivation and coping vary over the course of the academic year giving novel insight into how student learning and adaptation to the situation changed over time. We also report on differences in these patterns according to year group and for those students who are the first-in-family to attend university and those who are not. Based on these findings we identify priority areas where higher education institutions should support undergraduate students and provide evidence that some groups of students may need more and targeted support to secure their ongoing learning and well-being.     

The CLEM model: Path analysis of the mediating effects of attitudes and motivational beliefs on the relationship between perceived learning environment and course performance in an undergraduate non-major biology course

In this study, the following questions were addressed in an undergraduate non-major biology course using a large lecture format: Is there a relationship between students?? perceptions of their learning environment and course performance, and what roles do motivation and attitudes play in mediating that relationship? The purpose of this study was to test a path model describing the mediating effects of motivation and attitudes on learning environments and course performance. The study considered contemporary understanding of teaching and learning, as well as motivation and attitudes, in suggesting a direction for future reform efforts and to guide post-secondary science education instructors and leaders in the design of learning environments for undergraduate non-major biology courses. Among the classroom learning environment variables assessed in this study, personal relevance was the major contributor to predicting attitudes, motivation and course performance. Although the classroom learning environment had a very weak direct effect on course performance, there was a moderate total effect on self-efficacy and intrinsic goal orientation. The classroom learning environment also had a moderate total effect on attitudes toward biology. Attitudes toward biology had a moderate direct effect on self-efficacy. While attitudes toward biology was significantly correlated with course performance, the direct effect was extremely weak and was dropped from the model. However, attitudes toward biology had a moderate indirect effect on course performance due to the mediating effects of self-efficacy. Self-efficacy had a strong direct effect on course performance and therefore seemed to be particularly important. The model tested in this study explained 33?% of the variance in course performance, 56?% of the variance in self-efficacy, 24?% of the variance in attitudes toward biology, and 18?% of the variance in intrinsic goal orientation. To improve course performance, instructors should focus on building self-efficacy among their students and ensure that students find the course personally relevant.     

Supporting the less-adaptive student: the role of learning analytics,formative assessment and blended learning

Abstract

How can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile.     

Conception of learning and motivation of Spanish psychology undergraduates in different academic levels

Three conceptions of learning (rote, interpretative and constructive), and two aspects of motivation (level and value of motivation) were identified in 258 Spanish psychology undergraduates classified in three different academic levels (initial, intermediate and final course). Results about conceptions of learning showed final-course students are the most constructive and interpretative whereas students in the initial level have higher scores in rote conception. With respect to motivation, level and value are significantly related to one another, with a specific correlation between a high level of motivation and an intrinsic value whereas a low level was related to an extrinsic value. Additionally, intrinsic value in final-course students is significantly higher than in initial and intermediate-course students. Besides, we observed that students with both higher motivation and intrinsic value have a significantly higher score in interpretative and constructive conceptions. With respect to the academic level in psychology, initial-course students with intrinsic value or high motivation have a higher score in the constructive conception of learning. Intermediate students obtain a high score in the constructive conception if they are highly motivated. Final-course students did not show significant differences as regards the conception of learning dependent on motivation.     

The evolution of student identity: A case of caveat emptor

Engaging students has been seen as the key to promoting their achievement in higher education institutions. However, there is an important stage prior to this: the development of a positive student identity which influences students’ motivation to engage. As the student body has evolved from full-time, on-campus students entering university straight from school to embrace adult, part-time and online learners who are also in employment, the transition to a student identity has become less transparent. To encourage part-time students undertaking an undergraduate degree in Social and Health Care Management to engage with each other, the course team piloted peer assessment within the programme for a year. This paper informs the debate by providing insight into the students’ approach to learning and attainment. It is argued that the culture of compliance and the technocratic approach to task completion increasingly required within the social care and learning sector is antithetical to deep learning. For students to make the transition they need to commit to a student identity in which participation in reflection and critical debate are valued. The challenge is for universities to enable this by addressing the barriers and stimulating a positive identity for non-traditional students.     

Effects of formative feedback on intrinsic motivation: Examining ethnic differences

In this study we investigate the influence of ethnic differences on student motivation when learning from formative feedback. Interpersonal teacher behavior and student motivational needs are used to explain the effects of assessment for learning on intrinsic motivation by comparing students from different ethnic backgrounds. The final study's sample consisted of 558 students from Dutch secondary vocational education. Multi-level structural equation modeling was used to test possible models. Our findings show that modes of feedback (monitoring, scaffolding) and teacher interpersonal behavior are strongly related to predictors of student motivation. In line with self-determination theory, our findings indicated that competence and relatedness mediate the effect of feedback (both monitoring and scaffolding) on motivation. Multi-group analyses showed only small differences for ethnicity, especially in relation to mode of feedback, which led us to conclude that, irrespective of the “Immigrant Paradox”, assessment for learning may facilitate feedback provision for both immigrant and native Dutch students indiscriminately, thereby enhancing motivation to learn. Implications of these findings for learning in classrooms are discussed.     

Student Motivation from and Resistance to Active Learning Rooted in Essential Science Practices

Several studies have found active learning to enhance students’ motivation and attitudes. Yet, faculty indicate that students resist active learning and censure them on evaluations after incorporating active learning into their instruction, resulting in an apparent paradox. We argue that the disparity in findings across previous studies is the result of variation in the active learning instruction that was implemented. The purpose of this study was to illuminate sources of motivation from and resistance to active learning that resulted from a novel, exemplary active-learning approach rooted in essential science practices and supported by science education literature. This approach was enacted over the course of 4 weeks in eight sections of an introductory undergraduate biology laboratory course. A plant concept inventory, administered to students as a pre-, post-, and delayed-posttest indicated significant proximal and distal learning gains. Qualitative analysis of open-response questionnaires and interviews elucidated sources of motivation and resistance that resulted from this active-learning approach. Several participants indicated this approach enhanced interest, creativity, and motivation to prepare, and resulted in a challenging learning environment that facilitated the sharing of diverse perspectives and the development of a community of learners. Sources of resistance to active learning included participants’ unfamiliarity with essential science practices, having to struggle with uncertainty in the absence of authoritative information, and the extra effort required to actively construct knowledge as compared to learning via traditional, teacher-centered instruction. Implications for implementation, including tips for reducing student resistance to active learning, are discussed.

     

The Validity of Value-added Estimates from Low-Stakes Testing Contexts: The Impact of Change in Test-Taking Motivation and Test Consequences

Accountability mandates often prompt assessment of student learning gains (e.g., value-added estimates) via achievement tests. The validity of these estimates have been questioned when performance on tests is low stakes for students. To assess the effects of motivation on value-added estimates, we assigned students to one of three test consequence conditions: (a) an aggregate of test scores is used solely for institutional effectiveness purposes, (b) personal test score is reported to the student, or (c) personal test score is reported to faculty. Value-added estimates, operationalized as change in performance between two testing occasions for the same individuals where educational programming was experienced between testing occasions, were examined across conditions, in addition to the effects of test-taking motivation. Test consequences did not impact value-added estimates. Change in test-taking motivation, however, had a substantial effect on value-added estimates. In short, value-added estimates were attenuated due to decreased motivation from pretest to posttest.     

A time sequence-oriented concept map approach to developing educational computer games for history courses

Concept maps have been recognized as an effective tool for students to organize their knowledge; however, in history courses, it is important for students to learn and organize historical events according to the time of their occurrence. Therefore, in this study, a time sequence-oriented concept map approach is proposed for developing a game-based environment to facilitate students' learning of historical events and their organization during the gaming process. With this approach, students can easily learn the precedence relationships among the historical events that occurred in different time periods with the time sequence-oriented concept map. To evaluate the effectiveness of the proposed approach, a historical role-playing game has been developed for an elementary school history course to examine the students' performance in terms of learning motivation, self-efficacy and learning achievements. A subject unit, the “Siege of Fort Zeelandia by Zheng Cheng-Gong,” was chosen as the history topic. The results show that the proposed approach can significantly enhance the students' learning achievement, but did not affect their learning motivation or self-efficacy for the history course. As a consequence, it is concluded that students can benefit from concept maps in terms of enhancing their learning achievement, but they do not necessarily enjoy using concept maps in game-based learning activities.     

Does learning in clinical context in anatomical sciences improve examination results,learning motivation,or learning orientation?

The preclinical compulsory elective course “Ready for the Operating Room (OR)!?” [in German]: “Fit für den OP (FOP)”] was implemented for students in their second year, who were simultaneously enrolled in the gross anatomy course. The objective of the study was to determine whether the direct practical application of anatomical knowledge within the surgical context of the course led to any improvement in learning motivation, learning orientation, and ultimately examination results in the gross anatomy course, as compared with a control group. Within the scope of five teaching sessions, the students learned surgical hand disinfection, suturing techniques, and the identification of commonly used surgical instruments. In addition, the students attended five surgical demonstrations performed by surgical colleagues on cadavers. Successful learning of these basic skills was then assessed based on an Objectively Structured Practical Examination. Learning motivation and learning orientation in both subgroups was determined using the SELLMO‐ST motivation test and the Approaches and Study Skills Inventory test. While a significant increase in work avoidance was identified in the control group, this was not the case for FOP participants. Similarly, an increase in the “deep approach” to learning, as well as a decrease in the “surface approach,” was able to be documented among the FOP participants following completion of the course. The results suggest that students enrolled in the gross anatomy course, who were simultaneously provided with the opportunity to learn in clinical context, were more likely to be successful at maintaining learning motivation and learning orientation required for the learning process, than students who attended the gross anatomy course alone. Anat Sci Educ. 7: 3–11. © 2013 American Association of Anatomists.