Assessing Implementation of Learner-Centered Teaching While Providing Faculty Development

ABSTRACT

This article describes a study of 58 faculty members using a practical method for assessing the prevalence of learner-centered practices through individual interviews and rating their described practices with published rubrics. Analysis of the interviews found that the same faculty member might use more learner-centered practices in one course and more instructor-centered practices in another, depending on the course level, instructional format, and enrollment. Through the collegial interviews, faculty members became more aware of learner-centered practices. Interviews can be an effective development technique. Via this process, faculty developers can achieve two purposes: assessment of teaching and instructional development, at once.     

A review of rubric use in higher education

This paper critically reviews the empirical research on the use of rubrics at the post‐secondary level, identifies gaps in the literature and proposes areas in need of research. Studies of rubrics in higher education have been undertaken in a wide range of disciplines and for multiple purposes, including increasing student achievement, improving instruction and evaluating programmes. While, student perceptions of rubrics are generally positive and some authors report positive responses to rubric use by instructors, others noted a tendency for instructors to resist using them. Two studies suggested that rubric use was associated with improved academic performance, while one did not. The potential of rubrics to identify the need for improvements in courses and programmes has been demonstrated. Studies of the validity of rubrics have shown that clarity and appropriateness of language is a central concern. Studies of rater reliability tend to show that rubrics can lead to a relatively common interpretation of student performance. Suggestions for future research include the use of more rigorous research methods, more attention to validity and reliability, a closer focus on learning and research on rubric use in diverse educational contexts.     

面授辅导课在高校英语网络教学中的应用研究

面授辅导课在网络教育中被认为是支持学生自主学习的手段之一,在本质和功能上均有别于校园教育中的课堂教学。本研究以北京外国语大学网络教育学院开设的英语技能课程——“高级职业英语”和英语知识课程——“跨文化交际”为例,旨在调查建构主义所倡导的以学生为中心、基于学习任务的教学方法在网络教育面授辅导课中的实现程度、课程类型对实施此娄教学方法的影响及学生对它的反映和评价。研究方法包括调查问卷和统计学分析。研究结果表明：1.网络教育中学生对面授辅导课的需要和重视程度不容忽视;2．课程类型影响学生对面授辅导课的期望、教师的授课方法和学生评价面授辅导课的参考标准;3.作为自主学习的支特手段,面授辅导课在指导学习方法、培养学习能力、评估学习效果和提供情感支持等方面的功能还未得到师生两方面的充分认识和挖掘,研究者在此基础上为如何更好地发挥面授辅导课的助学功能提出了几点建议。     

Rubrics as a Tool for Learning and Assessment: What Do Baccalaureate Students Think?

Rubrics are increasingly used as tools to evaluate student work. This study examined BSW students' perceptions of the benefits and challenges of using rubrics. Pre- and posttest questionnaires were administered to 35 students in two sections of a diversity course. Students judged the use of rubrics favorably. Rubrics communicated the instructors' expectations, clarified how to write course assignments, explained grade and point deductions and, in general, made course expectations clearer. Students suggested that the rubric design should be self-explanatory and easy to follow. If carefully developed, rubrics may be a useful tool for advancing student learning in social work programs.     

Reexamining technology’s role in learner-centered professional development

The American Psychological Association’s Learner-Centered Principles provide empirically-based approaches to improving teaching and learning. However, in order to facilitate learner-centered, technology-rich instruction to K-12 students, teachers must be afforded opportunities to develop key understandings and skills, rarely evident in most professional development programs. In this paper, we synthesize empirically-based studies and recommendations for teacher learning and propose a learner-centered professional development (LCPD) framework to guide both professional development and empirical work on teacher learning. We describe LCPD components, discuss ways that technology can support LCPD, and highlight implications for research and practice.     

Designing and Validating Assessments of Complex Thinking in Science

Typical assessment systems often measure isolated ideas rather than the coherent understanding valued in current science classrooms. Such assessments may motivate students to memorize, rather than to use new ideas to solve complex problems. To meet the requirements of the Next Generation Science Standards, instruction needs to emphasize sustained investigations, and assessments need to create a detailed picture of students’ conceptual understanding and reasoning processes.

This article describes the design process and potential for automated scoring of 2 forms of inquiry assessment: Energy Stories and MySystem. To design these assessments, we formed a partnership of teachers, discipline experts, researchers, technologists, and psychometricians to align curriculum, assessments, and rubrics. We illustrate how these items document middle school students’ reasoning about energy flow in life science. We used evidence from review by science teachers and experts in the discipline; classroom experiments; and psychometric analysis to validate the assessments, rubrics, and automated scoring.     

Teachers' perspectives on classroom practice in Botswana: Implications for pedagogical change

Attempts to improve the quality of education in Botswana have, inter alia, included an emphasis on a learner-centered pedagogy. Attempts at implementing this pedagogy have been made within the ambit of the technical rational model of curriculum development. The attempts, however, have produced inconclusive results, and these results have often been rationalized in technicist terms, e.g., as being due to lack of resources and poorly trained teachers. Overlooked in this technicist model are the teachers' perspectives on the innovation. Using the case-study approach within the rubrics of the qualitative research paradigm, this study sought to establish the perspectives of geography teachers in a senior secondary school in Botswana vis-a-vis the learnercentered pedagogy advocated in Education for Kagisano ( Social Harmony ), a report produced by the 1977 Commission on Education. The findings indicated that teachers' classroom practices were influenced by many factors other than technical ones: these included the teachers' assumptions about the nature of knowledge and the ways it ought to be transmitted, their perceptions of students, and the goal of schooling. It also emerged that their assumptions were incongruent with the basic tenets of the learner-centered pedagogy. The findings, then, are an indictment of the technical rational model of change implementation applied in Botswana. They indicate that disregarding what teachers know and think about their taken-for-granted classroom practices when effecting change can lead to disappointing results.     

记忆原理在网络课程设计中的应用研究——以《教学系统设计》为例

网络课程为以学习者为中心的自主学习提供了有力的支持。从记忆原理出发,研究了适用于网络课程设计的四个记忆原理,以《教学系统设计》课程为例,分析了这些原理在网络课程设计中的应用。通过研究力求达到改善学习者的记忆效果,实现提高学习效率的目的。     

Evaluating standards-based assessment rubrics in a postgraduate public health subject

Standards-based assessment rubrics are recognised as an important tool for ensuring clear criteria in higher education. Most of the available evidence on rubrics comes from studies with face-to-face undergraduate students. Our study evaluated the introduction of rubrics into a postgraduate subject that included both online and face-to-face students. We conducted formative evaluation with former students to develop the rubrics, as well as surveying current students for process and impact evaluation, supplemented with a focus group. Process results showed that the rubrics were used widely and were generally considered to be of at least some use. Clarity of the rubrics was the main issue affecting perceived usefulness, particularly for the assessment tasks that had undergone comparatively less formative evaluation. Impact evaluation showed mixed results, with students that reported always using rubrics having higher marks on average compared to students who did not always use the rubrics. However, an expected improvement in marks across the whole student cohort compared to previous years did not eventuate, although this could be explained by a number of factors independent of the rubrics. Our results provide some evidence for the use of rubrics in postgraduate and online settings but highlight the need for rigorous formative evaluation.     

The anatomy of agency: Improving academic performance in first-year university students

The transition from secondary to tertiary education can be challenging, as students must adapt to independent learning. For students in the allied health and nursing disciplines, this transition may coincide with compulsory first-year courses in anatomy, which are traditionally difficult to master. Students' agency—their capacity to make intentional choices to alter the path of their learning—may play a role in their successful completion of first-year anatomy courses. This study aimed to develop a measure for agency and to determine whether agency is associated with academic achievement. First-year students (n = 131) completed open-ended questions measuring each aspect of agency. Student responses were quantified using rubrics and then combined to create an overall agency score. Three factors of agency were determined: action, metacognition, and self-efficacy. Students with higher agency scores were significantly more likely to have higher academic achievement in anatomy compared to students with lower agency scores. The relationship between agency and academic achievement was strongest for action. These results suggest that encouraging students to be active participants in their learning may help them to achieve at university.     

Learner-centered inquiry in undergraduate biology: positive relationships with long-term student achievement

We determined short- and long-term correlates of a revised introductory biology curriculum on understanding of biology as a process of inquiry and learning of content. In the original curriculum students completed two traditional lecture-based introductory courses. In the revised curriculum students completed two new learner-centered, inquiry-based courses. The new courses differed significantly from those of the original curriculum through emphases on critical thinking, collaborative work, and/or inquiry-based activities. Assessments were administered to compare student understanding of the process of biological science and content knowledge in the two curricula. More seniors who completed the revised curriculum had high-level profiles on the Views About Science Survey for Biology compared with seniors who completed the original curriculum. Also as seniors, students who completed the revised curriculum scored higher on the standardized Biology Field Test. Our results showed that an intense inquiry-based learner-centered learning experience early in the biology curriculum was associated with long-term improvements in learning. We propose that students learned to learn science in the new courses which, in turn, influenced their learning in subsequent courses. Studies that determine causal effects of learner-centered inquiry-based approaches, rather than correlative relationships, are needed to test our proposed explanation.     

Designing for Quality: Distance Education Rubrics for Online MSW Programs

ABSTRACT

There has been a rapid increase in the number of online MSW programs in the past decade without a commensurate body of literature on their administration. This article acquaints MSW program faculty and administrators with quality assurance rubrics, which are research-informed tools intended for use by distance education providers to develop, support and manage high quality online courses and programs. Graduate programs that are in the process of considering or actually designing an online delivery option, as well as those that are currently implementing online programs, may benefit from the use of such quality assurance rubrics.     

The use of scoring rubrics: Reliability, validity and educational consequences

Several benefits of using scoring rubrics in performance assessments have been proposed, such as increased consistency of scoring, the possibility to facilitate valid judgment of complex competencies, and promotion of learning. This paper investigates whether evidence for these claims can be found in the research literature. Several databases were searched for empirical research on rubrics, resulting in a total of 75 studies relevant for this review. Conclusions are that: (1) the reliable scoring of performance assessments can be enhanced by the use of rubrics, especially if they are analytic, topic-specific, and complemented with exemplars and/or rater training; (2) rubrics do not facilitate valid judgment of performance assessments per se. However, valid assessment could be facilitated by using a more comprehensive framework of validity when validating the rubric; (3) rubrics seem to have the potential of promoting learning and/or improve instruction. The main reason for this potential lies in the fact that rubrics make expectations and criteria explicit, which also facilitates feedback and self-assessment.     

The use of scoring rubrics for formative assessment purposes revisited: A review

The mainstream research on scoring rubrics has emphasized the summative aspect of assessment. In recent years, the use of rubrics for formative purposes has gained more attention. This research has, however, not been conclusive. The aim of this study is therefore to review the research on formative use of rubrics, in order to investigate if, and how, rubrics have an impact on student learning. In total, 21 studies about rubrics were analyzed through content analysis. Sample, subject/task, design, procedure, and findings, were compared among the different studies in relation to effects on student performance and selfregulation. Findings indicate that rubrics may have the potential to influence students learning positively, but also that there are several different ways for the use of rubrics to mediate improved performance and self-regulation. There are a number of factors identified that may moderate the effects of using rubrics formatively, as well as factors that need further investigation.     

ANNOUNCEMENTS

Most college professors want their students to grow personally as well as intellectually. They want their students to become more reflective and self-aware as a result of taking their courses. This goal is typically consistent with, and even serves to advance, the stated missions of the institutions in which they teach. But there is a problem: not only do these "ineffable" objectives seem difficult or impossible to assess within the context of a course, but it is also often unclear how the course itself will help students work toward these objectives. Critical thinking about one's experiences, attitudes, and values goes hand-in-hand with personal growth and development. This essay explores how conventional assignments can be modified and expanded to include such critical thinking and writing vis-a ¤ -vis the main concepts of the course. Also presented are grading rubrics that can serve as formative assessments of the student's abilities in these areas.     

Improving course evaluations to improve instruction and complex learning in higher education

Recent research has touted the benefits of learner-centered instruction, problem-based learning, and a focus on complex learning. Instructors often struggle to put these goals into practice as well as to measure the effectiveness of these new teaching strategies in terms of mastery of course objectives. Enter the course evaluation, often a standardized tool that yields little practical information for an instructor, but is nonetheless utilized in making high-level career decisions, such as tenure and monetary awards to faculty. The present researchers have developed a new instrument to measure teaching and learning quality (TALQ). In the current study of 464 students in 12 courses, if students agreed that their instructors used First Principles of Instruction and also agreed that they experienced academic learning time (ALT), then students were about 5 times more likely to achieve high levels of mastery of course objectives and 26 times less likely to achieve low levels of mastery, according to independent instructor assessments. TALQ can measure improvements in use of First Principles in teaching and course design. The feedback from this instrument can assist teachers who wish to implement the recommendation made by Kuh et al. (2007) that universities and colleges should focus their assessment efforts on factors that influence student success.