Building a Sustainable Quality MattersTM Community of Practice Through Social Network Analysis

ABSTRACT

The growth of distance education has necessitated strong evidence of quality for institutions of higher education, and numerous standards and principles of quality have been developed, such as Quality Matters? (Quality Matters). These systems are often considered only at the course level to guide design and improve student outcomes, but they can also help to pull the institution together and galvanize advancement in online development. Adopting online quality standards can be a complex process that requires changes to institutional culture. This article describes how the use of the Community of Practice (CoP) framework engaged a campus-wide network of individuals in adoption of the Quality Matters training, rubric, and review process to advance distance education support and online course development. Using Social Network Analysis, researchers were able to identify the strengths and weakness of the CoP during the early adoption phase of Quality Matters to quantitatively measure the connections among members of the community.

Based on a survey administered to every participant who attended the Applying the Quality Matters Rubric? (APPQMR) workshop, researchers analyzed connections across the Quality Matters? (Quality Matters) Community of Practice (CoP). This analysis indicated strong cohesion of the network based on work related to distance education but low density for connections based on Quality Matters. Furthermore, it demonstrated that significant connections existed between members prior to the adoption of Quality Matters and identified key influencers within the network. The results also indicated that the Quality Matters leadership team at the institution is highly central to the Quality Matters CoP network. The results can be used to identify strategies to further adoption of Quality Matters at the institution by strengthening the CoP.     

The Impact of Quality Matters Professional Development on Teaching across Delivery Formats

ABSTRACT

This study explored the impact of professional development workshops for online course design on faculty’s pedagogical practices in online, face-to-face (f2f), and blended instructional modes. It specifically focused on trainings offered by the Quality Matters (QM) organization on a rubric for assessing quality in online course development. A mixed-methods analysis of survey data collected from 2,148 participants in QM workshops over a three-year period (2012–2015) demonstrated that, across all three teaching modes, participants revised learning objectives, improved course alignment, and paid greater attention to communication with students. Additional benefits from participating in QM training related to specific modalities. Common online and blended impacts included changes in assessment practices as well as in modifying course materials to be more compliant with accessibility standards. In f2f settings, frequent changes involved redesigning learning activities to increase learner-learner interaction.     

Instructional Strategies to Help Online Students Learn: Feedback from Online Students

Increased enrollment in online programs and courses has prompted a plethora of research on instructional strategies that impact online students’ learning. Most of these strategies came from instructors, and others were solicited from students. While the literature notes that students who have more university experience tend to provide more substantive responses when solicited, there seems to be limited representation of online master’s students’ preferences on what instructional strategies work for them. There is paucity in the literature on how these preferred instructional strategies inform existing theoretical and practical frameworks that could impact online learning performance. This article discusses the Top Ten Instructional Strategies preferred by master’s students who responded to a dissertation survey question - What specific things would you like your online instructors do to help you learn successfully? - and relates these strategies to the Seven Principles for Good Practice in Undergraduate Education and the Quality Matters Rubric.     

Linking Mathematics and Psychological Science

Abstract

We describe a successful collaboration between mathematics and psychological science faculty members to create a learning community for our students that linked sections of introductory mathematical reasoning and psychological science courses. The students in our learning community were in their second or third semester. The learning community is designed so that, throughout the semester, students regularly move across the border between the two linked disciplines by completing common assignments, including a group project. We modified our existing course topics and frameworks to be intentional about building connections between the courses.     

Chickering's Seven Principles of Good Practice: Student Attrition in Community College Online Courses

As online enrollments escalate, so does concern about student attrition rates. There is an abundance of literature addressing student success in online courses, particularly using constructivist learning theories to create engaging learning experiences. Also emerging from the literature is the Seven principles of good instructional practice by Checkering and Gamson as an accepted rubric for evaluating effective online instruction. This study focused on whether the use of instructional strategies as measured by the seven principles had an effect on student attrition rates in online courses. Full and part-time faculty at three community colleges in Virginia who taught online course(s) in the last three semesters completed an online survey to determine the extent to which they used instructional strategies reflecting the constructivist-based seven principles in their online courses. Scores from the survey were then compared to the attrition rates in their courses. Results indicated both groups strongly used instructional strategies reflecting the seven principles of good practice in their online courses with full-time faculty scores ranging a bit higher. When the results for the principles were examined individually rather than as a set, both groups scored lower on principles reflecting innovative instructional strategies. No relation between the extent to which faculty reported using those instructional strategies and student success as measured by attrition rates were found. However, a moderate relation was found with the third principle, “encourage active learning.” This indicated that faculty who made strides toward actively engaging students found some success in reducing student attrition.     

Quality Control in Online Courses

SUMMARY

There has recently been increased interest in the quality of online courses. Faculty from the School of Education at Marquette University suggest using social constructivist theories in the design and development of online courses and in the training and pedagogy of online instructors to ensure quality in online courses. Quality can be designed into online courses by focusing on complex tasks, using multiple perspectives, establishing a learning community, encouraging the social negotiation of meaning and providing assistance for learners at various levels. While good design can go a long way to ensure quality in online courses, the quality of the instructor is equally critical. Training instructors to establish a supportive climate, provide constructive feedback, and ask critical and probing questions leads to high quality online instruction.     

Course Revision in Introductory STEM Courses: An Exploratory Study at an HBCU Community College

ABSTRACT

This paper presents the results of an exploratory study of a professional development-based effort at one of the nation’s 14 federally designated Historically Black Colleges and Universities community colleges. Course revisions included introductory courses in its Natural Sciences department. The goal was to improve students’ critical-thinking and reading skills in science through faculty professional development opportunities, to improve success across all science, technology, engineering, and mathematics (STEM) curricula. This study examines faculty-selected professional development efforts combined with time release for course revision, and how it impacted students’ attitudes toward science and students’ critical-thinking skills. Six of the department’s 11 full-time faculty instructing introductory science courses received training in WestEd’s Reading Apprenticeship program and on critical-thinking skills. These faculty then revised their courses as they chose based on techniques learned during their training. A comprehensive assessment that included extensive course videos, pre- and post-tests of students’ attitudes toward science the Critical Thinking Assessment Test, and focused interviews with faculty were conducted. Despite major cuts in state support, turnover of key administrators, and other challenges, improvements in student attitudes toward STEM topics and critical-thinking skills were documented as faculty expanded their teaching tool-kits.     

CARPE DIEM: OVERCOME MISCONCEPTIONS IN COMMUNITY COLLEGE DISTANCE LEARNING

ABSTRACT

This paper makes note of the vast opportunities for growth and expansion available to community colleges through online distance education. While many community colleges have taken advantage of these opportunities, continued success may be in jeopardy because of the high drop-out rates in online courses of study relative to courses offered as traditional, face-to-face classroom instruction. The reason for this may be that the “digital divide” still exists between students of the 21st century and faculty who were educated long ago in the 20th century, including even those faculty who have stepped forward to offer online courses. Perception of up-to-date concepts of distance learning is a major issue, and only when the gap is bridged between distance learner and instructor will online learning reach its potential. The literature available on distance learning has numerous suggestions for bridging this gap between students and faculty. The authors of this article recommend that community colleges make the institutional commitment to equip and train Internet-ready faculty to appropriately advise and teach 21st-century students. However, taking such a step may have significant implications for the immediate future in the allocation of financial resources.     

Technical Communication Coaching: A Strategy for Instilling Reader Usability Assurance in Online Course Material Development

ABSTRACT

Online course material development requires much writing, often catching faculty by surprise because of either the sheer volume or the specialized role and function of writing in an online only and multimodal environment. technical and professional communication (TPC) faculty are uniquely suited to coach faculty in producing readable writing for online courses. This article explores the professional development strategies and coaching skills necessary for TPC instructors and/or practitioners to serve in this role in online course development training.     

Linking online course design and implementation to learning outcomes: A design experiment

This paper reports on preliminary findings from ongoing design-based research being conducted in the fully online Master of Arts in Teacher Leadership (MTL) program at a small, Midwest public university. Researchers are using the Quality Matters (QM) and Community of Inquiry (CoI) frameworks to guide the iterative redesign of core courses in the program. Preliminary results from the redesign of one course suggest that such approach can improve student learning outcomes. Results also support the efficacy of the QM and CoI theoretical frames, and the usefulness of design-based approaches in online learning.     

Impact of Personality on Choice of Instructional Delivery and Students’ Performance

ABSTRACT

This study was designed to investigate how college students’ personality characteristics relate to their choice of instructional delivery (online or face-to-face) and whether this choice mediates the relationship between personality and academic performance. One hundred eighty-eight undergraduate students were given a choice between taking the same general education course online or face-to-face. Students completed the Big Five Inventory (BFI) upon the conclusion of this course. Using a Bayesian regression course modeling framework, we found that Conscientiousness and Agreeableness were related to the choice of instructional delivery. Students scoring higher on Conscientiousness and lower on Agreeableness tended to choose the online environment. Conscientiousness also was a direct predictor of academic achievement regardless of the course environment. These results suggest that in order to find the best fit between student and the learning environment, it is important to identify personality characteristics indicative of success in online and traditional face-to-face courses to help students to become more efficient learners and assist faculty in designing quality courses to meet students’ needs.     

Post-secondary educators' professional development: Investigation of an online approach to enhancing teaching and learning

Faculty in post-secondary institutions must continually reassess, refine, and revise their teaching, yet it is a challenge for them to gain this professional development with heavy teaching responsibilities and high demands on their time. Creating Optimum Learning Environments (CREOLE) is a collaborative project between one community college and one university to develop an online training program for post-secondary education faculty on the basic principles of teaching and learning and the development of online courses. Four independent modules were developed and taught in a one semester format for educators throughout the U.S. The goal of this research was to identify the strenghts and challenges of this course; determine the changes in pedagogical practice of the participating faculty members; and to examine the resulting changes in participants' course materials to reflect learning and motivation theories, and appropriate online learning strategies. Methods included pre- and post-surveys of the participants, interviews, document analysis, and instructors' reflections. Results demonstrated high expectations from all participants, difficulty in forming a sustained learning community, continuing challenge in technological aspects, and requirement for intense instructor involvement to maintain morale.     

Weaving Together Undergraduate Research, Mentoring of Junior Faculty, and Assessment: The Case of an Interdisciplinary Program

Scholars in teaching and learning value student research and program assessment as strategies to promote excellence in undergraduate education. Yet, in practice, each can be complex and difficult to sustain. This case study demonstrates how undergraduate research, mentoring of junior faculty, and assessment can be integrated in ways that enrich the educational experiences of students and the professional development of faculty and improve research on teaching and learning. The authors describe a lively undergraduate research project that became tied to the mentoring of assistant professors and then to program assessment. We conclude with recommendations for implementing such a project in other academic settings. Elizabeth Thomas is Assistant Professor in the Interdisciplinary Arts and Sciences at the University of Washington Bothell. She received her Ph.D. in Psychology from the University of Illinois at Urbana-Champaign and teaches courses on inquiry in the social sciences, community psychology, and psychology and the arts. Her research examines sociocultural contexts for learning and development with a particular focus on the role of the arts and the potential of participatory action research strategies. Diane Gillespie is Professor and Associate Director of Interdisciplinary Arts and Sciences (IAS) at The University of Washington, Bothell, received her Ph.D. at the University of Nebraska—Lincoln in Cultural and Psychological Studies in Education. She teaches multicultural social science courses and qualitative research. Her recent publications explore the importance of narrative for reflective teaching and learning, learning in small groups, and the role of human rights in nonformal education.     

Development of a ‘universal’ rubric for assessing undergraduates' scientific reasoning skills using scientific writing

We developed a rubric for measuring students' ability to reason and write scientifically. The Rubric for Science Writing (Rubric) was tested in a variety of undergraduate biology laboratory courses (total n = 142 laboratory reports) using science graduate students (teaching assistants) as raters. Generalisability analysis indicates that the Rubric provides a reliable measure of students' abilities (g = 0.85) in these conditions. Comparison of student performance in various biology classes indicated that some scientific skills are more challenging for students to develop than others and identified a number of previously unappreciated gaps in the curriculum. Our findings suggest that use of the Rubric provides three major benefits in higher education: (1) to increase substance and consistency of grading within a course, particularly those staffed by multiple instructors or graduate teaching assistants; (2) to assess student achievement of scientific reasoning and writing skills; and (3) when used in multiple courses, to highlight gaps in alignment among course assignments and provide a common metric for assessing to what extent the curriculum is achieving programmatic goals. Lastly, biology graduate students reported that use of the Rubric facilitated their teaching and recommended that training on the Rubric be provided to all teaching assistants.     

The digital course training workshop for online learning and teaching

A primary concern with Information Technology (IT) training has been that IT-based training focuses upon the technical or point and click aspects of learning management system (LMS) platforms and pedagogy-enhancing software without any concern for the content of the courses. The Digital Course Training Workshop (DCTW) approach examined in this article addresses this concern by supporting a content-first approach. The DCTW approach—an initiative at a Midwestern University—is aimed at supporting faculty through the process of transitioning from face-to-face (F2F) courses to online teaching. Participating faculty enter the week-long seminar with traditional course content and leave with digital content transitioned into the appropriate LMS platform. This article is intended to stimulate reflections on the need for systematic faculty professional development programs and activities to help higher education faculty in the transition process from traditional to online courses.     

The Use of Collaboration,Authentic Learning,Linking Material to Personal Knowledge,and Technology in the Constructivist Classroom: Interviews with Community College Faculty Members

ABSTRACT

This study explored how faculty members implemented constructivist teaching methods after training. The student-centered teaching methods were interactions and collaborations, authentic learning and real-world experiences, linking material to previously learned information, and using technology in the classroom. Seven faculty members trained in student-centered teaching methods by the professional development department at a community college were interviewed. Interviews were supplemented with teacher-generated documents and classroom observations. All reported implementing the recommended practices in the classrooms, both online and in traditional face-to-face classrooms.     

线上教学设计：求精求质求创新

线上学习蓬勃发展,科研和教学法有效结合,教学品质就能进一步提升。以皇家大学的教学模式为例,深入探讨4项线上教学的原则：学习成果、经验性真实性之学习、学习社区、小组学习。在天津电大开办培训课程,引导教师们深思个人的教学哲理和教学方法,以设计思考的方式,为线上教学挑战寻求解决方案。70名教师参与度高,制作设计蓝图,分享经验,做中求知,创意十足,充分展现中西双方的教学精髓,使之紧密结合,增加教学成效。未来培训的方向是以面授、线上混合之方式,实行小班制,为中国和加拿大线上教学的创新与合作做出更有意义之贡献。     

The product life-cycle of online courses and student engagement

ABSTRACT

With increased online course offerings at most higher education institutions, it is important to have a way to determine whether the courses continue to have value to students or outlived their usefulness. Courses are the central means of knowledge delivery for each institution and may be viewed through the lens of the product life-cycle, which is a common way for for-profit corporations to ensure they are aware of when it is time to make adjustments or completely overhaul what they provide to consumers. We leverage this concept to develop a conceptual mode of the life-span and cycle of curricular products; especially, those delivered online, which may have a shorter shelf life than in-classroom courses. To that end, we map a single course that has spanned nearly 20 years and shifted from face-to-face delivery, to a blended mode with learning technologies support, and then into a fully online format. This piece depicts the course life-cycle, which emerged from multi-strategy research analysis of that course. Understanding that online courses have a life-cycle can help department and university managers plan for the investment in the improvement of each as it comes to the end of its useful lifespan. This can ensure high-quality learning and a sustainable portfolio of programs and courses with which students are engaged.     

Designing Personalized Online Teaching Professional Development through Self-Assessment

Many institutions use a one-size-fits-all approach to faculty development for online teaching, which does not meet the needs of faculty who often have different levels of experience, skill, and self-efficacy in online teaching and learning. To address these issues, the [university name removed] [center name removed] designed and implemented an online teaching readiness self-assessment. The instrument was developed based on key attributes and skills needed for proficiency in online teaching, in three areas: online teaching experience and attitudes, learning management system proficiency, and access to technology. The self-assessment was distributed through a web-based survey tool to faculty who were identified to develop new online courses. Individual results were used to create personalized frameworks of professional development offerings (workshops, institutes, videos, and consultations) and just-in-time resources to support faculty in their development process.     

The Development of QM-Fudan Higher Education Online Course Quality Standards: Some Results and Analysis

ABSTRACT

This paper aims to examine whether and how the US-based Quality Matters (QM) Higher Education Rubric-Design Standards for Online and Blended Courses apply to the Chinese higher education environment. Suitability and matchability of QM Standards are respectively examined through a questionnaire and course reviews at Fudan University, a leading research institution in China, with which Quality MattersTM has an exclusive five-year cooperation agreement to develop an adapted Chinese rubric based on the QM Standards. Cross-referencing the dimensions of suitability and matchability, QM Standards are divided into four categories, namely, Perfect, Challenging, Potential and Chicken-ribs standards. This classification helps to identify what standards are ready for adoption and what standards need to be adapted. It is found that most QM Standards are thought to be suitable for the Chinese higher education environment, but China has a long way to go to meet these standards. On the whole, QM Standards on course format, function, and basic quality elements are relatively easy for Chinese online courses to meet while the advanced standards on course quality, particularly those relating to learning outcomes, assessment and evaluation, interaction and other aspects of course design remain challenging at the present time. The research findings not only show areas of course design in China that need improvement, but also lay a solid foundation for the development of QM-Fudan Standards, which will be supplemented and improved by future practice and research based on the actual condition and progress of online education in China.