Student Engagement and Student Learning: Testing the Linkages*

This study examines (1) the extent to which student engagement is associated with experimental and traditional measures of academic performance, (2) whether the relationships between engagement and academic performance are conditional, and (3) whether institutions differ in terms of their ability to convert student engagement into academic performance. The sample consisted of 1058 students at 14 four-year colleges and universities that completed several instruments during 2002. Many measures of student engagement were linked positively with such desirable learning outcomes as critical thinking and grades, although most of the relationships were weak in strength. The results suggest that the lowest-ability students benefit more from engagement than classmates, first-year students and seniors convert different forms of engagement into academic achievement, and certain institutions more effectively convert student engagement into higher performance on critical thinking tests. *A version of this paper was presented at the annual meeting of the American Educational Research Association, San Diego, April 2004.     

The effectiveness of blended online learning courses at the community college level

Whether through the use of online-only or hybrid/blended formats, colleges and universities across the country are increasingly utilizing online platforms as a medium for the delivery of instruction. At the same time, we know little about how student learning outcomes are related to students’ engagement with online instructional formats. In particular, few studies have evaluated online learning in community colleges, and fewer yet have employed an experimental or quasi-experimental design to do so. In this research, we use propensity score matching to compare learning gains between community college students enrolled in blended courses, (courses that combine online instructional delivery with traditional classroom-based instruction) with gains experienced by students receiving only classroom-based instruction. Among students enrolled in blended courses, we also consider which aspects of student use of online instructional materials are most strongly associated with student learning. While some evidence has suggested significantly poorer outcomes for community college students enrolled in online-only courses, our results suggest that students enrolled in blended courses perform similarly, if not better, relative to students in a traditional instructional setting. Implications for practice and research are discussed.     

Classroom Discussions with Student‐Led Feedback: a Useful Activity to Enhance Development of Critical Thinking Skills

ABSTRACT: Critical thinking skills (CTS) are the core learning outcome measures for higher education. Generally, CTS are not extensively developed or practiced during primary and secondary education. As such, early cultivation of CTS is essential for mastery prior to collegiate matriculation. Weekly engagement in 50 min of classroom discussion with student feedback (CDSF) was utilized to develop the CTS of students in an introductory food science course at Purdue Univ. Students' critical thinking ability was assessed longitudinally over a 16‐wk semester using the ACT‐CAAP? (Collegiate Assessment of Academic Proficiency) critical thinking test. The ACT‐CAAP measures the students' ability to analyze, evaluate, and extend an argument described in a short passage. We hypothesized that the implementation of CDSF for 16 wk would expedite development of CTS for students enrolled in the course. The CDSF intervention significantly increased critical thinking ability for non‐native English speaking students as compared to native English speaking students. Students who were classified as sophomore status or above when compared to freshmen and students enrolled as food science majors when compared to other majors also demonstrated increased critical thinking ability. Recitation size also significantly influenced critical thinking ability where students enrolled in a relatively small recitation section had elevated critical thinking when compared to the abilities of those students enrolled in a large recitation. These observations suggest that engaging students in classroom discussions with student‐led feedback is a useful instructional technique for developing CTS. Further, the data suggest the development of critical thinking skill among food science majors can be augmented when classroom discussions with student‐led feedback are conducted in smaller sized recitations.     

Transitioning to learning outcomes at the coalface: An academic’s quantitative evaluation at the course level

Implementation of learning outcomes in Universities has not been seamless – their alignment with assessments requires faculty to specify learning outcomes and show transparent evaluation of this alignment. Difficulties arise transitioning from grading within a range of pre-existing assessment formats to grading common learning outcomes across those different formats. Experiencing this, we performed a quantitative evaluation of students completing an academic literacy course. We aimed to see if student achievement was determined by assessment format or by learning outcomes, and then to identify whether achievement of a learning outcome was equivalent across assessment formats. A twostep cluster analysis identified three clusters of students: high, medium, and low achievers. Strongest predictors of cluster-membership were learning outcomes assessed in the written essay, however scores for each learning outcome when assessed across assessment formats correlated poorly. Faculty should ensure consistent standards in learning outcomes achievement when assessed across different formats, or clearly separate learning outcomes.     

The Mediating Effects of Student Engagement on the Relationships Between Academic Disciplines and Learning Outcomes: An Extension of Holland’s Theory

This research examined the relationships among students?? academic majors, levels of engagement, and learning outcomes within the context of Holland??s person?Cenvironment theory of vocational and educational behavior. The study focused on the role of student engagement as a mediating agent in the relationships between academic majors and student learning. Drawing on data from a stratified random sample of 20,000 seniors who participated in the 2008 National Survey of Student Engagement, results revealed that students?? academic majors were significantly related to levels of engagement and learning outcomes. Student engagement was also significantly related to learning outcomes. Students?? academic majors generally were not indirectly related to learning outcomes through levels of engagement. An important exception to this result was found for students in Enterprising environments where indirect relationships among Enterprising disciplines and Enterprising learning outcomes were positive, statistically significant, and substantially larger than the direct relationship.     

Enhancing critical thinking using team-based learning

This study examines students’ perceptions of the development of academic and critical thinking skills in college, with a specific focus on team-based learning (TBL), an active learning strategy designed to increase student interaction and engagement. Six hundred and fifty students in five different courses were surveyed at the beginning of the semester about the extent to which they felt the typical college course enhances various academic and critical thinking skills. These responses were compared to their responses after a semester of TBL regarding the extent to which the TBL environment enhanced these same skills. Students expressed significantly greater improvement in critical thinking skills in a TBL environment in comparison to typical courses for most of the skills assessed and greater improvement in all of these skills in comparison to lecture-based courses. These results held for every demographic subgroup examined, including males, females, freshman, sophomores, juniors and seniors, as well as all levels of academic achievement as measured by grade point average.     

Does Delivery Format Make a Difference in Learning About Global and Cultural Understanding?

This study assessed a learning outcome for nontraditional seniors who were in accelerated degree programs in both online and on-site formats. Using items from the National Survey of Student Engagement, researchers explored engagement with global understanding and cultural awareness. A quantitative, single-case analysis method was used to determine significance with the items. Results indicated 50% of the items were significant, and for all of the significant items, means were higher for the on-site senior group. Implications are explored, including pedagogical ideas for online programs in teaching global and cultural themes.     

学习性投入能带来批判性思维能力增值吗？ ——来自“2017全国本科生能力测评”的证据

采用倾向值匹配方法，以全国16个省78所院校5433名大四本科生能力测评数据为基础，探讨了学 习性投入对大学生批判性思维能力增值的影响。结果发现，总体上，学习性投入正向作用于批判性思维能力 增值；较之个体性学习投入，侧重交流、互动的社会性学习投入更有利于批判性思维能力增值；但是，并非所有 的社会性学习投入都显著作用于批判性思维能力增值，确切地说，大学生同龄群体间交流、互动性质的社会性 学习投入显著促进了批判性思维能力增值。深入分析后发现，学习性投入能否影响批判性思维能力增值的关 键在于它是否生成了论证性对话情境。深入、全面的论证性对话是批判性思维能力发展的核心动力。     

Who’s asking the questions in classrooms? Exploring teacher practice and student engagement in generating engaging and intellectually challenging questions

Student engagement that leads to enhanced learning outcomes involves three interdependent facets: behaviour, emotion and cognition. As such, learning activities that encourage deep learning and the intellectual challenging of minds should provide opportunities for reasoning and critical and creative thinking. An approach that resonates strongly with student engagement involves fostering student voice in the classroom, and the generation and utilization of students’ questions is one means of achieving this. Implicit in this approach is the need for both teachers and students to pose questions that engage and intellectually challenge thinking. In this pilot case study, eight volunteer teachers from one school chose to investigate their own practice by either focusing on their own questioning skills to foster student engagement in the classroom or, on how they could support their students to generate intellectually challenging questions that lead to increasing student voice, engagement and deeper learning in the classroom. Key findings were that who does the questioning is not an either-or dichotomy, and that significant pedagogical shifting requires a long-term focus. This shift is influenced by teachers’ commitment to using questioning as a pedagogical approach for enhancing student learning.     

“I Forgot I Wasn’t Saving the World”: the Use of Formative and Summative Assessment in Instructional Video Games for Undergraduate Biology

This study examined the role of formative and summative assessment in instructional video games on student learning and engagement. A 2 (formative feedback: present vs absent) × 2 (summative feedback: present vs absent) factorial design with an offset control (recorded lecture) was conducted to explore the impacts of assessment in video games. A total of 172 undergraduates were randomly assigned to one of four instructional video game conditions or the control. Results found that knowledge significantly increased from the pretest for players in all game conditions. Participants in summative assessment conditions learned more than players without summative assessment. In terms of engagement outcomes, formative assessment conditions did not significantly produce better learning engagement outcomes than conditions without formative assessment. However, summative assessment conditions were associated with higher temporal disassociation than non-summative conditions. Implications for future instructional video game development and testing are discussed in the paper.     

Instructional Tasks and the Development of Student Capacity to Think and Reason: An Analysis of the Relationship between Teaching and Learning in a Reform Mathematics Project

Abstract

In the present study the relationship between teaching and learning was examined using a conceptual framework that links dimensions of instructional tasks with gains in student learning outcomes. The greatest student gains on a performance assessment consisting of tasks that require high levels of mathematical thinking and reasoning were related to the use of instructional tasks that engaged students in the “doing of mathematics” or the use of procedures with connections to meaning. In addition, student performance gains were greater for those sites whose tasks were both set up and implemented to encourage the use of multiple solution strategies, multiple representations, and explanations. Whereas, student performance gains were relatively small for those sites whose tasks tended to be both set up and implemented in a procedural manner and that required a single solution strategy, single representations, and little or no mathematical communication.     

An Investigation of the Contingent Relationships Between Learning Community Participation and Student Engagement

This study examined the contingent relationships between learning community participation and student engagement in educational activities inside and outside the classroom using data from the 2004 administration of the National Survey of Student Engagement (NSSE). Results indicated that learning community participation was positively and significantly related to student engagement, both for first-year students and seniors. For some types of engagement, relationships were significantly stronger for seniors than for first-year students. Analyses also revealed there was substantial variability across institutions in the magnitude of the relationships between learning community participation and first-year students’ levels of engagement. Although institutional characteristics accounted for some of the variability across institutions, a substantial amount of the variability in engagement–learning community relationships remained unexplained.     

The relationship between classroom quality and students’ engagement in secondary school

Student engagement has been identified as an influential mediator between classroom interactional quality and adolescent learning outcomes. This study examined the relationship between classroom quality and student behavioural engagement in secondary school classrooms. Three dimensions of classroom quality (emotional, organisational and instructional support) and the dimension of student engagement were observed in nine classrooms using the Classroom Assessment Scoring System. Self-ratings of behavioural engagement were provided by 181 Finnish secondary school students along with their teachers’ ratings of classroom-level student engagement. The results showed, first, that there was variation in both classroom quality and student behavioural engagement between the classrooms. Second, classroom organisational support was associated with observed and with teacher- and student-rated engagement, and instructional support was associated with student-rated and observed engagement. Third, emotional support did not have a direct effect on student engagement but contributed to student engagement indirectly via organisational and instructional support. There were no gender differences with respect to self-reported engagement. Class size had a positive effect on teacher-rated engagement. The results demonstrated specific associations between the domains of classroom quality and student behavioural engagement in secondary school classrooms.     

Profiles of middle school science teachers: Accounting for cognitive and motivational characteristics

Teachers play a critical role in successfully implementing science education reforms in the United States to provide high-quality science learning opportunities to all students. However, the differentiated ways in which teachers make decisions about their science teaching are not well understood. This study takes a person-centered approach by applying latent profile analysis to examine how cognitive (pedagogical content knowledge) and motivational (instructional goal orientations, self-efficacy beliefs, and reform values) characteristics combine to form science teacher profiles in middle school. Predictors of profile membership (bachelor's degree, school %FRL) and both teacher (science instructional practices) and student (science achievement, engagement, and self-efficacy) outcomes related to the teacher profiles were also examined. Five science teacher profiles were identified (severely discouraged but reform oriented, discouraged but reform oriented, conventional, confident and mastery oriented, and confident with multiple goal approaches) that represented unique configurations of cognitive and motivation characteristics. Additionally, findings showed that the teacher profiles were significantly related to three dimensions of science instructional practice including communication, discourse, and reasoning. Finally, the teacher profiles were significantly related to student science achievement and motivational outcomes. Implications for differentiated approaches to teacher professional learning and supports for science instruction are discussed.     

An examination of the instruction provided in Australian essay guides for students’ development of a critical viewpoint

The argumentative essay has endured as a popular form of university assessment, yet students still struggle to meet key intended learning outcomes, such as those associated with critical thinking. This paper presents the results of a study that examines the instruction provided by Australian essay writing guides to support students’ development of a questioning, critical viewpoint. Thirty publically available guides were chosen from a range of university types, and sourced from central student learning units and humanities disciplines. Findings of this documentary analysis show that some guides provide too little context for essay writing as an academic practice, and conceptualise definitional, instructional and procedural aspects of the task in ways that may not align with intended outcomes. The conclusion indicates a need for further research about the teaching of argumentative essay writing.     

Student & tutor consensus: a partnership in assessment for learning

The mistakes made when attempting tasks often prove to be some of the most invaluable learning experiences. Despite this, outcome and results driven assessment formats largely penalise student performance errors or reward students who succeed by chance. The consequences of this paradigm are visible effects on student relationships with assessment. The student–tutor consensus approach to assessment was introduced to capture student learning achieved ‘from’ assessment to complement the measurement of performance outcomes. This approach parallels student and tutor judgement in a grade negotiation, affording the student an opportunity to share with their assessor what they have learned from the assessment activity. This student self-awareness was then considered alongside the conventional outcome-based score awarded by the tutor to generate a final grade for the assessed activity. Our study evaluated the perceptions of 90 undergraduate students enrolled in the bachelor of paramedic studies, who participated in this novel assessment approach as part of a final-year capstone topic. The results comprehensively indicated value for all aspects of the assessment approach, as well as a recognition that the skills will be useful in their future professional roles.     

If and When Money Matters: The Relationships Among Educational Expenditures, Student Engagement and Students�� Learning Outcomes

Calls for accountability in higher education are prompted in part by questions concerning whether colleges and universities use their resources effectively to promote student learning. Unfortunately, too little is known about whether money matters to desired outcomes of college. Using students?? responses to the 2004 administration of the National Survey of Student Engagement (NSSE) in concert with institutional data from the Integrated Postsecondary Education Data System (IPEDS) and the College Board, this study examined the relationships between educational expenditures, student engagement and selected student self-reported learning outcomes, controlling for student and institutional characteristics. Results indicated that expenditures were modestly related to student engagement and learning outcomes. However, the nature of these relationships differed, depending on the engagement/outcome measure and student year in school.     

Understanding science teaching effectiveness: examining how science-specific and generic instructional practices relate to student achievement in secondary science classrooms

ABSTRACT

In order to create conditions for students’ meaningful and rigorous intellectual engagement in science classrooms, it is critically important to help science teachers learn which strategies and approaches can be used best to develop students’ scientific literacy. Better understanding how science teachers’ instructional practices relate to student achievement can provide teachers with beneficial information about how to best engage their students in meaningful science learning. To address this need, this study examined the instructional practices that 99 secondary biology teachers used in their classrooms and employed regression to determine which instructional practices are predictive of students’ science achievement. Results revealed that the secondary science teachers who had well-managed classroom environments and who provided opportunities for their students to engage in student-directed investigation-related experiences were more likely to have increased student outcomes, as determined by teachers’ value-added measures. These findings suggest that attending to both generic and subject-specific aspects of science teachers’ instructional practice is important for understanding the underlying mechanisms that result in more effective science instruction in secondary classrooms. Implications about the use of these observational measures within teacher evaluation systems are discussed.     

The impact of alternative authentic assessment outcomes in Palestinian fourth grade math classrooms

Focusing on evaluating students’ performance in basic math classrooms, the researchers in this study examined the impact of alternative assessments on learning outcomes in fourth grade Palestinian classrooms. Representing a large sector of education in the Palestinian territories, fourth grade students were randomly selected to participate in the study in which they participated in various math instructional and assessment activities throughout multiple lessons and cycles. Alternative assessment approaches were used including student self- assessment, peer assessment, and teacher assessment in terms of three main achievement levels to measure the extent to which students learned the math concepts by recall and remembrance, ability to apply, and making inferences. Mixed Design ANOVA measures were used to analyze and interpret the results which showed significant trends and correlations across the four cycles of math instruction and indicated that alternative authentic assessment methods have had a positive impact on students’ learning and application of math. Implications for integrating authentic assessment measures as well as peer and self- assessments were drawn in light of the promising outcomes of augmenting student motivation and developing critical life-long skills.     

Building bridges to student learning: Perceptions of the learning environment,engagement, and learning outcomes among Chinese undergraduates

The study examined the relationships among students’ perceptions of the learning environment, prior academic achievement, engagement, and learning outcomes (cumulative university GPA, generic skills development, and learning satisfaction) with a sample of 2,616 seniors from a full-time research-oriented university in Mainland China. The results supported a model which showed that students’ perceptions of the learning environment and prior academic achievement had direct effects on learning outcomes, and indirect effects via their engagement. The effects, however, varied depending on the type of the outcome in question: (1) Student engagement mediated the relationship between course experience and generic skills development, (2) cocurricular experience positively predicted learning satisfaction, (3) first semester GPA positively predicted cumulative university GPA, and (4) National College Entrance Examination scores did not correlate with any other factor. A major proportion of the variance in the three types of learning outcomes was accounted for by the model, showing its effectiveness in predicting university students’ learning. Implications for improving undergraduate education in China are provided.