Challenge-based instruction promotes students’ development of transferable frameworks and confidence for engineering problem solving

ABSTRACT

Challenge-based teaching facilitates students’ simultaneous development of content mastery and strategies for applying technical knowledge innovatively. The University of Texas at Austin Department of Biomedical Engineering has offered a challenge-based course on biotransport as an accelerated study-abroad learning experience in Cambridge, England. We used a mixed methods approach to characterize students’ learning trajectory, to include technical prowess, problem-solving self-efficacy, and engineering identity throughout the entirety of this course. Students developed problem solving strategies and confidence over the semester and readily transferred their acquired solution framework to technical domains outside of the course subject of biotransport. Students identified challenge-based pedagogies as their preferred methods of classroom instruction, became familiar with corresponding assessments, and identified strongly as practitioners within the engineering field. We believe this illustrative case study provides significant evidence for the effectiveness of challenge-based instruction and can serve as a model for pedagogy-sensitive classroom assessment in engineering.     

Using Online Studio Groups to Improve Writing Competency: A Pilot Study in a Quality Improvement Methods Course

Communication skills are a significant contributor to an individual's success in the workplace. Unfortunately, students often have trouble expressing their ideas in written form and the poor quality of students’ written work often impedes the learning process. This pilot study investigates the use of online writing studios within a quality improvement methods course and the impact of this intervention on students’ writing competency and perceptions about the writing process. The impact of this approach on student performance is evaluated within and across semesters using comparative statistical analyses. Results show that students who participated in online writing studios performed better (i.e., at least one rubric level higher) on their final written assignments for the course compared to students who did not, and that this approach is associated with improved students’ perceptions about the writing process. This research suggests that the use of online writing studios within a content‐specific course can incrementally improve students’ writing competency over the course of one semester, and can positively affect the learning of written communication skills and change students’ perceptions about various aspects of the writing process.     

Individualized Course‐Specific Strategy Instruction for College Students with Learning Disabilities and ADHD: Lessons Learned From a Model Demonstration Project

Abstract. This 3‐year Model Demonstration Project involved the development and field testing of an individualized course‐specific strategy instruction model with college students with learning disabilities and Attention Deficit Hyperactivity Disorder (ADHD). The 46 participants received individualized semester‐long strategy instruction by graduate students in special education. A variety of data sources were used to evaluate the implementation of the model as well as the academic success of students who received individualized strategy instruction. Quantitative analyses indicated that the group as a whole as well as the subset of students on probation and suspension significantly improved their grades and sustained this improvement over time. Qualitative analysis identified two factors related to improvement: independent use of strategies and the supportive nature of the strategy instructor–student relationship. Qualitative analysis also identified two factors related to nonimprovement: academic/cognitive skill deficits and emotional/medication‐related issues. Implications of the model for postsecondary education and suggestions for future research are discussed.     

Improving Criminal Justice Students’ Writing Outcomes Through Systematic Writing Instruction

Criminal justice faculty members often express disappointment that their students are not meeting the writing expectations of the discipline. This study was a collaborative project between criminal justice and English faculty members to institute a writing pedagogy intervention to examine if criminal justice students’ writing would improve over the course of a semester. Quantitative and qualitative methods were used to examine student attitudes toward writing, documentation style, grammatical correctness, academic diction, and paraphrasing/plagiarism. The results revealed statistically significant improvements in student writing when writing assignments were scaffolded and frequent feedback was provided. Additionally, this study used independent raters to compare student performance on papers from a previous semester, when minimal writing instruction was provided, to the papers from the current study. The results suggest the intervention may improve criminal justice student writing.     

Using Continuous Improvement to Enhance an Online Course

Assessment is becoming important from many different perspectives. Universities are planning, developing, and testing various assessment models to satisfy stakeholders. Many accrediting agencies are also requiring assessment plans and their implementation from universities for reaccreditation. This article describes how assessment was used to continuously improve a database course in a Web MBA program, and combines Deming's Plan‐Do‐Check‐Act (PDCA) cycle with Bloom's taxonomy to develop rubrics for problem solving learning objectives in an online course. Results from direct and indirect measurements are used to improve the course. Specifically, two semester results are compared for course assessment. Results show some improvement; however, the course requires continuous improvement to meet benchmarks. The model presented here is generic in nature and should be useful for all educators who plan to initiate or continue the assessment and continuous improvement process. Instead of reinventing the wheel, educators can learn from our experiences and use the results as a starting point for their own assessment programs.     

Assessing the success of a discipline-based communication skills development and enhancement program in a graduate accounting course

In this paper we present results of the impact diagnostic testing and associated context-specific workshops have on students' written communication skills in a graduate-level accounting course. We find that students who undertook diagnostic testing performed better in their first semester accounting subject. This improvement is positively associated with student attendance at context-specific writing skills-based workshops. When we extend the analysis to examine the long-term benefits of participation in the academic development program, there is evidence that diagnostic testing has led to sustained improvement in students' writing ability within their final semester accounting subject.     

Educational Research in an Introductory Astronomy Course

The lecture is a common method used in college instruction, but many teachers are questioning its effectiveness. For this study, two successive spring semester sections of introductory astronomy for non-science majors were studied. The spring 1999 semester was the instructor's first attempt to incorporate innovative instructional techniques to include hands-on, minds-on instruction within the lecture setting. The educational research involved classroom observations, personal interviews, and pre-instruction/post-instruction administration of the Texas Attitude Survey and the Astronomy Diagnostic Test. During the spring 2000 semester, the instructor modified instruction to respond to student concerns from the previous semester. Student scores for the second course showed significant improvement in astronomy content and the institutional course survey, but not in student self-efficacy.     

Development of Scientific Thinking Facilitated by Reflective Self‐Assessment in a Communication‐Intensive Food Science and Human Nutrition Course

A one‐credit seminar on controversies in food science and human nutrition was a platform to introduce students to learning frameworks for thinking‐like‐a‐scientist. We hypothesized that explicitly engaging students in thinking about their thinking abilities within these frameworks would enhance their self‐perception of scientific thinking, an important general ability for food scientists. Our objectives were to assess thinking‐like‐a‐scientist using a student self‐assessment survey, and analyze their self‐reflections for evidence of such thinking. For students enrolled in one of the offerings of this course among 5 semesters from 2012 to 2014, differences in scores on a survey instrument for thinking‐like‐a‐scientist from the beginning to the end of the course showed gains in self‐assessed abilities (N = 21 to 22 students/semester). In each of the first 2 semesters in which we introduced thinking‐like‐a‐scientist frameworks, students thought they were better at defining problems scientifically by 13% to 14%. In the 3rd course offering, students’ self‐assessment of their abilities to seek evidence improved by 10%. In the 4th and 5th semester course offerings, students’ self‐assessed abilities to develop plans based on evidence improved by 7% to 14%. At the end of each semester, students’ self‐reflections on scientific thinking (N = 20 to 24/semester) included specific reference to asking questions (45% to 65% of reflections) and making plans based on evidence (26% to 50% of reflections). These data support the usefulness of self‐reflection tools as well as specific learning frameworks to help students to think about and practice thinking‐like‐a‐scientist.     

Teacher candidates' growth in designing mathematical tasks as exhibited in their lesson planning

Abstract

In order to gain insight into preservice teachers' beliefs about planning for mathematics instruction, a study was carried out involving K‐8 teacher candidates enrolled in an elementary mathematics methods course. Doyle's (1992) notion of academic task and the research on pedagogical content knowledge served as the theoretical framework for this study. The teacher candidates submitted lesson plans at three intervals during a semester‐long methods course; the lesson plans were then coded based on candidates' planned uses of academic tasks. Analyses of the data revealed trends in these teacher candidates' design of academic tasks over the course of the semester. Recommendations and implications are pre‐sented highlighting the benefits of incorporating the knowledge base on academic task into a mathematics methods course as a means to con‐tribute to teacher candidates' developing pedagogical content knowledge via their designing of academic tasks in lesson planning.     

Beyond the Central Dogma: Model-Based Learning of How Genes Determine Phenotypes

In an introductory biology course, we implemented a learner-centered, model-based pedagogy that frequently engaged students in building conceptual models to explain how genes determine phenotypes. Model-building tasks were incorporated within case studies and aimed at eliciting students’ understanding of 1) the origin of variation in a population and 2) how genes/alleles determine phenotypes. Guided by theory on hierarchical development of systems-thinking skills, we scaffolded instruction and assessment so that students would first focus on articulating isolated relationships between pairs of molecular genetics structures and then integrate these relationships into an explanatory network. We analyzed models students generated on two exams to assess whether students’ learning of molecular genetics progressed along the theoretical hierarchical sequence of systems-thinking skills acquisition. With repeated practice, peer discussion, and instructor feedback over the course of the semester, students’ models became more accurate, better contextualized, and more meaningful. At the end of the semester, however, more than 25% of students still struggled to describe phenotype as an output of protein function. We therefore recommend that 1) practices like modeling, which require connecting genes to phenotypes; and 2) well-developed case studies highlighting proteins and their functions, take center stage in molecular genetics instruction.     

Effects of thematic‐based,hands‐on science teaching versus a textbook approach for students with disabilities

Institutions of higher education, states, and local K–12 districts have been challenged to improve math and science education for our nation's students. In the past few years, there has been renewed interest in inquiry‐based, activity‐oriented instruction in science for students with disabilities. Yet, there still exists the need for further empirical evidence to support instructional improvements for students with more involved emotional and behavioral disabilities. This study describes a program in which 18 middle school students with serious emotional disturbances were instructed, over the course of 8 weeks, on “Matter” by two different instructional approaches. Students in one classroom received a traditional textbook approach to science content, whereas students in another classroom received science instruction by a hands‐on, thematic approach. Over the course of instruction, data were collected regarding students' behavior and achievement. Results indicate that, overall, students in the hands‐on instructional program performed significantly better than the students in the textbook program on two of three measures of science achievement, a hands‐on assessment and a short‐answer test. The students did not differ on a multiple‐choice format test. With regard to behavior, there were no significant differences in behavioral problems found between the two groups of students over the course of the study. Findings are discussed in relation to instructional implications for students with disabilities in the science classroom. © 2005 Wiley Periodicals, Inc. J Res Sci Teach 42: 245–263, 2005     

高中英语教师写作教学信念与实践的个案研究

本研究采用历时质性个案研究方法,对北京某重点高中两位英语教师进行了为期一年的跟踪调查。通过分析访谈、课堂观察等多种数据,本研究发现两名教师都认为英语写作教学应以培养学生的批判性思维和语言综合能力为目的,且与其他技能的培养相融合。她们采用体裁式写作教学方法,将写作教学嵌入日常英语教学活动,关注学生学习写作的过程。本研究发现表明高中英语教师在日常教学中可以突破应试束缚,切实培养学生的写作能力。     

Use of individual feedback during human gross anatomy course for enhancing professional behaviors in doctor of physical therapy students

Medical professionals and public consumers expect that new physical therapy graduates possess cognitive, technical, and behavioral skills required to provide safe and high‐quality care to patients. The purpose of this study was to determine if a repertoire of ten professional behaviors assessed at the beginning of doctorate of physical therapy education and before the first significant clinical internship could be enhanced in a semester course in gross human anatomy using individual formative feedback. During the human anatomy course, 28 first‐year physical therapy students completed six biweekly, anonymous self‐ and peer assessment surveys that targeted ten professional behaviors important to physical therapists. All professional behaviors were assessed using a five‐point Likert scale. Feedback reports occurred at week eight (mid‐semester) and week 16 (end‐of‐semester) and comprised the direct intervention components of this study. At the midpoint of the semester, professional behavior scores and narrative comments from weeks two, four, and six were compiled and shared with each student by one of three faculty members in a feedback session. Students then submitted biweekly self‐and peer professional behavior assessments (weeks 10, 12, and 14) for the remainder of the human anatomy course. Differences between preintervention and postintervention scores for each of the ten professional behaviors were compared using the Wilcoxon signed‐ranks test. Upon receiving mid‐semester individual feedback, students demonstrated significant improvement in each of the ten professional behaviors. Results from this study indicated a gross anatomy laboratory dissection experience during the first academic semester provided an effective opportunity for teaching and assessing professional behaviors of doctoral students in physical therapy. Anat Sci Educ 6: 324–331. © 2013 American Association of Anatomists.     

公共英语写作中引入同伴互评模式的行动研究

通过行动研究的方式探讨在公共英语教学中引入同伴反馈作文评改方式的可行性和有效性.研究结果表明:学生认可同伴评改的方式,学生被证明具备评价他人作文的能力,同伴互评可以使学生的作文在内容、结构、语言上有一定的改进.通过这次行动研究可知只要设计合理、操作严谨,同伴反馈可做为教师反馈方式的一种补充,融入到写作教学中,从而提高公共英语学生的写作水平.     

Impacts of contextual and explicit instruction on preservice elementary teachers' understandings of the nature of science

This mixed‐methods investigation compared the relative impacts of instructional approach and context of nature of science instruction on preservice elementary teachers' understandings. The sample consisted of 75 preservice teachers enrolled in four sections of an elementary science methods course. Independent variables included instructional approach to teaching nature of science (implicit vs. explicit) and the context of nature of science instruction (as a stand‐alone topic vs. situated within instruction about global climate change and global warming). These treatments were randomly applied to the four class sections along a 2 × 2 matrix, permitting the comparison of outcomes for each independent variable separately and in combination to those of a control group. Data collection spanned the semester‐long course and included written responses to pre‐ and post‐treatment administrations of the VNOS‐B, semi‐structured interviews, and a variety of classroom artifacts. Qualitative methods were used to analyze the data with the goal of constructing profiles of participants' understandings of the nature of science and of global climate change /global warming (GCC/GW). These profiles were compared across treatments using non‐parametric statistics to assess the relative effectiveness of the four instructional approaches. Results indicated that preservice teachers who experienced explicit instruction about the nature of science made statistically significant gains in their views of nature of science regardless of whether the nature of science instruction was situated within the context of GCC/GW or as a stand‐alone topic. Further, the participants who experienced explicit nature of science instruction as a stand‐alone topic were able to apply their understandings of nature of science appropriately to novel situations and issues. We address the implications of these results for teaching the nature of science in teacher preparation courses. © 2010 Wiley Periodicals, Inc., Inc. J Res Sci Teach 48: 414–436, 2011     

Implementing Recommendations for Introductory Biology by Writing a New Textbook

We redesigned the undergraduate introductory biology course by writing a new textbook (Integrating Concepts in Biology [ICB]) that follows first principles of learning. Our approach emphasizes primary data interpretation and the utility of mathematics in biology, while de-emphasizing memorization. This redesign divides biology into five big ideas (information, evolution, cells, emergent properties, homeostasis), addressing each at five levels of organization (molecules, cells, organisms, populations, ecological systems). We compared our course outcomes with two sections that used a traditional textbook and were taught by different instructors. On data interpretation assessments administered periodically during the semester, our students performed better than students in the traditional sections (p = 0.046) and exhibited greater improvement over the course of the semester (p = 0.015). On factual content assessments, our students performed similarly to students in the other sections (p = 0.737). Pre- and postsemester assessment of disciplinary perceptions and self-appraisal indicate that our students acquired a more accurate perception of biology as a discipline and may have developed a more realistic evaluation of their scientific abilities than did the control students (p < 0.05). We conclude that ICB improves critical thinking, metacognition, and disciplinary perceptions without compromising content knowledge in introductory biology.     

Educational psychology at the university of Wisconsin

A 44 item questionnaire and free response instrument was given to 280 students selected from two different kinds of introductory educational psychology courses: (a) A “module”; approach involving selection of 3 five‐week modules from a list of such courses; and (b) A specially prepared composite learning and development course covering 1 semester. Analysis of the results lead to the following conclusions: (1) “In theory”; students preferred the module approach; (2) “In practice”; students preferred the composite 1 semester course; (3) The outstanding variable contributing to students’ assessment of relevancy, and teaching procedures, was the instructor. The implication of these findings for innovations in teaching students is discussed.     

Third graders' use of writing to facilitate learning of engineering concepts

Incorporating engineering instruction into the elementary curriculum is not without challenges. Traditionally, researchers investigated using engineering design to promote students learning science concepts. More recently, researchers have conducted qualitative investigations to measure students' learning of engineering concepts after engaging in engineering design. In this study, we extended work on elementary engineering instruction by implementing an integrated engineering and writing unit with 58 third-grade students. Using stratified random assignment based on pre-intervention engineering vocabulary assessment scores, we assigned students to treatment (n = 28) or comparison (n = 30). During a 10-day unit, all students participated in design challenges, emulated the practices of actual engineers, and used writing to support and document their learning, as they designed and authored their own five-page pop-up books. Students in the treatment condition participated in additional writing during 8 of the 10 unit lessons. During this time, they responded to journal prompts related to lesson objectives. At the same time, students in the comparison condition participated in small-group discussions during which they discussed journal prompts orally. We found that all students made statistically significant gains from pre- to posttest on an engineering vocabulary assessment; total words written, number of different engineering concepts used, and depth of understanding of engineering concepts in a written essay response; and number of different engineering concepts used in an oral interview response, regardless of their incoming writing skills and regardless of whether they participated in additional writing or small-group discussion of lesson objectives. This study is the first to quantitatively document the effectiveness of a combined elementary engineering and writing intervention for promoting students' learning of engineering concepts in multiple ways (rote recall, written representation, and oral representation). We argue that literacy, particularly writing, provides an effective and feasible method for incorporating engineering instruction into the elementary curriculum.     

A modified peer rating system to recognise rating skill as a learning outcome

The peer rating system used here advances the quantitative literacy goals outlined in the social sciences. We instituted a mid-semester intervention to teach rating skills and used an index to track longitudinal changes of skill mastery over the course of the semester. Seventy-four students in five advanced research classes followed the procedure of the existing peer rating system by completing reading assignments, writing reflections online, engaging in class discussions, rating their peers’ reflections and receiving feedback on their group effort. Peer ratings were then compared with each other and also with the instructor ratings to derive individualised indices of reliability and validity. These technical indicators enabled two rounds of assessment before and after a class-wide intervention. An omnibus test across the five classes showed a significant improvement in rating quality due to the intervention. Our courses not only met a quantitative learning outcome but also promised vocational competence.     

Design and implementation of a project-based active/cooperative engineering design course for freshmen

A project-based active/cooperative design course is planned, implemented, assessed and evaluated to achieve several desired engineering outcomes. The course allows freshman-level students to gain professional hands-on engineering design experience through an opportunity to practise teamwork, quality principles, communication skills, life-long learning, realistic constraints and awareness of current domestic and global challenges. Throughout successive design reports and in-class assignments, the students are required by the end of the semester to communicate, clearly and concisely, the details of their design both orally and in writing through a functional artefact/prototype, a design notebook, an A0 project poster and a final oral presentation. In addition to these direct assessment tools, several indirect measures are used to ensure triangulation. Assignments are based on customer expectations using a detailed checklist. This paper shows the direct and indirect assessment tools that indicated a high level of achievement of course learning outcomes and a high level of student satisfaction.