Rapid Feedback Assessment Methods: Can We Improve Engagement and Preparation for Exams in Large-enrollment Courses?

Scratch-off immediate feedback assessment technique (IF-AT) forms and classroom response systems (clickers) can increase student engagement and interaction and help students prepare for exams by indicating the type and level of questions they will encounter. We used the IF-AT throughout the semester in three sections of a lower-division biology class; in two, students worked on IF-AT questions in small permanent groups, and in one, students alternated between IF-AT and clickers each week. At the end of the semester, students answered surveys about instant feedback techniques. Students appreciated prompt feedback on their understanding of course material, enjoyed the group interaction and opportunities to learn from each other, and continued to have positive perceptions of instant feedback activities and to take them seriously throughout the semester. While appreciating the versatility of clicker questions, we find that the ease of use, low cost, effectiveness, and improved classroom climate of the IF-AT method are particularly commendable.     

WHAT YOU KNOW AND HOW YOU WRITE IT: A PROJECT FOR TEACHING AND ASSESSING WRITING ACROSS THE CURRICULUM

Writing evaluation conventionally relies on essay tests, but more informal methods can help reveal students' writing skills. A classroom project was designed to examine students' awareness of the demands posed by various academic writing, tasks, to discover how that awareness develops with experience, and to orient new students to the roles writing plays in their academic lives. The project involved three groups: freshmen enrolled in introductory writing classes for the first time, freshmen and others repeating the introductory classes, and upperclass students enrolled in a course in professional writing. At the beginning of the semester, all were asked to report any information they could find that would help them complete the semester's writing tasks. At the end of the semester they added information they had gained in the interval. Reports from all groups contained the same kinds of information, but students in professional writing noted more often that purposes of assignments related to goals for the course, while the freshmen added more late information about writing processes. The project was a valuable learning activity and suggested what roles writing plays in students' academic lives. Similar projects should be included in a thorough assessment of writing programs.     

Accommodating the Remedial Student in the Content Class

The authors examined how the regular use of Monte Carlo Quizzes, learning logs, or non-random quizzes impacted student completion of assigned reading and preparedness for class. A questionnaire was used to gather data on student perceptions and self-reported reading behavior in response to each of the methods over the course of a semester. Results suggested that students in classes that used the learning log method were more motivated to complete readings, felt better able to contribute to class discussions, and were more likely to recommend the assessment method than students in classes that used the other methods.     

Longitudinal study of a cooperation-driven,socio-scientific issue intervention on promoting students’ critical thinking and self-regulation in learning science

ABSTRACT

This longitudinal study explored the effects of a Cooperation-driven Socioscientific Issue (CDSSI) intervention on junior high school students' perceptions of critical thinking (CT) and self-regulation (SR) in Taiwan. Forty-nine grade 7 students were randomly selected as an experimental group (EG) to attend a 3-semester 72-hour intervention; while another 49 grade 7 students from the same school were randomly selected as the comparison group (CG). All participants completed a 4-wave student questionnaire to assess their perceptions of CT and SR. In addition, 8 target students from the EG with the lowest scores on either CT or SR were purposefully recruited for weekly observation. These target students and their teachers were interviewed one month after the intervention in each semester. Analyses of covariance and paired-wise t-tests revealed that the EG students' perceptions of CT and SR in learning science were improved during the study and were significantly better than their counterparts' at the end of the study. Systematic interview and classroom observation results were consistent with the quantitative findings. This study adds empirical evidence and provides insights into how CDSSI can be integrated into planning and implementing effective pedagogical strategies aimed at increasing students' perceptions of CT and SR in learning science.     

What Students Think and Do in Classroom Teams When Peer Evaluations Are Highly Consequential: A Two‐Stage Study

The article presents findings from a two‐stage study that examined student perceptions of peer evaluations (PEs) conducted in undergraduate business classroom teams. In stage 1, we used qualitative research to identify constructs focal in students’ PE‐related cognitive schemas and developed grounded measurement scales and hypotheses about their relationships. Then, we implemented PEs in 17 sections of undergraduate business courses taught over seven semesters. The PEs were highly consequential; i.e., they entirely determined the grade each student received on her/his team project. At the end of each semester, we surveyed student perceptions and behaviors using measurement scales we developed after stage 1 of the study. We find that the knowledge of impending PEs leads students to exercise a great deal of care in terms of what they say and do while working with others. The higher levels of care trigger both impression management behaviors and perceptions that others are contributing more. The perceptions that others are contributing more seem instrumental in shaping students’ decision to contribute more themselves. Implications for instructors and future research are discussed.     

体育管理学课程案例教学研究

为了解体育管理课程案例教学对学生学习兴趣及分析问题、解决问题能力的影响,在2年教学时间内,在体育管理学教学中安排了40％课时比重的案例教学,对295名学生的调查发现学生对案例教学很重视,但对案例教学的效果满意度不高。学生对案例质量的实用性和时效性要求较高,对教师收集业界第一手案例的期望较高。学生希望对案例教学的分组做到公平合理。     

A comparative study on student perceptions of their learning outcomes in undergraduate science degree programmes with differing curriculum models

ABSTRACT

This study investigated students’ perceptions of their graduate learning outcomes including content knowledge, communication, writing, teamwork, quantitative skills, and ethical thinking in two Australian universities. One university has a traditional discipline-orientated curriculum and the other, an interdisciplinary curriculum in the entry semester of first year. The Science Students Skills Inventory asked students (n?=?613) in first and final years to rate their perceptions of the importance of developing graduate learning outcomes within the programme; how much they improved their graduate learning outcomes throughout their undergraduate science programme; how much they saw learning outcomes included in the programme; and how confident they were about their learning outcomes. A framework of progressive curriculum development was adopted to interpret results. Students in the discipline-oriented degree programme reported higher perceptions of scientific content knowledge and ethical thinking while students from the interdisciplinary curriculum indicated higher perceptions of oral communication and teamwork. Implications for curriculum development include ensuring progressive development from first to third years, a need for enhanced focus on scientific ethics, and career opportunities from first year onwards.     

Year-Long Peer Mentoring Activity to Enhance the Retention of Freshmen STEM Students in a NSF Scholarship Program

The last year of a National Science Foundation (NSF) funded scholarship program was used to provide pseudo-formal peer mentoring activities to engineering, mathematics, and science undergraduates. A one-credit class was used to afford time for peer mentors and mentees to interact. During the fall semester, seniors augmented each week’s topics with personal experiences as to how they used the skill/topic that they had learned in their freshmen class in a future sophomore, junior or senior level course or on their co-op assignment. The last 10 min of every class were used for the seniors and freshmen to have an informal discussion. During the spring semester, the seniors served as an additional technical resource for the freshmen as they completed their class project. All participants found the one-credit class, project and peer mentoring activities beneficial to their education and would highly recommend the experience to incoming students.     

Students' Perceptions of Teaching and Learning: The influence of students' approaches to learning and teachers' approaches to teaching

Nearly 500 secondary students in 24 classes were surveyed and four students in each class interviewed concerning their approaches to learning and perceptions of their classroom environment. While interviewed students with deep approaches to learning generally demonstrated a more sophisticated understanding of the learning opportunities offered to them than did students with surface approaches, teaching strategies also influenced students' perceptions. When teachers focused strongly on actively engaging students and creating a supportive environment, students with both deep and surface approaches focused on student-centred aspects of the class. In contrast, when traditional expository teaching methods were used exclusively, students with deep and surface approaches both focused on transmission and reproduction.     

Learner Assessment through Subjective Theories and Action Research

This paper deals with students’ and university teachers’ self‐concepts on the basis of subjective theories: It is proposed to show how students and teachers are guided in university classes by their self‐images and how these determine their behaviour in such sessions. In a project carried out with students in the summer of 1997 in a literature course, subjective theories were connected with action research. Students and teachers collected data that helped them reflect on their behaviour, especially their own participation during sessions (from the students’ side) and on teacher control and dominance (from the teacher's side). Student diaries, video documentation of some of the sessions and interviews with students at the end of the semester were analysed with regard to learning processes and respective insights into students’ and the teacher's subjective theories.     

Incremental impact of time on students' use of E‐learning via Facebook

The majority of studies utilised the cross‐sectional method to measure students' intention to learn and investigate their corresponding learning behaviours. Only a few studies have measured the process of change in students' learning behaviour in the context of time. The main purpose of this study is to determine the effects of using a Facebook group as an e‐Learning tool based on students' longitudinal perceptions to address the aforementioned literature gap. We surveyed 170 students in a business statistics course. We also measured changes that occurred in the students' intention to use and use of e‐Learning at three different stages. The model was tested at the beginning, middle and end of the semester using structural equation modelling. The results show that students' perceptions when using e‐Learning via Facebook changed when they interacted and explored the system. Students were more familiar with the usability of the Facebook group after learning for a few weeks, and their intention to use and use of e‐Learning via Facebook subsequently increased. The results indicated that social network sites such as Facebook can be used as complementary tools to expose students to course‐related links and documents, which will create extra time for learning, when they plan to spend time on Social network sites (Facebook) and interact and communicate with friends.     

Bridging the Gap Between Preservice Early Childhood Teachers’ Cultural Values, Perceptions of Values Held by Scientists, and the Relationships of These Values to Conceptions of Nature of Science

This study explored preservice teachers’ views of their own cultural values, the cultural values they believed scientists hold, and the relationships of these views to their conceptions of nature of science (NOS). Parallel assignments in a foundations of early childhood education and a science methods course required preservice teachers to explore their own cultural backgrounds and their perceptions of the cultural backgrounds of scientists. The Schwartz Values Inventory was used to measure preservice teachers’ personal cultural values and those they perceived of scientists. The Views of Nature of Science version B questionnaire and interviews assessed teachers’ conceptions of NOS. Copies of student work were collected and sought for themes indicating how preservice teachers perceived scientists’ cultural values and how those perceptions changed over time. We found that from the beginning to the end of the semester, preservice teachers perceived fewer differences between their own cultural values and those they perceived scientists held, though they did not change their own cultural values. We found that preservice teachers’ NOS conceptions improved, and that they were related to both their cultural values and those they perceived scientists held. Preservice teachers who indicated the fewest differences between their own cultural values and those they perceived scientists held the most informed conceptions of NOS.     

Conceptions of Biology and Approaches to Learning of First Year Biology Students: Introducing a technique for tracking changes in learner profiles over time

We surveyed first year students at the start and at the end of their first semester of university biology (n?=?285) as to their approaches to study (surface, deep) and their conceptions of biology (fragmented, cohesive). Hierarchical cluster analysis was used to group students who responded similarly to the survey; this resolved four Learner Profiles based on specific combinations of approach to study and conception of biology. By comparing cluster membership at the start and end of the semester we could assess whether students (1) maintained their incoming approach to study and conception of the discipline of biology, i.e. their ‘Learner Profile’ and (2) whether certain Learner Profiles were more persistent than others. Approximately half the student cohort did not alter their approach to study or conceptions of biology by semester's end. Students in the disengaged profile, i.e. who returned mostly negative responses to survey items, appeared the most resistant to changing their Learner Profile; while the greatest migration occurred towards less than desirable learning strategies (particularly to the disengaged profile). We were able to confirm the significant migration patterns by assessing the heterogeneity of each cluster at the start of semester clusters with respect to the students' approaches and conceptions at the end of semester. Thus we present a process to accurately track Learner Profile changes that may tell us more about how we can enhance students' learning and provide a means by which to gather the empirical data to support decisions relating to curriculum change.     

Evaluating the impact of online discussion boards on student engagement with group work

The purpose of this study is to examine the impact of the use of an online discussion board as an assessment item on students learning performance in relation to group work based on Social Learning Theory. The study uses survey questionnaires at the beginning and end of semester together with student grade information. The data analysis consists of (1) a regression analysis to explore the relationship between student interaction and performance and (2) a repeated measures ANOVA to explore changes in attitude and perceived encouragement. Student's perceptions at the outset were found to be important as was the use of the online discussion board as a learning tool even when it is not assessed. Further, students' attitude to the online discussion board improved through the semester however the online assessment task did not encourage domestic students to be more engaged in group-based activities. In contrast, international students were more encouraged to participate in group-based activities at the end of the semester. The study has implications for online group activities in education.     

Development of Scientific Thinking Facilitated by Reflective Self‐Assessment in a Communication‐Intensive Food Science and Human Nutrition Course

A one‐credit seminar on controversies in food science and human nutrition was a platform to introduce students to learning frameworks for thinking‐like‐a‐scientist. We hypothesized that explicitly engaging students in thinking about their thinking abilities within these frameworks would enhance their self‐perception of scientific thinking, an important general ability for food scientists. Our objectives were to assess thinking‐like‐a‐scientist using a student self‐assessment survey, and analyze their self‐reflections for evidence of such thinking. For students enrolled in one of the offerings of this course among 5 semesters from 2012 to 2014, differences in scores on a survey instrument for thinking‐like‐a‐scientist from the beginning to the end of the course showed gains in self‐assessed abilities (N = 21 to 22 students/semester). In each of the first 2 semesters in which we introduced thinking‐like‐a‐scientist frameworks, students thought they were better at defining problems scientifically by 13% to 14%. In the 3rd course offering, students’ self‐assessment of their abilities to seek evidence improved by 10%. In the 4th and 5th semester course offerings, students’ self‐assessed abilities to develop plans based on evidence improved by 7% to 14%. At the end of each semester, students’ self‐reflections on scientific thinking (N = 20 to 24/semester) included specific reference to asking questions (45% to 65% of reflections) and making plans based on evidence (26% to 50% of reflections). These data support the usefulness of self‐reflection tools as well as specific learning frameworks to help students to think about and practice thinking‐like‐a‐scientist.     

Exploring first‐year academic achievement through structural equation modelling

The purpose of this research was to develop and test a multicausal model of the individual characteristics associated with academic success in first‐year Australian university students. This model comprised the constructs of: previous academic performance, achievement motivation, self‐regulatory learning strategies, and personality traits, with end‐of‐semester grades the dependent variable of interest. The study involved the distribution of a questionnaire, which assessed motivation, self‐regulatory learning strategies and personality traits, to 1193 students at the start of their first year at university. Students' academic records were accessed at the end of their first year of study to ascertain their first and second semester grades. This study established that previous high academic performance, use of self‐regulatory learning strategies, and being introverted and agreeable, were indicators of academic success in the first semester of university study. Achievement motivation and the personality trait of conscientiousness were indirectly related to first semester grades, through the influence they had on the students' use of self‐regulatory learning strategies. First semester grades were predictive of second semester grades. This research provides valuable information for both educators and students about the factors intrinsic to the individual that are associated with successful performance in the first year at university.     

Decreasing course content improves student comprehension of science and attitudes towards science in freshman biology

This study demonstrates a small, but significant, difference in prior understanding of basic biological concepts between students enrolled in majors' versus nonmajors' introductory biology courses. By the end of their respective courses, nonmajors demonstrated greater improvement in posttest scores than did majors. Furthermore, although initially students in the major course had a significantly more positive attitude towards science, especially in terms of personal comfort with science, by the end of the course this difference disappears. Following a semester of instruction, the attitudes of nonmajors generally improved, but student attitudes in the majors' classes declined in nearly all categories. We demonstrate a significant instructor effect in these results.     

Positive error climate promotes learning outcomes through students’ adaptive reactions towards errors

Errors are an integral part of the learning process and an opportunity to increase skills and knowledge, but they are often discouraged, sanctioned and derided in the classroom. This study tests whether students' perceptions of being part of an error-friendly classroom context (i.e., a positive classroom error climate) is positively related to students' learning outcomes via students' adaptive reactions towards errors. A total of 563 Italian middle school students from 32 mathematics classes completed a questionnaire on their perceptions of classroom error climate and their reactions towards errors. Students' math grades were used as indicators of their level of learning outcomes. A multilevel model showed that perceived classroom error climate was positively related to math grades via increased adaptive reactions towards errors. Our findings revealed that an error-friendly classroom context is associated with students’ adaptive adjustment to errors and to better learning outcomes in mathematics.