Multi-Method Evaluation of Instruction in Engineering Classes

Student evaluation of instruction in college and university courses has been a routine and mandatory part of undergraduate and graduate education for some time. A major shortcoming of the process is that it often relies exclusively on the opinions or qualitative judgments of students rather than the learning or transfer of knowledge that takes place in the classroom. To develop a more objective system of assessment, this research focused on a learning-centered approach to course work and teaching evaluation. Standardized testing tools were developed suitable for measuring the content knowledge of students in a representative group of undergraduate courses. Course evaluations were conducted using two systems of assessment: the traditional student questionnaire feedback system and one based on the learning-centered approach using a computer-based question bank and on-line testing. Significant performance differences were evident in pretest/posttest comparisons of student learning. Favorable ratings of instruction are reflected in opinions on student questionnaires. No relationship was demonstrated between learning and traditional course evaluation outcomes. Our hypothesis that the learning-centered approach provides information that is not available using the traditional student feedback system was supported.Support for this research was provided in part by Grant No. P116B981224-00 from the U.S. Department of Education, Fund for the Improvement of Post-Secondary Programs awarded to the University of North Carolina at Charlotte. The opinions expressed do not necessarily reflect the position or policy of the Department of Education, and no official endorsement should be inferred.     

Navigating Between Home and Empire: Mobility and Male Friendship in <Emphasis Type="Italic">Tom Brown’s Schooldays</Emphasis> and <Emphasis Type="Italic">The Three Midshipmen</Emphasis>

In this article, we investigate the public school novel as represented by Thomas Hughes’s Tom Brown’s Schooldays (1857) and the boy’s sea story as represented by W. H. G. Kingston’s The Three Midshipmen (1873). The school novel and the sea story sometimes functioned as twinned forms enabling authors for boys to explore anxieties about male selfhood and relocating oneself in the larger community while growing up. As becomes especially apparent when they are read together, these novels address the boy’s relationship to home and empire, rootlessness and rootedness. The coming-of-age plot found in the boys’ books reveals a literature that embraces both rootlessness/mobility and rootedness/community and that posits an all-male version of something closely resembling domestic life as a way to navigate between the two.     

A Constructivist Model of Mentoring,Coaching, and Facilitating Online Discussions

This case study of an online graduate course determines the message characteristics of the instructor, volunteer teaching assistants, and students in online discussions, and proposes a mentoring, coaching, and facilitating model for online discussions. The researchers developed a coding system based on the literature of mentoring, coaching, and facilitating to identify the characteristics of conference discussion messages. The instructor fostered the development of volunteer teaching assistants into coaches and of student discussion facilitators into facilitators of learning. The proposed constructivist model fosters active learning, provides scaffolding for students to become facilitators of learning, and suggests creative ways for online instructors to manage different types of teaching responsibilities. Recommendations for further research are included.     

An Interview Protocol and Scoring Rubric for Evaluating Teacher Performance

This paper introduces an interview protocol, administration procedures, and scoring rubric for evaluating teacher performance. Procedures used to develop and adminis ter the protocol and scoring rubric and subsequent validity and reliability studies are reported. All evidence suggests that the protocol and scoring rubric are aligned with professional standards and focus on a teacher's assessment of and ability to modify instruction to improve student learning. These findings support the viability of the interview protocol as an effective method of evaluating teacher performance.     

The role of lesson analysis in pre-service teacher education: an empirical investigation of teacher learning from a virtual video-based field experience

A video-based program on lesson analysis for pre-service mathematics teachers was implemented for two consecutive years as part of a teacher education program at the University of Lazio, Italy. Two questions were addressed: What can preservice teachers learn from the analysis of videotaped lessons? How can preservice teachers’ analysis ability, and its improvement, be measured? Two groups of preservice teachers (approximately 140 in total) participated in the program. A three-step lesson analysis framework was applied to three lesson videos: (1) goal(s) and parts of the lesson; (2) student learning; and, (3) teaching alternatives. Preservice teachers’ ability to analyze lessons was measured through an open-ended pre- and post-assessment. In the assessment, preservice teachers were asked to mark and comment on events (in a lesson not included in the program) that they found interesting for: teachers’ actions/decisions; students’ behavior/learning; and, mathematical content. A coding system was developed based on five criteria: elaboration, mathematics content, student learning, critical approach, and alternative strategies. In both studies, the ability to analyze instruction improved significantly on all five criteria. These data suggest promising directions for the development of both an instrument to measure lesson analysis abilities and a model for teacher learning.     

The Development of Implicit Memory From Infancy to Childhood: On Average Performance Levels and Interindividual Differences

The present multimethod longitudinal study aimed at investigating development and stability of implicit memory during infancy and early childhood. A total of 134 children were followed longitudinally from 3 months to 3 years of life assessing different age‐appropriate measures of implicit memory. Results from structural equation modeling give further evidence that implicit memory is stable from 9 months of life on, with earlier performance predicting later performance. Second, it was found that implicit memory is present from early on, and no age‐related improvements are found from 3 months on. Results are discussed with respect to the basic brain structures implicit memory builds on, as well as methodological issues.     

Learning from scientific texts: personalizing the text increases transfer performance and task involvement

In an experiment with 65 high-school students, we tested the hypothesis that personalizing learning materials would increase students’ learning performance and motivation to study the learning materials. Students studied either a 915-word standard text on the anatomy and functionality of the human eye or a personalized version of the same text in which 60 definite articles (e.g., “the eye”) were replaced with 60 second-person possessive pronouns (e.g., “your eye”). Afterwards, participants answered comprehension and transfer questions. One week later, the participants were asked to restudy the text and to answer the same questions again with the aim to improve their performance. In the personalized text condition, students showed higher transfer performance, spent more time on restudying the text, and reported being more motivated than students in the standard text condition. However, only duration of restudying (not self-reported motivation) mediated the effect of personalization on transfer performance.     

A “Chameleonic” Identity: Foreign-Born Doctoral Students in U.S. Counselor Education

This study explored the interplay between a multidimensional model of acculturation and professional identity development among eight foreign-born doctoral students in U.S. counselor education. Themes generated through an interpretive phenomenological analysis revealed that the participants, while trying to adapt to the Euro-American cultural context of their counselor programs, experienced a sense of conflict, loss, and grief, resulting in what they called a “chameleonic” professional identity. Findings illustrated that for international counseling students, professional identity development is an arduous and complex process deeply intertwined with their acculturation experiences. Implications for counselor programs and future research are further discussed.     

Liquid subjects: news media and public political pedagogy

The purpose of this paper is to examine the relationship between news media and political education within consumer society. We argue that political education today needs to be understood as part of consumerism and media culture, in which individuals selectively expose themselves to and scrutinize various media representations not only of political issues, but also of political subjectivity and action. Individuals learn about how they might become political and act politically through their engagements with the news, in the context of the characteristics of liquid modernity, namely consumer culture, individualization, and choice. When examined through a lens of public pedagogy, political education becomes intertwined with consumer culture and the role of media in the education and socialization of political subjectivity. In this paper, we look at one example of the relationship between news and the education of political subjectivity by drawing from a larger research study, which examined the role of mainstream and alternative media in citizens’ political mobilization on climate change. We argue that news consumption is part of a public political pedagogy through which individuals negotiate becoming liquid subjects, that is, citizens who take a critical, monitorial, and individualistic consumer approach to becoming political and taking part in social change.     

The role of non-formal contexts in teacher education for STEM: the case of horno3 science and technology interactive centre

Abstract

Teacher education can benefit directly from experiences in non-formal settings. This article presents a research study with elementary teachers who were teaching in public schools in the state of Nuevo León, México, and participated in a STEM Continuous Professional Development (CPD) workshop. The workshop provided a platform for teachers to interact with scientists and disseminators of science, allowing the appropriation of scientific knowledge applied to everyday activities and settings. Participants improved the quality of their teaching practices in classrooms and gained a new understanding of STEM subjects, enabling them to promote inspiring learning experiences with their students, where dialogue, experimentation and elucidation became an important part of their lessons. The study was carried out using ethnographic tools for analysing recorded videos, 15 sets of field notes, and 49 questionnaires. The sequential analysis of talk and gestures in their participation in the CPD workshop demonstrated high levels of involvement, creativity, and collaborative solution of STEM problems.