An investigation on industry-sponsored design projects' effectiveness at the first-year level: potential issues and preliminary results

This paper presents the preliminary work for developing guidelines to ensure that industry-sponsored projects in first-year courses aid, not hamper, retention of students. Specifically, the overall research plan includes the following steps: (1) investigating the appropriateness of industry projects in a required introduction to engineering design course (approximately 1000 students per year), (2) assessing the impact of industry-sponsored projects on first-year students' learning and retention, and (3) promoting an awareness of issues involved in successfully introducing industry projects in the first year. It is expected that the outcomes of this work will result in guidelines widely applicable by other institutions looking into or currently using industry projects in the first year, thereby addressing the recognized national need of increasing retention rates, especially amongst women and minorities.

This paper covers a review of potential factors affecting industry-sponsored projects' appropriateness at the first year, and related preliminary data.     

Who is the expert? Construct and criteria validity of student and teacher ratings of instruction

In this article, we examine the construct and criteria validity of student and teacher ratings as indicators of instructional features. As parsimonious measures, student and teacher reports are frequently used to assess aspects of the learning environment. From a methodological perspective, however, both approaches have been questioned. Whereas student ratings are occasionally criticised as being undifferentiated and easily influenced by personal preferences, teacher reports are sometimes considered to be biased by self-serving strategies or teaching ideals. Instead of pitting one method against the other, our study aimed at establishing the specific value of each approach. The analyses draw on data from a German extension to the 2003 PISA assessment, in which 288 mathematics teachers and their students completed questionnaires using identical items to tap various aspects of instruction. Mean student ratings were computed for each class. Exploratory and confirmatory factor analyses revealed specific conceptual structures for student and teacher ratings, with teachers elaborating on the use of tasks and methods, and students focusing on their teacher’s support in personal and learning matters. Three shared dimensions were also established: occurrence of classroom management problems, degree of cognitive autonomy during lessons, and tempo of interaction. Teacher/student agreement on these dimensions varied across constructs, with considerable agreement on classroom management, low agreement on cognitive autonomy, and no significant agreement on whether or not the interaction tempo was appropriate. Accordingly, correlations with external criteria (student motivation, teacher motivation, mathematical achievement scores, and characteristics of the tasks set in class) also varied across constructs. We conclude that student and teacher ratings are best suited to tapping different aspects of the learning environment, and recommend that care be taken in choosing a data source appropriate for the construct to be measured.

The h index research output measurement: Two approaches to enhance its accuracy

The h index is a widely used indicator to quantify an individual's scientific research output. But it has been criticized for its insufficient accuracy—the ability to discriminate reliably between meaningful amounts of research output. As a single measure it cannot capture the complete information on the citation distribution over a scientist's publication list. An extensive data set with bibliometric data on scientists working in the field of molecular biology is taken as an example to introduce two approaches providing additional information to the h index: (1) h² lower, h² center, and h² upper are proposed, which allow quantification of three areas within a scientist's citation distribution: the low impact area (h² lower), the area captured by the h index (h² center), and the area of publications with the highest visibility (h² upper). (2) Given the existence of different areas in the citation distribution, the segmented regression model (sRM) is proposed as a method to statistically estimate the number of papers in a scientist's publication list with the highest visibility. However, such sRM values should be compared across individuals with great care.     

Making Sense of Academic Development

One aim of student evaluation of instruction is the improvement of teaching quality, but there is little evidence that student assessment of instruction alone improves teaching. This study tried to improve the effects of evaluation by combining evaluation with individual counselling in an institutional development approach. Evaluation was conducted in a private school for speech therapy (logopedia) in 35 classes (N = 16 teachers, N = 592 students). Evaluation was done twice within a period of three to twelve months using a standardized questionnaire (HILVE‐II) developed for evaluation of university courses. The intervention effect on teaching quality was more than half a standard deviation on the teacher scales. Despite the fact that the counsellor had no pedagogical training, the quality of teaching not only improved quantitatively and qualitatively but also became more homogeneous although the relative rank listing of teachers did not change.

Ein Ziel der studentischen Lehrevaluation ist die Verbesserung von Lehrqualität. Es gibt aber wenig empirische Evidenz dafür, dass studentische Lehrevaluation allein Lehre verbessern kann. Diese Studie versuchte, die Effekte von Veranstaltungskritik in einem Ansatz, der Lehrevaluation mit Beratung verbindet, zu erhöhen. Lehrveranstaltungsevaluation wurde in einem privaten Ausbildungsinstitut für Logopädie in 35 Kursen von 16 Dozenten mit 592 Studierenden durchgeführt. Veranstaltungskritik wurde zweimal praktiziert binnen eines Zeitabschnitts von drei bis zwölf Monaten anhand eines Fragebogens (HILVE‐II), der für die Evaluation von Hochschulveranstaltungen entwickelt wurde. Der Verbesserungseffekt auf Lehrqualität war in den dozentenbezogenen Skalen größer als eine halbe Standardabweichung. Obwohl der Berater keine pädagogische Ausbildung hatte, verbesserte sich die Lehrqualität nicht nur in den quantitativen und qualitativen Maßen, sondern wurde auch homogener. Die relative Rangreihung innerhalb der Dozenten blieb aber stabil.

Un des objectifs de l’évaluation, par les étudiants, de l’enseignement est l’amélioration de la qualité de ce dernier. Pourtant, les preuves que l’évaluation de l’enseignement par les étudiants améliore celui‐ci sont limitées. Cette étude a tenté d’améliorer les effets de l’évaluation en combinant l’évaluation avec du conseil individuel au sein d’une approche de développement institutionnel. L’évaluation a été effectuée dans 35 classes (N = 16 enseignants, N = 592 étudiants) d’une école privée d’orthophonie (logopédie). L’évaluation a été effectuée deux fois sur une période variant de trois à seize mois en employant un questionnaire standard (HILVE‐II) développé pour l’évaluation des cours universitaires. L’effet relatif à la qualité de l’enseignement associé à l’intervention représentait plus d’un demi écart‐type sur l’échelle des enseignants. En dépit du fait que le conseiller n’avait pas de formation pédagogique, la qualité de l’enseignement s’est améliorée à la fois au plan quantitatif et au plan qualitatif, en plus de devenir davantage homogène, bien que le positionnement relatif des enseignants n’ait pas changé.     

An investigation of student teachers' study strategies with respect to certain variables

This study aimed to determine the study strategies of student teachers attending vocational education faculties and whether these habits are affected by certain variables (department, year of study, positive perception of university and lecturer, time spent studying). The study sample consisted of a total of 746 student teachers from 5 departments, 380 of whom were freshman students and 366 of whom were senior students. The results revealed that student teachers' study strategies were at a moderate level. Additionally, it was observed that study strategies scores were higher for freshman students than for senior students, for students with a positive perception of university than for those with a negative perception, and for students who studied more than 5 hr weekly than for those who studied 3 hr or less.     

DEVELOPMENT, EVALUATION, AND VALIDATION OF A PAPER-AND-PENCIL TEST FOR MEASURING TWO COMPONENTS OF BIOLOGY TEACHERS’ PEDAGOGICAL CONTENT KNOWLEDGE CONCERNING THE “CARDIOVASCULAR SYSTEM”

One main focus of teacher education research concentrates on teachers’ pedagogical content knowledge (PCK). It has been shown that teachers’ PCK correlates with teaching effectiveness as well as with students’ achievement gains. Teachers’ PCK should be analyzed as one of the main important components to evaluate professional development programs. On this account, it is necessary to develop standardized measures of biology teachers’ topic-specific PCK that are labor-efficient. This paper presents a study on the development, evaluation, and validation of a paper-and-pencil test to measure biology teachers’ declarative PCK on the topic of blood and the human cardiovascular system. The development of the test was based, among other considerations, on a review of research literature on PCK and an analysis of 50 videotaped biology lessons. The final test instrument was comprised of 15 items distributed across 2 scales. The findings of the main study—with 93 preservice and in-service biology teachers and 12 biologists—confirmed that this measure of biology teachers’ declarative PCK was reliable, objective, and valid. In-service biology teachers scored higher on the test than preservice teachers (effect size Cohen’s d, 0.65) on one hand and, also, than biologists (Cohen’s d, 1.00) on the other hand. Future versions of this test should explore enlarging the scales and measuring procedural aspects of PCK.     

Acadia Advantage—Evolution and Experiences

In 1996, Acadia University became the first Canadian university to adopt a plan of a fully computerized campus. This plan called for progressively equipping each student and faculty member with a personal laptop computer, introducing computer technology into most courses, providing students and faculty with ubiquitous access to the computer network everywhere on the campus, and integrating the technology into the undergraduate curriculum and campus life. In this paper, we describe the context in which this decision was made, discuss the nature of the experience and the involvement of faculty and students in the process, the logistic problems, and impact on faculty and students, successes and disappointments. We also present selected research projects undertaken by faculty within this framework, and outline plans for the future.     

The Effect of Computer-Assisted Learning Integrated with Metacognitive Prompts on Students’ Affective Skills

The purpose of this study is to investigate the effect of computer-assisted learning integrated with metacognitive prompts on elementary students’ affective skills on the subject of electricity. The researchers developed educational software to enable students to easily and comprehensively learn the concepts in the subject of electricity. A case study method was used. Eighteen students from the seventh grade (12–13 years) participated in the study. Students’ views on their performances while using educational software and the impact of the software on their affective skills towards the subject of electricity were examined. Data were collected by open-ended questions in the educational software. According to the research results, there were students who had negative attitudes and perceptions before starting to learn about the subject of electricity. Interactive activities, animations, and visual experiments in the educational software were effective in overcoming the students’ negative attitudes and perceptions about the subject. Besides, students who assessed their own performances during the learning process believed themselves to be more successful over time. In the light of the research results, some suggestions are made for future studies.     

Looking Far And Looking Near: Student Insights On History,Language, And Power

ABSTRACT

Three community college students participated in a collaborative student/professor research project to experiment with new ideas in teaching. Under the direction of the instructor, the students studied the South African riots in Soweto, 1976, and how issues of language and power were connected to this event. This investigative process began with video information to introduce students to the key issues, and was then followed by student research and discussion. The students, who were particularly motivated to understand the conflict by relating it to their own linguistic circumstances, worked individually and together to find articles and video sources to support their personal interests and ideas. By reflecting on their experiences and perceptions about language and communication, students were able to become engaged in an unfamiliar historical topic, discover relevant academic information, evaluate sources, and formulate insightful responses.