Cross-Language Evaluation Forum: Objectives, Results, Achievements

The Cross-Language Evaluation Forum (CLEF) is now in its fourth year of activity. We summarize the main lessons learned during this period, outline the state-of-the-art of the research reported in the CLEF experiments and discuss the contribution that this initiative has made to research and development in the multilingual information access domain. We also make proposals for future directions in system evaluation aimed at meeting emerging needs.     

Stage, Transfer, and Academic Achievement in Dialect-speaking Hawaiian Adolescents

The study reported here is concerned with certain dialect-speaking groups in the United States who do poorly in high school while giving their teachers an impression that they have great intellectual ability and doing well on formal operational tasks. We examined the relation between stage of cognitive development, transfer ability, production ability in Standard English, and school achievement among a sample of high school students in rural Hawaii, speakers of Hawaiian Creole English. A path analysis suggests that transfer ability is the missing ingredient in school performance, and that a habit of active encoding in the classroom, in turn, facilitates transfer.     

Changes in science teachers' conceptions and connections of STEM concepts and earthquake engineering

ABSTRACT

The authors find justification for integrating science, technology, engineering, and mathematics (STEM) in the complex problems that today's students will face as tomorrow's STEM professionals. Teachers with individual subject-area specialties in the STEM content areas have limited experience in integrating STEM. In this study, the authors investigated the conceptual changes of secondary school teachers teaching domain-specific STEM courses after a week-long professional development experience integrating earthquake engineering and domain-specific concepts. They documented and then triangulated outcomes of the experience using participating teachers' concept maps and teacher-generated written materials, respectively. Statistical comparisons of participants' concept maps revealed significant increases in their overall understanding of earthquake engineering and more accurate linkages with and among science domain-specific concepts. Content analyses of teachers' learning products confirmed the concept map analysis and also provided evidence of transfer of workshop learning experiences into teacher-designed curriculum products accurately linking earthquake engineering and domain-specific STEM content knowledge.     

Developing the wasp: Wareing attitudes toward science protocol

Affective development has long since been cited as one of the main components of scientific literacy. According to Krathwohl, Bloom and Masia, attitudes, emotions, and values that are manifested as preferred choices, appreciations, and interests comprise the affective domain. Such attitudes, emotions, and values are neither immutable nor necessarily transferable from one discipline to the next. In an effort to identify and measure scientific affect and to later assess its impact on achievement, the author set out to develop and validate an attitude instrument in the form of a Likert-type scale. Following test construction, reliability was calculated according to several split-half methods, using a sample of 806 students in grades 4 through 12. The result was a most satisfactory reliability range of 0.91–0.94.     

Assessing the Assessments of Teacher Preparation

Teacher preparation programs have both a desire and a responsibility to demonstrate, with affirmative evidence, that teacher education makes a difference in PreK–12 student learning. Program faculty need good data to make decisions about the progress of students, whom to recommend for state licensure, and how to improve teacher education. This article describes an American Psychological Association task force report that discusses 3 measures of program effectiveness that have potential for both informing the public and providing useful data for programs to continuously improve: (a) outcome data from PreK–12 student academic growth as assessed by standardized tests; (b) teacher performance as evaluated by valid and reliable observational instruments; and (c) judgments of graduates, their PreK–12 students, and those who hire teachers as gauged by surveys. Although no technique of data collection and analysis is perfect, this report provides directions for teacher educators who seek to continuously improve their programs.     

Gender and culture: Reported problems,coping strategies and selected helpers of male and female adolescents in 17 countries

This is the second report of a multinational project undertaken in 1988 by the International Round Table for the Advancement of Counseling that sought, among other things, to compare and contrast the reported problems, coping strategies, and help-seeking behavior of 2129 male and 2307 female adolescents from a total of three different socioeconomic backgrounds in each of 16 countries (Australia, Brazil, Canada, Greece, Hong Kong, India, Israel, Japan Kuwait, the Netherlands, the Philippines, China, Puerto Rico, Turkey, the US, and Venezuela) and from a "classless" background in Russia. The first report described the study and research methodology and cited preliminary findings that 1) problems and coping strategies tended to be universal and age-related; 2) impoverished subjects from Brazil, India, the Philippines, and Venezuela had more problems than any other adolescents; 3) problems were usually related to school, family, and identity rather than to sexuality; and 4) the most common coping strategy was individual problem-solving. This report compares male/female identification of up to three problems that cause worry, response to such problems, and help-seeking behavior. All adolescents cited problems in school, identity, and family. Males and females reported similar coping strategies and showed a strong dependence on individual coping strategies. Both males and females choose personal friends and family members as those most likely to help with problems. Males exhibited a higher percentage of problems related to school and a lower percentage of family problems. Russian adolescents reported more problems relating to altruism than any other group, especially males. These results imply that strong similarities exist for males and females, and the findings are worrisome in that problems related to sexuality were not cited. Counselors should expect the concerns of adolescents to be developmentally related and to overwhelm gender differences.     

Changes and challenges in the transition to adulthood: views and experiences of young people with learning disabilities and their families

The transition to adulthood poses one of the most complex challenges for young people with intellectual disabilities. In order to conduct a wide-reaching and in-depth study of this process, we need to know the views of these young people themselves and their families. This article presents research designed to collect the experiences and perceptions of young people with disabilities and their families regarding perceived problems and support in their transition to adulthood in Spain. A qualitative case study method was used to achieve this. Data were collected in three stages on the following topics: educational pathway (primary and secondary school), social support networks and free time, and construction of a personal plan for the future (labour market inclusion and independent living). Various different instruments were used, including interviews, focus groups and visual methods. As for the results, the young people who participated in the study experienced difficulties with both successfully completing secondary education and continuing their education. The families in our study were not very satisfied with the guidance received from professionals upon finishing secondary school. They also complained about the lack of training options available to young people with disabilities. The participants expressed certain fears regarding social inclusion and labour market integration. They are aware that they will need help, and have doubts about whether they will receive the necessary support to progress with their plans for labour market integration and independent living. As a result of the study, we propose several recommendations to improve opportunities for the social inclusion of young people with disabilities in their transition to adulthood.     

Computer-based compensation of adult reading disabilities

We studied the use of computer readers, and especially their speech synthesis component, as a compensatory tool for adults with dyslexia. We first explored the enhancement of reading skills in a group of college students and working adults. Their unaided reading was very slow, and most participants in the study could sustain reading for only short periods. Although their timed comprehension was poor, their untimed comprehension was above average. The computer reader enhanced the reading rate and comprehension of most participants and enabled them to sustain reading longer. The difference between aided and unaided reading rate was inversely proportional to the unaided rate. Slower readers experienced greater enhancement than faster ones. The enhancement of comprehension was also inversely proportional to unaided scores, and good predictions of the enhancement were obtained from multiple regression models that included scores from specific standard tests of auditory and visual cognitive abilities. We also explored the use of computer readers in the workplace and show through case studies that their use can have important positive effects on individual careers and self-confidence when specific conditions exist. Finally, we investigated the use of computer readers to supplement an adult remediation program. The readers allowed and motivated the students to read more and, as a result, to progress more rapidly. Support for this study was provided by Xerox, the Luke B. Hancock Foundation, and the Charles and Helen Schwab Foundation.