Web-Based Student Assessment for Program Evaluation

As part of an overall evaluation of the Global Learning and Observations to Benefit the Environment, (GLOBE) program, we designed a Web-based assessment environment to measure students' environmental awareness and data analysis skill. It was expected that students who were identified as high implementers in the GLOBE program would outperform low implementers in their ability to construct environmental inferences and the degree to which they could analyze environmental data. Seven high and middle school classrooms were identified as either high or low GLOBE implementers depending on the amount of atmospheric data they had collected during the year. Within each classroom students were assigned into smaller learning groups of three students per group. A total of 32 groups participated in this study. Analysis of students' responses to the tasks revealed that the students differed in their performance. Overall, the results showed that students in the high implementing classrooms were more likely to construct higher-level environmental inferences than students in the low implementing classes. Contrary to expectations, middle school students were more likely than high school students to solve the data analysis problem correctly. However, upon further analyses, high school students constructed more data graphs and were more skilled in providing correct evidence to support their decision making than were middle school students in GLOBE. This study confirms the viability of using technology-based assessments for measuring students' environmental awareness and data analysis.     

GLOBE: A Worldwide Environmental Science and Education Partnership

The Global Learning and Observations to Benefit the Environment (GLOBE) Program is a unique hands-on international environmental science and education program designed for use in schools in Kindergarten through Grade 12. Continually growing, GLOBE to date involves students in almost 5000 schools in over 60 countries around the world. GLOBE students take environmental measurements selected by the world science community so as to provide data useful for research into the dynamics of the Earth's environment. GLOBE data is reported using the Internet/World Wide Web. Data from GLOBE schools all over the world are used to produce vivid displays and contour maps as immediate feedback helping students to appreciate the impact and context of their efforts. Other features of the GLOBE Web site allow GLOBE students to communicate and collaborate with scientists and with other GLOBE students around the world.     

GLOBE in the Czech Republic: a program evaluation

The article presents results of the evaluation of the GLOBE program (Global Learning and Observations to Benefit the Environment) in the Czech Republic. The evaluation explores the implementation of the program in schools and its impact on research skills. Four hundred and sixty six pupils, aged 13, from 28 different schools participated in the evaluation. The evaluation revealed problems with the implementation of the program in schools. The majority of pupils usually collect data and work with worksheets in the program. The other activities, such as the analysis and comparison of collected data or planning GLOBE activities, are done only occasionally or never. Although one of the main goals of the program is to develop pupils' research skills, the program had no measurable effect on this outcome. According to these results, changes in the way the program is implemented are needed. Recommendations for further program development and evaluation are discussed.     

GLOBE—The Science Behind Launching an International Environmental Education Program

Global Learning and Observations to Benefit the Environment (GLOBE) is an international science and environmental education program that enables school children to learn about the environment by taking scientific measurements of their natural surroundings and sharing their data with scientists via the Internet. By carefully following protocols and using approved measurement devices, students around the world are developing an archive of standardized data that can also be used in professional research. GLOBE is divided into several separate investigations, each focused on a different aspect of the environment. They include land cover, soil, hydrology, phenology, haze, and the atmosphere. Each investigation has a team of scientists who have worked with students and teachers to develop detailed protocols for the students to collect data. In addition, the scientists are exploring ways of using that data in their own research. This article is mostly about the work of GLOBE scientists—but also some students and teachers—in the first 5 years of the program. It is intended to provide an overview of the scientists' efforts to develop a meaningful learning experience around gathering environmental data for research.     

THE EFFECT OF SENIOR AUDITORS ON COLLEGE CLASSES: AN ASSESSMENT BY FACULTY MEMBERS

College and university programs that permit older persons to audit regularly scheduled classes free of charge through tuition waiver programs are open to those aged 60 and over or 65 and over in at least 44 states. A study of such a program at a medium‐sized state university included a survey of 135 faculty members teaching classes audited by elder students. Seventy‐four percent of faculty members surveyed returned a one‐page survey questionnaire that asked them to describe the behavior of older auditors and compare them to younger students. Findings indicate that senior auditors are conscientious, most attending classes regularly and some completing written assignments and taking tests. Faculty members indicated that older auditors make a positive difference in class, learn as quickly as younger students, and are more motivated than younger students. Ninety percent of faculty respondents felt that the free audit program offers older students something of value. No significant differences in responses were found when controlling for the teaching experience of faculty members, for their age, or for the number of older students who had audited their classes.     

Implementation variation and fidelity in an inquiry science program: Analysis of GLOBE data reporting patterns

This article examines variations in patterns in the enactment of a large‐scale kindergarten through Grade 12 science inquiry program. Student data reports in the GLOBE program provide a useful measure of implementation because key design elements in the program are student collection and reporting of local environmental data. We examined associations among teachers' responses to survey items to patterns in GLOBE data reporting to develop hypotheses about important contextual factors related to program implementation. Implications for the study of science inquiry programs are discussed. © 2004 Wiley Periodicals, Inc. J Res Sci Teach 41: 294–315, 2004     

Tools for Successful Student–Teacher–Scientist Partnerships

Student–teacher–scientist partnership (STSP) programs are cooperative relationships in which students, with the support of their teachers, participate in and contribute to the research of scientists. This paper examines one of the world's largest STSPs—an international environmental science education program called GLOBE (Global Learning and Observations to Benefit the Environment)—and proposes recommendations to scientists about how they can get the most out of their research and teaching relationship with students and their teachers. GLOBE is an international K–12 STSP that engages students in Earth's Systems investigations. Extensive training is needed for students to collect and report accurate data to scientists, and special preparatory curricula are needed to make their partnership effective and motivating. Recognizing these issues, this research was conducted specifically to identify and recommend a set of training material design criteria for implementation of STSPs in the elementary and middle school levels. The conclusions—the result of background research, extensive interviews and consultation with teachers—provide guidance to GLOBE and other STSP programs to enhance the development of effective and engaging training materials.     

The GLOBE Visualization Project: Using WWW in the Classroom

Though commercial interest in the World Wide Web is growing, the potential uses of the medium as a learning tool are numerous. The GLOBE Visualization Project is one such educational application. We have designed and implemented a WWW-based, user-friendly, language-independent, graphical user interface providing access to visualizations created for GLOBE, a multinational program of education and science. The target users of the system are K–12 students and their teachers from over 1100 schools in 39 countries; other clients include the GLOBE scientific investigators and members of the public internationally. Navigation is intuitive, and employs the metaphors of a Control Panel which changes the image appearing in a Viewscreen. The interface can be learned empirically by persons of all ages regardless of technical expertise or native language; context-sensitive help is provided for users who prefer documentation. The GLOBE Visualization server is on the World Wide Web at URL http://globe.gsfc.nasa.gov/globe/.     

Learning of musculoskeletal ligament stress testing in a gross anatomy laboratory

Human anatomy in physical therapy programs is a basic science course serving as a foundation for subsequent clinical courses. Integration of anatomy with a clinical emphasis throughout a curriculum provides opportunities for reinforcement of previously learned material. Considering the human cadaver laboratory as a fixed cost to our program, we sought opportunities to add value to the resource via vertical integration into a clinical skills course taught later in the curriculum. We designed an opportunity for second-year physical therapy students to revisit the human anatomy laboratory to study select clinical musculoskeletal tests and the associated anatomy in a clinically relevant context. Students performed select orthopedic ligament test on human cadavers, then incised specific structures and repeated the tests. Students were able to feel and visualize the function of pertinent anatomy associated with the clinical tests. Ninety-five percent of respondents reported that the ligament stress testing experience enhanced their understanding of orthopedic clinical tests with 91% reporting an enhanced understanding of anatomy related to specific clinical tests. Likewise, the experience was perceived as enjoyable and valuable with 86% of respondents reporting the experience as enjoyable and 100% responding the experience should continue as part of the curriculum.     

The process of (non) ageing in the perception of Polish centenarians

Currently, there are over 120,000 people aged 100 years or more in Europe. In Poland, there are 4,000 centenarians. And although demographic forecasts say that the number of people above 100 years of age will be on the rise in the decades to come, each centenarian is a unique case that should be the focus of interest for medical and social researchers. In this article, we are going to present the results of qualitative research carried out among people aged 100 or older and show their perception of their own old age in the context of their individual life stories. The results prove that despite individual differences, experience, and functional limitations, the respondents are very open to other people and take the passage of time and their developing age with a pinch of salt. The most important aspects of life for the respondents are positive social relations in their closest environment, deep and authentic faith, and an optimistic attitude. All of the centenarians tried to be physically active, and those who were bedridden remained intellectually active (reading, prayers, conversations). They were at peace with the ailments and difficulties associated with old age and treated them as something natural.     

Evaluation of Short-Term Impact of a High School Summer Science Program on Students' Perceived Knowledge and Skills

Summer science programs held in university research facilities provide ideal opportunities for pre-college students to master new skills and renew, refresh, and enrich their interest in science. These types of programs have a positive impact on a student's understanding of the nature of science and scientific inquiry and can open a youngster's eyes to the many possible career opportunities in science. This paper describes a study of high school students enrolled in the Summer Science Academy program at the University of Rochester that investigates the program's impact on students' knowledge of laboratory skills, as well as the impact on student interest in pursuing a career in science. Students' exposure to advanced laboratory techniques and their interaction with professional scientists provided them with a very positive hands-on experience. Students who attended the program felt more confident in their ability to use sophisticated laboratory skills and that the Summer Science Academy program provided a positive influence on their performance in advanced science courses, as well as their desire to pursue a career in science.     

Predicting academics' willingness to participate in peer review of teaching: a quantitative investigation

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed 221 (106 female, 115 male) academics in the first year of implementation of a peer review of a teaching program at a large dual-sector university. Results supported the impact of four key variables on willingness to engage in peer review of teaching: the perceived benefits of the program, an individual's perceived need for support around teaching, perceived drawbacks of the program and career-related benefits. Level of teaching experience was related to willingness to engage: staff with moderate levels of teaching experience were most willing to participate in the program. Limitations of the study are noted and recommendations for peer-review programs are provided.     

虚实融合学习环境:概念、特征与应用

随着现代信息技术的发展和教育教学理念的转变,基于网络和多媒体的"虚拟"学习环境已经被人们熟悉并部分取代基于课堂的"现实"学习环境。虚拟和现实的学习环境各有利弊,前者有利于学习者使用丰富的数字化资源开展跨地域的协作学习、拓宽知识视野,后者有利于学习者的临场体验和实际操作能力培养。在分析相关文献和现有学习环境特征研究的基础上,分析了"虚实融合学习环境"的内涵与特征,对虚拟、现实以及虚实融合的学习环境进行比较,并就若干典型的虚实融合学习环境及其教学应用情况进行了分析,其中包括:校园环境信息观测与研究性学习、GLOBE全球性学习与观察、虚实融合的机器人教育、数字化探究实验室。     

The impact of multimedia cases on preservice teachers' learning about literacy teaching: A follow‐up study

Abstract

Using surveys and interviews as a data set, this study explored the influence of multimedia cases in preservice literacy methods courses by following a set of preservice teachers into their first years of teaching. Analysis of the survey and interview data yielded three salient themes. First, respondents reported that their methods courses had positively influenced their teaching. Second, respondents reported several factors (e.g., active involvement during class time, the enthusiasm of the instructor) as influential in their recall of course content. Third, respondents reported that the use of the multimedia cases influenced their learning, both during their teacher education program and in their current teaching. This follow‐up study offers insight into the connections teachers make between their teacher education programs and their later teaching and serves as an impetus for future research into the potential benefits of using multimedia cases as a way to situate preservice teacher learning in real problems.     

Who benefits? What benefits? Part-time postgraduate study in health and human services

Part-time postgraduate students make up a significant proportion of the student population, yet their experience remains poorly understood. In this article, a multi-phase, explanatory mixed-method study conducted within Tasmanian health and human services provides some answers. Students reported improved job performance, self-esteem and increased motivation to learn as primary outcomes. Other benefits of significance included an increased ability to manage change and increased job satisfaction. At the other end of the scale, fewer than half of all respondents agreed that part-time postgraduate study led to increased pay or remuneration, and only one-quarter of respondents believed their study led to improvements in personal relationships. There were significant associations between organisational placement and perceptions of benefit. The managers of those who were studying were less likely to perceive either increased job satisfaction or improved job performance in their subordinates. Amongst postgraduate, mature-age, part-time student respondents, their prior experience in higher education, professional background, seniority in the organisation, age and gender were also associated with differing perceptions of the benefits of higher education. These results add to the body of knowledge around the human, social and identity capital benefits associated with lifelong learning, and this study provides guidance for students, employers and universities.     

A GLOBE Collaboration to Develop Land Cover Data Collection and Analysis Protocols

Global Learning and Observations to Benefit the Environment (GLOBE) is an international environmental education and science partnership which coordinates the work of students (aged 5 to 18), teachers and scientists from 48 countries on five continents to study and better understand the global environment. Accurate ground reference data is fundamental to the use of remotely sensed data for land cover classification and mapping. Because very little ground reference data has been collected, the accuracy of many land cover maps may be questioned, thus accurate land cover ground reference data is an important need that could be addressed through GLOBE scientist-student collaboration. If earth systems scientists are to use student data, it is important that those data be as accurate as possible to ensure reliability of research results. Thus a key question for this research is whether student collected data are accurate enough to support rigorous scientific investigations. This paper describes results of the GLOBE Science-Education Team on Data Validation and Accuracy Assessment's collaboration with teachers and students to: (1) design and test the pre-protocol learning activities; (2) test the protocols intended to guide the collection and analysis of data; and (3) implement the learning activities and protocols to determine the relative accuracy of student collected versus professionally collected land cover data. To ensure the most accurate classification of land cover possible, a new international hierarchical land cover classification system, the Modified Unesco Classification (MUC) system was developed. GLOBE Data Collection Protocols and methods were designed and implemented to test the accuracy of student collected reference data were designed and implemented. Students who collected land cover reference data using GLOBE protocols, obtained data which are at least as accurate as that collected by professionals.     

The AAS to BAS Pathway: Heating Up the Educational Aspiration of CTE Students

The enrollment and transfer behaviors of college students are diverse. As a result, college students travel various pathways to the baccalaureate degree. The purpose of this qualitative study was to better understand the lived experience of students who entered higher education through an associate of applied science (AAS) program and then continued in higher education to earn a bachelor of applied science (BAS) degree. To explore this phenomenon, eight participants completed two in-depth interviews regarding their lived experience as students on this educational pathway. Five structures emerged from the data to frame the participants' experiences on the AAS to BAS pathway: disengagement, doubt, knowledge of something different, significant relationships, and transformation. These five structures interacted in discrete ways to characterize the participants' experiences as pushing through disillusionment related to education, the profession, and self. The participants' moving through three dimensions of disillusionment along the pathway formed the meaning and the essence of the phenomenon, dogged determinism. The findings elaborate on the themes that contributed to heating up, or raising the educational aspirations of these career-technical students.     

Elementary Pre-Service Teachers' Response-Shift Bias: Self-efficacy and attitudes toward science

Response-shift bias occurs when participants' initial constructs, such as self-efficacy in teaching science, are incomplete because they do not fully conceptualize something they have yet to experience. This study examines whether elementary pre-service teachers can consistently evaluate constructs such as self-efficacy and attitudes toward science throughout an elementary methods course. After the administration of traditional pre-tests, retrospective pre-tests, and post-tests, this study examined whether a response-shift bias consistently occurred in scales indicating science teaching self-efficacy (as measured by the Science Teaching Efficacy Beliefs Instrument-B), attitudes toward science (modified Attitudes Toward Science Inventory), and relevancy of science (Changes in Attitudes about the Relevancy of Science). Results indicate that a significant response-shift bias occurred in the scales relating to self-efficacy, confidence, and attitudes toward science; while no response-shift bias occurred in scales relating to outcome expectancy, value, and relevancy of science. Our data provide evidence that response-shifts naturally discriminate among different constructs and that participants successfully and consistently reported certain constructs over time which may be of interest for program evaluators and self-efficacy researchers. This research could have implications for program evaluators and researchers who need to measure program impacts on pre-service teachers with limited science-teaching experiences.     

Instruments for school self-evaluation: lost in translation? A study on respondents’ cognitive processing

School self-evaluation (SSE), as an important leverage for quality assurance, often relies on surveys among staff members to collect information on the schools’ functioning. The extent to which respondents cognitively process items as developers intended them determines the cognitive validity of SSE results. However, it is unclear what problems occur in respondents’ cognitive processes which lead to cognitively invalid SSE results and how respondents’ positions in the school affects these cognitive processes. This study draws on cognitive interviews conducted with 20 teachers and principals to understand their thinking process while answering an SSE survey. Cognitively invalid results were analysed using a content analysis to identify problems in respondents’ cognitive processes. Findings showed that respondents experience semantic and syntactical issues when interpreting items. While elaborating, problems were found regarding items’ topic and focus, particularly concerning whom to make a statement about. Issues also emerged in the response stage, especially that the ‘don’t know’ option was not used as intended. Respondents’ positions influence their understanding about whom a statement is required and how self-evident some items are to them. These problems should be taken into account by developers of SSE surveys and other instruments that intend to measure organisational characteristics.     

Family fortunes: female students’ perceptions and expectations of higher education and an examination of how they,and their parents,see the benefits of university

This paper details a case study undertaken in 2011 which examined a small group of female students’, and their parents’, perceptions of the purpose of a university education. The research is underpinned by a review of the literature examining the views held by academics and politicians as to the benefits of higher education and of research in the field of student choices, as related to habitus and their familial experience of higher education. Data collection involved the use of mixed methods to investigate perceptions and expectations about higher education on arrival at university and whether for a small sample of postgraduate respondents, these perceptions had changed over time. The findings showed that initially there is a belief that higher education is primarily a route to economic gain but, three years after graduation, the respondents consider their time spent at the university – primarily – as a period of personal growth and fulfilment.