Investigating science learning for rural elementary school teachers in a professional‐development project through three distance‐education strategies

Distance education is a significant topic of discussion within institutions at all levels of education. It is not only significant in terms of finances and student enrollment but also in terms of meaningful learning. The purpose of this study was to determine the relative effectiveness of three distance‐education strategies for enhancing the science learning of 94 Midwestern elementary‐school teachers participating in a 5‐year professional‐development project. The three distance‐education strategies studied were interactive television with all presenters live in real time (live), interactive television with live discussions wrapped around videotaped presentations (video), and asynchronous, Web‐based sessions with streamed videotaped presentations supported by interaction through discussion boards (Web). A repeated measures design was used to analyze the science learning and attitudes of the study participants. Analysis of variance of participants' postsession science scores yielded differences (p < 0.05) on multiple‐choice and constructed‐response science subscales. Participants in the live mode outperformed participants in the Web and video modes on all three assessment types (multiple choice, constructed response, and vignettes). Participants in the Web mode outperformed participants in the video mode on multiple choice and constructed response. © 2006 Wiley Periodicals, Inc. J Res Sci Teach 43: 1019–1039, 2006     

Evaluating Change and Stability in Learning Style Scores: a methodological concern

Learning styles are purported to be relatively stable characteristics with some change or development expected. Some studies using Kolb's Learning Style Inventory (LSI) have reported significant positive test‐retest correlations of LSI scores or nonsignificant repeated‐measures ANOVAs and concluded that learning styles are stable. This study examined stability and change on Kolb's revised Learning Style Inventory (LSI‐1985) using 152 participants at two points in time separated by about 10 weeks. A variety of statistics were used to evaluate stability and change in LSI‐1985 scores for the four subscales and two dimensions and the four learning styles. The use of test‐retest correlations, differences between means and other methods emphasising group effects were criticised. It was recommended that researchers also analyse and report the stability and change of style categories directly, not just score changes. These comments are also applicable to other learning style measures such as the Learning Style Questionnaire.     

成人教育面临的机遇与挑战——“2005年成人教育创新与学习型社会建设国际论坛”综述

四月的上海春意盎然，在风景如画的华东师范大学丽娃河畔不仅洋溢着一片醉人的春色，而且到处可以感受到浓浓的学术气息。     

Estimated student score gain on the act COMP exam: Valid tool for institutional assessment?

The higher education community needs measures of the value added to student development by the college experience. ACT provides a quick, easy method for estimating the extent of student growth in general education. An institution can test seniors with the ACT College Outcome Measures Project (COMP) exam, then subtract from the senior score anestimated freshman score obtained from a concordance table that is based on the known relationship between freshman ACT Assessment composite score and freshman COMP Total score. Studies using scores for 4,200 seniors and 2,100 freshmen tested during a two-year period at the University of Tennessee, Knoxville, indicate that this method is not sufficiently reliable or valid to serve as the basis for making precise judgments about the quality of general education programs.     

Voice in Digital Education: The Impact of Instructor's Perceived Age and Gender on Student Learning and Evaluation

Instructor evaluations are influenced by implicit age and gender bias, with lower ratings and negative feedback given to instructors believed to stray from stereotypical age and gender norms. Female instructors exhibiting typically male-associated qualities such as leadership and authority, are often negatively impacted. Implicit bias also influences evaluation of digital resources and instructors, regardless of students' positive learning outcomes. As digital learning resources become the norm in education, it is crucial to explore the impact of implicit bias at various educational levels. In this study, undergraduate and graduate students were randomly exposed to one of five digital tutorials; four experimental tutorials presenting identical anatomy content with narrators of different gender and age, and a control tutorial featuring origami (paper folding) instructions without audio. Learning outcomes were measured by pre-quiz vs. post-quiz comparisons using repeated measures MANOVA. Implicit bias was analyzed by evaluation response comparisons using repeated measures MANOVA and three-way MANOVA. Post-quiz scores increased significantly in the four experimental groups (P < 0.05) but not in the control (P = 0.99). The increased performance was not statistically different across the four experimental groups (P > 0.26), suggesting that learning occurred irrespective of the instructor gender and age. Students' evaluations were consistently higher for the experimental resources than the control. There was no significant difference in evaluations across the four experimental groups but compared to the control, younger male and younger female narrators received significantly higher ratings for approachability, acceptance, inclusivity, and care for student learning. The study highlights important considerations for digital resources development and interpretation of student evaluations.     

Mentors’ personal growth and development in a college access mentorship program

As the prevalence of mentoring programs in higher education institutions continues to grow, there remains little research on the growth and development that comes from serving as a mentor. In this phenomenological study, the researchers examined college students’ personal and educational gains through serving as mentors to high school students in a work-study mentoring program for increasing college access. Drawing on interviews with 14 mentors and other program staff, the researchers examined the following research question: In what ways did student mentors in the G-Force Mentoring Program grow and develop as a result of their mentor experience? Findings included mentor growth in three key categories: (a) self-development and awareness, (b) skill development, and (c) career development. Implications for practice and future research are offered.     

Relationship between measures of academic quality and undergraduate student attrition: the case of higher education institutions in the Colombian Caribbean region

Undergraduate student attrition is a major concern in higher education. It is usually explained by the impact of student attributes; however, recent developments in student success literature point to the need of exploring institutional practices that may impact a student's decision to abandon their studies. The current weight of academic quality assurance for Colombian higher education institutions (HEI) and what such measures may mean for how HEI fulfill their missions indicates the need to consider a possible relation between such quality measures and undergraduate student attrition. Using official databases from the Colombian Ministry of Education for the year 2009, this study explores through analysis of variance the relationship between attrition and three measures of academic quality: accreditation status, professional test scores required to graduate (Saber Pro Exam) and the number of research groups at HEI. The scope of the study is the Colombian Caribbean region and the sample includes 19 HEI. Study results demonstrate that the percentage of accredited undergraduate programs at HEI was the only measure of quality assurance, out of the three explored, that showed a statistically significant relationship with undergraduate student attrition rates.     

如何把家长座谈会变成学校与家庭之间良性心理循环的加油站

家长座谈会是学校与家庭沟通的一个有效的途径。实践证明,如果会开得好,它的确能够起到老师与家长达到共识、形成合力共同教育学生的作用,但是如果单纯地发布考试成绩和向家长揭学生的短,忽略对学生成长的展示,不但不会促进学生的发展,反而会造成家庭对学校教育抵触的恶性心理循环状态。     

The relationship between quality of the present level of academic achievement and functional performance statement and student learning

The present level of academic achievement and functional performance (PLAAFP) is an essential component of the individualised educational program (IEP) process because it identifies student strengths and areas for growth. However, there is minimal research that examines components of an IEP and student outcomes. The current study examined the relationship between PLAAFP quality and student achievement, and between training and ongoing professional development and quality of the PLAAFP. The data were obtained from 211 special education teachers in one state. Results suggested that ongoing professional development predicted the quality of the PLAAFP statement, accounted for a large amount of the variance (r² = 0.14) in the PLAAFP quality score, and was a stronger predictor than participating in a single training. Additionally, PLAAFP quality predicted winter achievement scores beyond the school district, fall achievement scores and teacher variables, and accounted for significant and moderate amount of unique variance for reading (r² = 0.05) and math (r² = 0.07). Implications for research and practice are included.     

THE STUDENT ASSESSMENT PROJECT

Under a grant from Education Research and Development Committee, researchers at Macquarie University, Sydney, Australia, developed a set of instructional materials aimed at the inservice education of teachers on the topic of student assessment. The Student Assessment Project (SAP) now comprises seven modules in slide‐tape format covering the topics of test design, item writing, analysis of norm‐referenced and criterion‐referenced tests, combining scores from different components, moderation of test results, and grading and reporting. The kit also contains appropriate computer software (for an Apple II microcomputer), manuals and supplementary materials. This article gives some details of the project and its development and describes the widespread use of the first 20 kits from which evaluation data are being sought. Although SAP originally focussed on inservice education of secondary teachers, the present applicability to higher education and the further potential for modification and use at this level is discussed.     

Student Learning in Higher Education: a Commentary

This commentary begins by summarizing the five contributions to this special issue and briefly recapping the background to the topic of student learning in higher education. Narrative and systematic reviews are compared, and the relative value of different bibliographic databases in the context of systematic reviews is assessed. The importance of measures of effect size is stressed. The relationship of the five contributions to early research on levels of processing and approaches to learning is discussed, along with the presage–process–product model of student learning and historical discussions that are relevant to the current theoretical discussions. This field has benefited from the development of more robust instrumentation, but researchers must continue to develop new kinds of measure, including online measures of students’ strategy use. Researchers need to consider ways of enhancing the quality of student learning through the use of problem-based curricula and other student-centered approaches. Finally, it is suggested that researchers into student learning need to evaluate whether their concepts, methods, theories, and findings are valid in online environments and to investigate how curricula in higher education can build upon those in secondary education.     

Improving the quality of student ratings of instruction: A look at two strategies

The effects of rating scale format (behaviorally anchored vs. Likert) and rater training on leniency and halo in student ratings of instruction were investigated. The subjects (N=269) were students enrolled in required courses at a graduate theological seminary in the Southwest United States. A repeated measures design controlling for teacher and course was used. Findings indicated: (a) training was effective in reducing leniency and halo in ratings from both instruments; (b) trained raters exhibited less leniency on two rating dimensions when using behaviorally anchored rating scales (BARS's) than when using the Likert scale; and (c) trained raters exhibited less halo when using the Likert than when using the BARS. The findings demonstrate the importance of focusing efforts to improve quality of ratings on the students rather than on the format of the instrument.Presented at the Twenty-Eighth Annual Forum of the Association for Institutional Research, Phoenix, Ariz., May 1988.     

What Third-Grade Students of Differing Ability Levels Learn about Nature of Science after a Year of Instruction

This study explored third-grade elementary students' conceptions of nature of science (NOS) over the course of an entire school year as they participated in explicit-reflective science instruction. The Views of NOS-D (VNOS-D) was administered pre instruction, during mid-school year, and at the end of the school year to track growth in understanding over time. The Young Children's Views of Science was used to describe how students conversed about NOS among themselves. All science lessons were videotaped, student work collected, and a researcher log was maintained. Data were analyzed by a team of researchers who sorted the students into low-, medium-, and high-achieving levels of NOS understandings based on VNOS-D scores and classwork. Three representative students were selected as case studies to provide an in-depth picture of how instruction worked differentially and how understandings changed for the three levels of students. Three different learning trajectories were developed from the data describing the differences among understandings for the low-, medium-, and high-achieving students. The low-achieving student could discuss NOS ideas, the medium-achieving student discussed and wrote about NOS ideas, the high-achieving student discussed, wrote, and raised questions about NOS ideas.     

BOOK REVIEW. Development Planning and School Improvement for Middle Managers Co-authors: Marilyn Leask and Ian Terrell,London, UK: Kogan,Page 1997.x + 246 pp. ISBN 0 7494 2038 3

The longitudinal impacts on school change and student achievement of implementing varied Comprehensive School Reform (CSR) models was investigated in 12 elementary schools in diverse geographic locations. Each school was individually matched and compared to a demographically similar control school on measures of school climate, teacher satisfaction, observed classroom teaching methods, and student achievement on a battery of 4 individually administered reading tests. Data were analyzed for all CSR-control school pairs combined and separately for pairs representing 4 different CSR models (Balanced Early Literacy Initiative, Core Knowledge, Direct Instruction, and Success for All). Although results varied across location (rural versus urban) and models on different measures, overall CSR advantages were evidenced for teacher attitudes, school climate, and student achievement. Observations of teaching strategies further revealed their general conformity to the CSR models' pedagogical emphases (e.g., direct instruction, ability grouping, higher order questioning). The implications of the findings are discussed relative to processes of enacting and sustaining educational change using whole-school reform approaches.     

Comparing the Accuracy of Student Growth Measures

Testing programs are often interested in using a student growth measure. This article presents analytic derivations of the accuracy of common student growth measures on both the raw scale of the test and the percentile rank scale in terms of the proportional reduction in mean squared error and the squared correlation between the estimator and target. The study contrasts the accuracy of the growth measures against that of current status measures—current test scores and their percentile ranks. Key findings include the extent that status measures are more accurate than any of the growth measures and that alternative methods to estimate growth could be more accurate than the currently used methods. Our findings highlight the importance for evaluating the statistical properties of growth measures along with other concerns for states that are debating the reporting of growth. Our results also point out that assessing the accuracy of growth measures requires the specification of quantities of interest in terms of latent achievement rather than observed test scores, which is common practice for developing status measures but essentially never done by testing programs for growth measures.     

School-Wide Educator Evaluation for Improving School Capacity and Student Achievement in High-Poverty Schools: Year 1 of the School System Improvement Project

The United States is in an era of high-stakes evaluation of educators (i.e., teachers and principals), the results of which are used to inform human capital decision making (i.e., recruitment, hiring, retention, and dismissal), which in turn impacts school capacity and student learning. The present article describes the School System Improvement (SSI) Project, a school-wide educator evaluation initiative that includes 22 high-poverty schools. The primary goal is to present the Year 1 planning for implementation of educator evaluation, highlighting the use of system consultation for planning. The SSI Project team includes researchers in school psychology and special education, school administrators, and teachers. The project aims to implement a multimethod educator evaluation system that generates scores for informing targeted, evidence-based professional development. Project goals are to increase educator competencies that lead to improved student achievement. Finally, directions for training and recommendations for future school reform are presented.     

Addressing the messiness of data analysis: Praxis,readiness and tips from doctoral research

Despite the fluid and nonlinear nature of data analysis, specifically in qualitative research, published work in comparative education has rarely discussed the messy aspects of data analysis. This Forum addresses the complexity of the analysis stage faced by three doctoral researchers in terms of: considering data analysis when selecting data collection tools; messiness of data analysis deriving from fieldwork and data collection; integrating different data sources; practising reflexivity during data analysis; and ethical issues arising from data analysis. The Forum aims not only to offer suggestions and tips to deal with data analysis but also to encourage more open discussions on this topic within the research community.     

Developing Practical Knowledge of the <Emphasis Type="Italic">Next Generation Science Standards</Emphasis> in Elementary Science Teacher Education

Just as the Next Generation Science Standards (NGSSs) call for change in what students learn and how they are taught, teacher education programs must reconsider courses and curriculum in order to prepare teacher candidates to understand and implement new standards. In this study, we examine the development of prospective elementary teachers’ practical knowledge of the NGSS in the context of a science methods course and innovative field experience. We present three themes related to how prospective teachers viewed and utilized the standards: (a) as a useful guide for planning and designing instruction, (b) as a benchmark for student and self-evaluation, and (c) as an achievable vision for teaching and learning. Our findings emphasize the importance of collaborative opportunities for repeated teaching of the same lessons, but question what is achievable in the context of a semester-long experience.     

PRESERVICE MATHEMATICS AND SCIENCE TEACHERS IN AN INTEGRATED TEACHER PREPARATION PROGRAM FOR GRADES 7–12: A 3-YEAR STUDY OF ATTITUDES AND PERCEPTIONS RELATED TO INTEGRATION

The purpose of this article is twofold: (a) to describe a unique teacher licensure program for grades 7–12 that integrates mathematics, science, and technology education and (b) to explore the attitudes and perceptions related to the integration of mathematics, science, and technology education of three cohorts of preservice teachers enrolled in the first 3 years of the program. Eighty-one preservice teachers responded to a semantic differential to measure attitudes and perceptions related to “mathematics, science, and technology education integration.” Principal components and internal consistency reliability analyses were computed to provide validity and reliability evidence. Preservice teachers also responded to one open-ended, free-response written question, “What does the integration of mathematics, science, and technology education mean to you?” Multivariate and univariate analyses of variance with repeated measures and Pearson cross-tabulation chi-square analyses were computed to identify pretest–posttest differences for the value and difficulty scales, identified by the principal components analysis. Analytic inductive methods were used to identify emergent themes in student written responses to the open-ended question. Results indicated no change in preservice teacher attitudes and perceptions related to the value of integration—they clearly valued integration at the onset and completion of the program, often citing student benefits. However, a significant change in preservice teacher attitudes and perceptions related to difficulty was noted. Upon completion of the program, preservice teachers perceived integration to be more difficult and identified barriers and challenges—demonstrating a more realistic, practical, and cautious approach to the integration of mathematics, science, and technology education.