Current Concerns in Validity Theory

We are at the end of the first century of work on models of educational and psychological measurement and into a new millennium. This certainly seems like an appropriate time for looking backward and looking forward in assessment. Furthermore, a new edition of the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 1999) has been published, and the previous editions of the Standards have served as benchmarks in the development of measurement theory.
This backward glance will be just that, a glance. After a brief historical review focusing mainly on construct validity, the current state of validity theory will be summarized, with an emphasis on the role of arguments in validation. Then how an argument-based approach might be applied will be examined in regards to two issues in validity theory: the distinction between performance-based and theory-based interpretations, and the role of consequences in validation.     

Emerging adult women’s career role modeling and wishful identification with female TV news personalities

This study investigated how emerging adult women perceive, role model, and wishfully identify with female television news personalities (TVNPs) in the contemporary climate of social media celebrity where a male-dominated newsroom persists. Participants (n = 138, M = 19.58 years) selected TVNPs and completed survey measures of exposure, personal work values, perceived TVNP work values, and wishful identification. Participants’ perceived extrinsic and intrinsic work values of TVNPs correlated with their own work values, extrinsically and intrinsically. Exposure to TVNPs predicted greater wishful identification. The discussion explores women’s perceptions of TVNPs as they formulate career plans.     

A validation of the Dyslexia Adult Screening Test (DAST) in a post‐secondary population

In Ontario, Canada, there is a demand for psychometrically robust screening tools capable of efficiently identifying students with specific learning disabilities (SLD), such as dyslexia. The present study investigated the ability of the Dyslexia Adult Screening Test (DAST) to discriminate between 117 post‐secondary students with carefully diagnosed SLDs and 121 comparison students. Results indicated that the DAST correctly identified only 74% of the students with SLDs as ‘highly at risk’ for dyslexia. Although employing the cutoff for ‘mildly at risk’ correctly identified 85% of the students with SLDs, this also increased the percentage of students with no major history of learning problems identified as ‘at risk’ for dyslexia from 16% to 26%. These findings suggest that the DAST in its present form is limited in its ability to screen for SLDs. Implications for future research are discussed.     

Observations from the classroom: When analogies go wrongi

Specializations: teachers' pedagogical knowledge, analogical reasoning, conceptual change.     

Factors that prevent learning in electrochemistry

Electrochemistry plays an important role in curricula, textbooks, and in everyday life. The purpose of the present study was to identify and understand secondary‐school students' problems in learning electrochemistry at an introductory chemistry level. The investigation covered four areas: (a) electrolytes, (b) transport of electric charges in electrolyte solutions, (c) the anode and the cathode, and (d) the minus and plus poles. Written tests were given to high‐school students in five cycles. The population from which random samples were drawn totalled 15,700 subjects. Students were asked to select the correct answers and to justify their choices. It was found that students based their reasoning on four alternative concepts: (a) During electrolysis, the electric current produces ions; (b) electrons migrate through the solution from one electrode to the other; (c) the cathode is always the minus pole, the anode the plus pole; and (d) the plus and minus poles carry charges. The results suggest a teaching strategy in which students first experience and learn about electrochemistry concepts. In the second step, appropriate concept terms are added, and students then are confronted with the alternative concepts described in this article. © 2006 Wiley Periodicals, Inc. J Res Sci Teach 44: 258–283, 2007     

My Journey With Annemarie Roeper: Lessons Learned Along the Way

For over 70 years Annemarie Roeper was able to breathe new life into many aspects of giftedness and gifted education. Capturing the magic of such a charismatic and visionary leader is a challenge. However, stories and storytelling provide a pathway into the narrative of Annemarie’s life as it evolved from young adulthood to elderhood. This article provides the lessons learned during a long-standing friendship and insights into her multidimensional personality.     

Development of a distance education assessment instrument

The study described in this article takes the view that distance education programs are dynamic systems with multiple constituencies. Literature on distance education programs as complex systems and on the critical constituency approach to program evaluation was used to guide the development of a questionnaire designed to assess the components of a distance education program. Instrument development was conducted in four phases using both quantitative and qualitative methods. The data from this study suggest that there are four major components of effectiveness in distance education programs: instruction, management, telecommuting, and support. Within each of these components there are from two to five subcomponents, 14 components in all, which can be used to assess distance education programs. The assessment scale which was developed measures these four components and their subcomponents.     

Instructional practices of teachers enrolled in educational technology and general education programs

This study investigated classroom practices of 38 teachers enrolled in university masters' degree programs in educational technology and in other areas of education. The classroom practices related to five key concepts associated with educational technology: (a) learner-centered instruction, (b) instructional design, (c) media and technology, (d) assessment, and (e) instructional alignment. Teachers rated their frequency of use of desirable practices in these five areas on a 30-item Likert type survey. In addition, one class of students per teacher rated its own teacher's frequency of use of the practices on 20 items parallel to items on the teacher survey. The mean overall rating across all teachers for the classroom practice items was very close to Often, or 4.0, on the 5-point scale. There were few reported differences between the teachers enrolled in educational technology programs and those enrolled in other education programs. Student ratings indicated less frequent teacher use of the desirable practices on 16 of the 20 common items, with significantly lower student ratings on 8 of these items. However, there was strong teacher-student agreement on several other comparisons.The study reported in this article was conducted as a doctoral dissertation at Arizona State University.     

Teaching Science Effectively With Analogies: An Approach for Preservice and Inservice Teacher Education

Journal of Science Teacher Education -     

Continuing professional development needs and activities of school psychologists

The study investigated school psychologists' continuing professional development (CPD) needs and their relationship to selected demographic factors, preservice training, incentives, and typical engagement in various CPD activities. A survey questionnaire was mailed to 500 randomly selected National Association of School Psychologists (NASP) members, and responses were received from 235. Respondents reported their greatest CPD needs to be in the areas of direct service and consultation. No demographic variables were related to respondents' CPD needs. Few preservice training or incentive factors were related to CPD needs. Respondents' perceived value of preservice training in CPD management was related to their CPD needs, but few respondents reported that they had received this type of preservice training. Several personal incentives for CPD, including self‐assessment of CPD needs, opportunity to practice new skills and receive feedback during CPD training, and opportunity to evaluate the effectiveness of CPD training and CPD goal attainment were related to CPD needs. Respondents' CPD needs in each specific skill area, including direct service, consultation, assessment, program planning and evaluation, supervision, and research, had significant but low correlations with the amount of actual CPD activity in the respective skill area. © 2001 John Wiley & Sons, Inc.