Confirmatory factor analyses of Chinese students' evaluations of university teaching

Chinese University of Hong Kong students (N = 844) selected a “good” and a “poor” teacher, and rated each using a Chinese translation of the Students' Evaluations of Educational Quality (SEEQ) instrument. Multigroup confirmatory factor analysis (CFA) models, based on a 3 × 2 design, were constructed to test the invariance of the SEEQ factor structure across 3 discipline groups (a between‐group comparison of ratings by students in arts, social sciences, and education; in business administration; and in engineering, medicine, and science) and across ratings of good and poor teachers (via within‐subjects comparison). The selected model imposed between‐group invariance constraints on factor loadings, factor correlations, and factor variances across the 3 discipline groups and within‐subjects invariance constraints on factor loadings across ratings of good and poor teachers. The results support the use of SEEQ in this Chinese setting, demonstrating the generality of North American research findings and the usefulness of CFA in this research area.     

Do Lions Have Manes? For Children,Generics Are About Kinds Rather Than Quantities

Generic statements (e.g., “Lions have manes”) make claims about kinds (e.g., lions as a category) and, for adults, are distinct from quantificational statements (e.g., “Most lions have manes”), which make claims about how many individuals have a given property. This article examined whether young children also understand that generics do not depend purely on quantitative information. Five‐year‐olds (n = 36) evaluated pairs of questions expressing properties that were matched in prevalence but varied in whether adults accept them as generically true (e.g., “Do lions have manes?” [true] vs. “Are lions boys?” [false]). Results demonstrated that children evaluate generics based on more than just quantitative information. Data suggest that even young children recognize that generics make claims about kinds.     

Using collaborative two‐stage examinations to address test anxiety in a large enrollment gateway course

Large enrollment foundational courses are perceived as “high stakes” because of their potential to act as barriers for progression to the next course or admittance to a program. The nature of gateway courses makes them ideal settings to explore the relationship between anxiety, pedagogical interventions, and student performance. Here, two‐stage collaborative examinations were implemented to improve test‐taking skills and address widespread test anxiety in an introductory human anatomy course. Test anxiety data were collected (using the Motivated Strategies for Learning Questionnaire) before the first examination and last examination. Most students experienced decreased test anxiety over the course of the semester; however, some students may have experienced performance limiting conditions due to test anxiety at the end of the semester based on academic ability in the course (in “C” students when compared to “A” students: P < 0.00006 and “B” students: P < 0.05), overall academic ability (in academically weaker students: P < 0.025), and demographic factors (in women: P < 0.025). The strongest performances on examinations were primarily observed in already academically strong students (mean individual performance: P < 0.000, mean group performance: P < 0.000). Furthermore, changes in test anxiety were not significantly associated with the group portion of the examinations. Patterns of changes in test anxiety over the course of the semester underscore a complex interaction between test anxiety, student background, and student performance. Results suggest that pathways for test anxiety in “high stakes” courses may be separate from the mechanisms responsible for the benefits of collaborative testing. Anat Sci Educ 10: 409–422. © 2017 American Association of Anatomists.     

Assessment as learning: Enhancing discourse,understanding, and achievement in innovative science curricula

An assessment‐oriented design‐based research model was applied to existing inquiry‐oriented multimedia programs in astronomy, biology, and ecology. Building on emerging situative theories of assessment, the model extends prevailing views of formative assessment for learning by embedding “discursive” formative assessment more directly into the curriculum. Three twenty‐hour curricula were designed and aligned to content standards, and three levels of assessments were developed and used to assess and enhance learning for each curriculum. These assessments included three or four informal “activity‐oriented” quizzes and discursive formative feedback rubrics supporting collective discourse, a “curriculum‐oriented” examination of individual conceptual understanding, and a “standards‐oriented” test measuring aggregated achievement of targeted standards. After two design‐research cycles, worthwhile scientific argumentation and statistically significant gains were attained for two of the three packages on the exam and test. Achievement gains were comparable to or larger than those of students in comparison classrooms. Many existing innovations could be enhanced and evaluated in this fashion; designing these strategies directly into innovations could have an even greater impact on discourse, understanding, and achievement. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1240–1270, 2012     

Students' Conceptions of Research. 2: An exploration of contrasting patterns of variation

This study explores variation in postgraduate students' and supervisors' conceptions of research. Based on earlier work, a Conceptions of Research Inventory (CoRI) was trialled on a mixed sample of postgraduate students and supervisors (n = 251). Exploratory factor analyses of resultant data yields a five‐dimensional empirical model, the composition of which is consistent with earlier work by the present authors. Four of these five dimensions distinguish between (variation in) conceptions of research such as “truth”, “problem‐solving”, “re‐search”, and “an insightful process”. The fifth dimension captures variation in terms of what are interpreted as “misconceptions”. The discrete conceptual dimensions suggested within the factor model are further explored via k‐means cluster analyses in terms of partitioning of the dataset, as limited by sample sizes, according to postgraduate status and supervisor designation. These analyses provide further insights into variation, across the various clusters in each case, as expressed in the profiles of cluster mean scores. Such differences as are evidenced highlight contrasting patterns of variation between, for example, experienced and novice researchers. There is also evidence of dissonance in some of the cluster solutions and it is further demonstrated via analysis of variance that dissonant cluster membership is associated with a generally lower level of self‐estimated performance. The implications of these findings are finally considered in relation to postgraduate training and supervision.     

Prediction of Academic Performance by Means of the Swedish Scholastic Assessment Test

This article reviews ten predictive validity studies of the Swedish Scholastic Assessment Test (SweSAT). A primary result is that the predictive validity of the SweSAT seems to be highly dependent upon the study programme being examined; that is, the predictive validity is better at some programmes than others. When compared with the upper‐secondary school grade point average, the predictive validity of the SweSAT seems to be fairly good, but there are major differences between study programmes in this case as well. However, it is suggested that the validity of the results is to some extent threatened by methodological issues. A general conclusion is, therefore, that there is room for improving the test itself, as well as the way that predictive validity studies are carried out.     

Psychometric reevaluation of the scientific attitude inventory‐revised (SAI‐II)

The central purposes of this study were to review the development and evolution of the Scientific Attitude Inventory (SAI) and then reevaluate the psychometric properties of the revised form of the SAI, the Scientific Attitude Inventory II (SAI‐II). The SAI‐II was administered to a convenience sample of 543 middle and high school students from five teachers in four schools in four school districts in San Antonio, Texas, at the beginning of the 2004–2005 school year. Confirmatory factor analysis on the full data set failed to support the existence of a 12‐factor structure (as proposed by the scale developers) or a one‐factor structure. The data were then randomly divided into exploratory [exploratory factor analysis (EFA)] validation and confirmatory [confirmatory factor analysis (CFA)] cross‐validation sets. Exploratory and confirmatory models yielded a three‐factor solution that did not fit the data well [χ² (321) = 646, p < .001; RMSEA = .061 (.90 CI = .054–.068); and CFI = .81]. The three factors were labeled “Science is About Understanding and Explaining” (13 items), “Science is Rigid” (6 items), and “I Want to Be a Scientist” (8 items). The α‐coefficients for these three factors ranged from 0.59 to 0.85. Whether these identified subscales are valid will require independent investigation. In this sample, and consistent with prior publications, the SAI‐II in its current form did not have satisfactory psychometric properties and cannot be recommended for further use. © 2008 Wiley Periodicals, Inc. J Res Sci Teach 45: 600–616, 2008     

Teacher educators’ collaboration in subject departments: collaborative activities and social relations

Teacher educators’ collaboration plays an important role in the improvement of teacher education. Many studies in educational research focus on collaboration from 1 particular perspective. A focus on 2 perspectives, a qualitative (focusing on collaborative activities) as well as a quantitative (focusing on relations) perspective, and relating both perspectives, can add to our knowledge. Data were collected in 3 subject departments of a teacher education institute. Findings indicated that educators’ collaborative networks inside the departments could gain from more coherent and dense relations, and that key players were important to support and sustain collaboration. Both perspectives were mildly related, correlations were found for “degree” and “information” (r = .31, p < .05), “degree” and “joint work” (r = .38, p < .01), and “reciprocity” and “joint work” (r = .33, p < .05), no correlations were found for “degree” or “reciprocity” and “discussing”. At the department level, only mathematics showed significant correlations. Results indicated that, in further research, qualitative aspects as well as quantitative aspects should be included.     

THE LIFE SPAN: HUMAN DEVELOPMENT FOR HELPING PROFESSIONALS (2nd Ed.)

The purpose of the present study was to investigate attitudes toward old age in an Israeli population, compared with attitudes toward youth and middle age, among individuals representing these same ages. Global concepts “Youth,” “Adult,” and “Old person” were rated in comparison with the “Ideal Person.”

Representatives of 62 three‐generation families participated in the study. A semantic differential consisting of 21 bipolar adjective pairs in 7‐point scale format was used to measure attitudes toward the four concepts. Results indicated that the concept “Old Person” was rated lowest in relation to the “Ideal Person,” as a global concept as well as on three cut of four dimensions derived from the global concept. This pattern was found among all three groups of raters, including the elderly themselves. The elderly, however, rated themselves significantly more favorably than did the other groups.     

Impact of Personality on Academic Performance of MBA Students: Qualitative Versus Quantitative Courses*

The traditional core Masters in Business Administration (MBA) curriculum consists of a broad range of courses that can be considered as a whole, or divided into qualitative and quantitative courses. Regression models were developed with “QualGPA” and “QuantGPA” as response variables, and gender, pre‐MBA academic indicators, and personality factors (measured by the RightPath6^® profile) as the explanatory variables. Results may provide pedagogical insight for faculty teaching increasingly diverse MBA classes. Additionally, there are recruitment implications for those hiring MBA graduates, as well as implications for MBA students in decisions regarding MBA concentrations and subsequent career choices. While gender alone was not a significant variable in any model, gender–personality interactions were significant. Across both course categories, performance tended to be higher for students who were more “Detached” than “Compassionate,” with the exception of females in quantitative courses. Additionally, “Extraversion” and “Reactiveness” significantly enhanced performance among males in qualitative courses, and “Conscientiousness” had a strong positive performance effect among females in quantitative courses.     

THE USES OF REMINISCENCE IN OLDER ADULTHOOD

Findings from previous research on the benefits of reminiscence and life review in the aging process have been inconclusive. This may be due in part to a lack of clarity with regard to the particular type of reminiscence being investigated. The study reported in this article attempted to bring some clarity to the phenomenon of reminiscence by identifying and differentiating its various uses or functions. A 17‐item Uses of Reminiscence scale was administered to 288 older adults as part of the Georgia Centenarian Study. A factor analysis of the data revealed three distinct uses of reminiscence: “therapeutic,” “informative,” and “enjoyment.” Implications for research and practice are discussed.     

A Quantitative Assessment of the Research Chefs Association Core Competencies for the Practicing Culinologist

ABSTRACT: Professional organizations have linked core competency to professional success and competitive strategy. The Research Chefs Assn. (RCA) recently released 43 core competencies for practicing culinologists. Culinology^® is a profession that links skills of culinary arts and food science and technology in the development of food products. An online survey was created asking RCA members from all 6 membership categories (Associate, Affiliate, Chef, Culinology, Food Science and Technology (FS&T), and Student) to rate their knowledge level based on a 7‐point scale and agreement to importance in job performance based on a 5‐point Likert scale for each competency statement. RCA participant's (N = 192) survey results were analyzed using SPSS for Windows version 13.0 at a significance level of P < 0.05. Statistical survey validation grouped all 43 competency statements into 8 factors (groupings) according to level of competency proficiency (opposed to the 7 groups each competency was originally designated by the RC A) and into 9 factors according to job success. Results suggest that Chef Members know “Culinary Arts” best and FS&T members know “Food Science” best. A gap analysis determined what competency factors were low in knowledge level yet important to job success for each membership category. Chef members have a lower level of knowledge in “Product Development,”“Food Science,” and “Quality Assurance” factors; however, the factors are important to job success. FS&T members have a lower level of knowledge in “Nutrition” yet identified the factor important to job success. An opportunity exists to improve educational efforts for specific membership categories.     

Reflecting Caring and Power in Early Childhood Education: Recalling Memories of Educational Practices

This paper examines university social science and education students' views of research methodology, especially asking whether a negative research orientation towards quantitative methods exists. Finnish (n?=?196) and US (n?=?122) students answered a questionnaire concerning their views on quantitative, qualitative, empirical, and theoretical methods, their readiness to use quantitative and qualitative methods in their own research, and the difficulties they experienced in quantitative methods' learning. Students were clustered in groups according to their views. Students had varying combinations of views on the methods, that is different research orientations towards methods were found in both countries. Some of the students had a dichotic attitude towards quantitative and qualitative methods; they seemed to “choose their side” between these methods. In both countries a negative research orientation towards quantitative methods was found. It was connected with either difficulties in quantitative methods' learning or with a lower appreciation of empirical methods than that of other students. Major subject and study year had no effect, so the views were not discipline‐specific and students seemed to already have them on entering university. Views were quite stable during the course. A reduction in difficulties experienced with quantitative methods' learning was connected with a lowered over‐appreciation of qualitative methods at the end of the course.     

A Developmental Model of Reading Acquisition Based upon Early Scaffolding Errors and Subsequent Vowel Inferences

This paper investigates the processes that predict reading acquisition. Associations between (a) scaffolding errors (e.g., “torn” misread as “town” or “tarn”), other reading errors, and later reading and (b) vowel and rime inferences and later reading were explored. To assess both of these issues, 50 6‐year‐old children were shown a number of CVC words, and word reading errors were noted. Children were then taught families of riming words that could serve as a basis for rime or vowel analogies (e.g., “bark”, “mark”, “dark” → “park” or “harm”) before attempting to read the CVCs a second time. Children’s reading ability was measured at age 6 and two years later at age 8. The results showed that, among word reading error groups, only scaffolding errors at age 6 were unique predictors of reading at age 8, after reading, vocabulary, and phonological awareness were controlled. Vowel but not rime inferences predicted reading at age 8. The results are used to inform a model of the role of phoneme awareness and grapheme use in early reading development wherein vowel inference‐use helps to specify precise representations of CVC words from preliminary scaffolding errors.     

An Experimental Study of the Effect on High School Sophomores of Teaching English with Emphasis on Guidance

Principal components factor analysis and Kaiser Varimax rotation was conducted on a correlation matrix of twenty-two subtests of a scholastic achievement test, a scholastic aptitude test, two critical thinking tests, a logical reasoning test, and a problem solving test. The subjects were “disadvantaged” Negroes, “disadvantaged” integrated Negroes and whites, and “non-disadvantaged” whites. Four factors were rotated. The largest rotated factor accounting for 50 percent of the variance was a scholastic achievement test and aptitude test factor. The second factor accounting for 21 percent of the variance was a Watson-Glaser Critical Thinking Appraisal factor. The third factor accounting for 20 percent of the variance was primarily a Cornell Critical Thinking Test factor.     

An analysis of the use of the “in doubt” response by university students on the musical aptitude profile and the iowa tests of music literacy

The Musical Aptitude Profile (MAP) and four levels of the Iowa Tests of Music Literacy (ITML) were administered to university non-music majors to investigate the use of the “in doubt” test item response. The “in doubt” response was not used indiscriminately by the university students on either test battery, and it appeared to function in a similar manner to use by public school students. The incidence of use of the “in doubt” response on ITML levels suggests that the students in this investigation felt quite confident of their answers on the achievement test levels and that this confidence remained stable throughout a semester of training. No reason to suspect the process validity of MAP or of ITML when used with university students was ascertained.     

GERONTOLOGICAL NURSING EDUCATION: A PROFESSIONAL AND PERSONAL CHALLENGE FOR FUTURE BACCALAUREATE FACULTY AND STUDENTS

Investigators in this study wanted to know if student nurses were increasing their factual knowledge and changing their attitudes about the elderly, as well as, desire to work with them. Respondents included two groups of undergraduates from a main campus (n = 87) and two from a satellite campus (n = 47) of a Baccalaureate College of Nursing (BSN) in a southern university during 1992‐1995. E. D. Palmore's (1990) quizzes (FAQ1, FAQ2, FAMHQ) were used as pre‐tests (upon entering the junior year) and post‐tests (upon completion of the senior year). E. D. Palmore's (1988) “documentation” and “classification” of items were used to calculate knowledge and attitude scores. Feelings about working with the elderly were part of demographic data, as were “determinants” in E. D. Palmore's (1982) “Theoretical Model.” Mean scores within groups were by dependent t tests. Grand Means for comparison between campuses were by independent t Jests at a ≤ .05 level of significance. Students from the main campus scored significantly less on the FAQ2, significantly more on the FAMHQ for knowledge, with significantly less negative attitudes on post‐tests. Subjects from the satellite campus scored significantly higher on FAQ1 for knowledge, with somewhat less negative attitudes on post‐tests. From 25% to 52% of all students checked “really like” working with the elderly on post‐tests. Recommendations include evaluation and revisions of BSN curricula for gerontological content, assisting faculty to enhance expertise in gerontology, and encouraging students to pursue career tracks in gerontology.     

Instructional Tools in Educational Measurement and Statistics (ITEMS) for School Personnel: Evaluation of Three Web-Based Training Modules

In the current No Child Left Behind era, K‐12 teachers and principals are expected to have a sophisticated understanding of standardized test results, use them to improve instruction, and communicate them to others. The goal of our project, funded by the National Science Foundation, was to develop and evaluate three Web‐based instructional modules in educational measurement and statistics to help school personnel acquire the “assessment literacy” required for these roles. Our first module, “What's the Score?” was administered in 2005 to 113 educators who also completed an assessment literacy quiz. Viewing the module had a small but statistically significant positive effect on quiz scores. Our second module, “What Test Scores Do and Don't Tell Us,” administered in 2006 to 104 educators, was even more effective, primarily among teacher education students. In evaluating our third module, “What's the Difference?” we were able to recruit only 33 participants. Although those who saw the module before taking the quiz outperformed those who did not, results were not statistically significant. Now that the research phase is complete, all ITEMS instructional materials are freely available on our Website.     

Young people’s views about their involvement in decision‐making

This paper reports on research conducted over a two‐year period in a large Educational Psychology Service (EPS) in England. Researchers were keen to ascertain the views of young people and EPS members about young people being directly involved in educational decision‐making and how their genuine involvement in such decision‐making might be best achieved. Focus groups were employed as a means of gathering data which were analysed using Content Analysis. Young people and EPS members ultimately identified “culture”, “attitudes”, “environment”, and “systems” as being the most important factors in ensuring the genuine involvement of young people in decision‐making.