A Revision of the Biggs' Study Process Questionnaire (R-SPQ)

The Biggs' Study Process Questionnaire (SPQ), an instrument for the evaluation of student learning in higher education, was revised over a three-year period with over 2500 tertiary students. The original instrument structure of 42 items in 6 sub-scales was maintained with each item being subject to revision and assessed for internal consistency and appropriateness through a sequence of trial and retrial. The final version consists of 8 original items and 34 revised items. This version was evaluated with 996 students, at first-year and third-year level, through the use of confirmatory factor analysis using AMOS. The two models having the best fit to the data are represented by the original six sub-scale model which loads onto two higher order factors, a deep approach and a surface approach to learning, or a seven sub-scale version which loads on the same two higher order factors. Evidence is presented as to the preference of the latter model.     

Recalled test anxiety in relation to achievement,in the context of general academic self-concept,study habits,parental involvement and socio-economic status among Grade 6 Ethiopian students

The study investigated the predictive nature of test anxiety on achievement in the presence of perceived general academic self-concept, study habits, parental involvement in children's learning and socio-economic status. From a population of 2482 Grade 6 students from seven government primary schools of a sub-city in Addis Ababa, 497 participants were randomly selected, namely 248 boys and 249 girls. The mean age of the participants was 12.98 years. An adapted version of Sarason's Test Anxiety Scale (28 items), plus the General Academic Self-Concept Scale (18 items), and Parental Involvement (10 items), Study Habits (10 items) and Socio-Economic Status (10 items) scales developed by the authors were the instruments of the study. The findings of the study indicated: (a) test anxiety correlated with achievement with a weak correlation of ?0.186; and (b) perceived general academic self-concept and study habits were positively and significantly related to achievement. Stepwise multiple regression on achievement resulted in the selection of general academic self-concept, study habits and parental involvement as significant contributors to achievement in that order. Test anxiety was found to be a non-predictor of achievement in the presence of other variables.     

Adaptation of the Students' Motivation Towards Science Learning (SMTSL) questionnaire in the Greek language

The present study aimed at adapting in the Greek language the Students' Motivation Towards Science Learning (SMTSL) questionnaire developed by Tuan, Chin, and Shieh (INT J SCI EDUC 27(6): 639-654, 2005a) into a different cultural context, a different age group, that is, in university students and with a focus on physics learning. Three hundred and fifty Greek student teachers participated in the study. The original instrument consisted of 35 items allocated in six scales: self-efficacy, use of active learning strategies, science learning value, performance goals, achievement goals, and learning environment stimulation. The instrument's internal consistency was acceptable and comparable to previous studies' reports. Confirmatory factor analysis (CFA) was applied on the data in order to test an a priori hypothesis regarding the SMTSL's factorial structure based on previous studies' findings. The results of the study showed that the six-factor conceptual model of students' motivation proposed by the SMTSL applies in this different cultural setting and in this group of university students with reference to physics learning. Along with the six distinct motivational constructs confirmed, students' motivational beliefs were also explained by a general motivational construct assumed to be at their basis. Suggestions for further improvement of the Greek version of the SMTSL are also discussed.     

Exploratory factor analysis of parent ratings of child and adolescent anxiety: A preliminary investigation

This study explored the factor structure of a parent rating scale designed for use in the assessment of child and adolescent anxiety. A total of 176 usable surveys were returned from parents of children in grades kindergarten through 11. Exploratory common factor analyses on the 29‐item scale suggested one second‐order factor yielding an internal consistency estimate of .93 which accounted for 70% of the covariance among items. © 1999 John Wiley & Sons, Inc.     

Psychometric Properties of the Malay Version of the Loewenstein Occupational Therapy Cognitive Assessment for Geriatrics (M-LOTCA-G) Among the Malaysian Elderly Population

Current cognitive screening tests are difficult to use due to their deficit in cultural and conceptual significance and translation into other languages. The purpose of this study was to translate the Loewenstein Occupational Therapy Cognitive Assessment for Geriatrics (LOTCA-G) into Malay language and test its reliability and validity for assessing cognitive deficit among institutional elderly who undergo occupational therapy. The study was based on a single group test–retest design of 52 selected subjects (among the elderly). Cronbach's alpha values were used to examine the reliability of the instrument. Convergent validity was also assessed by comparing the adapted Malay version to the original English version for any inconsistencies and abnormality in interpretation. This study concluded that the Malay version of the Loewenstein Occupational Therapy Cognitive Assessment for Geriatrics is reliable as the overall Cronbach's alpha value was more than .90. This study also indicated that both the adapted Malay version and the original English versions of the instruments were consistent in their performance in cognitive components. The findings pointed out that the Malay version of the Loewenstein Occupational Therapy Cognitive Assessment for Geriatrics is appropriate and reliable in identifying deficits in cognitive components in relation to occupational performance for the Malaysian elderly population.     

Psychometric Characteristics of the California Preschool Social Competence Scale in a Spanish Population Sample

Research Findings: Few rating scales measure social competence in very young Spanish or Catalan children. We aimed to analyze the psychometric characteristics of the California Preschool Social Competence Scale (CPSCS) when applied to a Spanish- and Catalan-speaking population. Children were rated by their respective teachers within 6 months following their 4th birthday in two population-based birth cohorts in Spain (N = 378). A confirmatory factor analysis (CFA) was used to compare the underlying structure of the Spanish–Catalan version with that of the original version. Cronbach's alpha coefficient was used to determine the internal consistency of each of the confirmed factors. Cohen's kappa formula was used to calculate the test–retest reliability in a small subset of children who were rated again one month later. Five correlated factors (Considerateness, Task Orientation, Extraversion, Verbal Facility, and Response to Unfamiliar) were optimally confirmed as a result of CFA. The first three factors had robust internal consistency. The kappa coefficient was satisfactory in 29 items out of 30. Children's cognitive abilities as assessed by the McCarthy Scales, children's gender, maternal social class and level of education were related to the social competence scores as indicators of criterion-related factors. Practice or Policy: The bilingual version of the CPSCS has good psychometric properties allowing it to be used in further studies in either Spanish or Catalan populations.     

Development of a short form of the attitudes toward mathematics inventory

Existing instruments designed to measure mathematics attitudes were too long, dated, or assessed with only western samples. To address this issue, a shortened version of the Attitudes Toward Mathematics Inventory (short ATMI) which measures four subscales??enjoyment of mathematics, motivation to do mathematics, self-confidence in mathematics, and perceived value of mathematics??was created. Its factor structure, reliability, and validity were assessed with 1,601 participants from Singapore. Confirmatory factor analyses supported the original four-factor structure. Within this structure, however, several items were found to correlate highly with others. Their removal either improved or did not impact the properties of the instrument. As a result, these items were removed to produce the short ATMI. Furthermore, a very high correlation (r?=?.96) was found between the enjoyment and motivation subscales. Results of further analysis suggested the removal of the motivation subscale. The short ATMI exhibited strong correlations with the original scale (mean r?=?.96), good overall internal consistencies, both for the full short version (???=?.93) and for the individual subscales (mean ???=?.87), and satisfactory test?Cretest reliability over a 1-month period (mean r _xx ?=?.75). The validity of the short ATMI was further demonstrated through inter-correlations between its subscales, and through correlations with mathematics anxiety and achievement test scores. Participants were able to complete the short ATMI in less than 10?min, making it a viable option when survey administration time is limited. This time would reduce further with the removal of the motivation subscale.     

Psychometric characteristics of the Persian version of the Multidimensional School Anger Inventory–Revised

The Multidimensional School Anger Inventory–Revised (MSAI-R) is a measurement tool to evaluate high school students' anger. Its psychometric features have been tested in the USA, Australia, Japan, Guatemala, and Italy. This study investigates the factor structure and psychometric quality of the Persian version of the MSAI-R using data from an administration of the inventory to 585 Iranian high school students. The study adopted the four-factor underlying structure of high school student anger derived through factor analysis in previous validation studies, which consists of: School Hostility, Anger Experience, Positive Coping, and Destructive Expressions. Confirmatory factor analysis of this four-factor model indicated that it fit the data better than a one-factor baseline model, although the fit was not perfect. The Rasch model showed a very high internal consistency among items, with no item misfitting; however, our results suggest that to represent the construct sufficiently some items should be added to Positive Coping and Destructive Expression. This finding is in agreement with Boman, Curtis, Furlong, and Smith's Rasch analysis of the MSAI-R with an Australian sample. Overall, the results from this study support the psychometric features of the Persian MSAI-R. However, results from some test items also point to the dangers inherent in adapting the same test stimuli to widely divergent cultures.     

Development and validation of a modified Turkish version of the Teacher Constructivist Learning Environment Survey (TCLES)

The Constructivist Learning Environment Survey is an instrument used for assessing students’ and teachers’ perceptions of their learning environments. The Teacher Constructivist Learning Environment Survey (TCLES) was created to better enable teachers and researchers to determine teachers’ perception of their use of constructivist approaches in their classrooms. This article reports the development and validation of a modified Turkish version of the TCLES with 449 teachers chosen randomly from primary schools in Turkey. The validity of the TCLES was investigated by means of explanatory and the confirmatory factor analyses, whereas the Cronbach alpha coefficient was used to assess the internal consistency of the scales. The factor analyses were carried out to check the factor structure of the Turkish adaptation of TCLES. The factor analysis revealed that the Turkish adaptation of the original survey consisted of 30 items with the same six-scale structure as the original survey.     

Humor and anxiety: Effects on class test performance

Measures of trait anxiety, state anxiety, and achievement were obtained on a sample of undergraduate students, half of whom received additionaal humorous items in the achievement test. In a regression analysis, the trait anxiety × test version interaction was a significant predictor of achievement. Subsequent analyses revealed a disordinal interaction in which highly anxious students had lower achievement on the humorous test than on the nonhumorous test, and students with low anxiety had higher achievement on the humorous test than did students with high anxiety. The results do not support the popular assumption that humor is a positive factor in reducing high anxiety associated with academic evaluations.     

Mathematical power of special‐needs pupils: An ICT‐based dynamic assessment format to reveal weak pupils' learning potential1

This paper reports a study aimed at revealing special‐educational‐needs pupils' learning potential by means of an ICT‐based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require ‘borrowing’. These problems, in which the value of the ones‐digit of the subtrahend is larger than the ones‐digit of the minuend, are known as a serious difficulty for weak pupils in mathematics. Seven of such problems from a standardised test were placed in the ICT environment. Data were collected from two test conditions: the standardised written test format and the ICT version of the test items including the tool that provided pupils with a set of virtual manipulatives. The 37 pupils involved in the study were 8–12 years old and from two special‐education schools in the Netherlands. Comparison of the performance scores in the two formats showed that an ICT‐based assessment format, including a dynamic visual tool, can reveal weak pupils' learning potential and strategy use. The study also pointed out that ‘partial‐tool use’, ie, not carrying out the complete subtraction operation with the tool, can provide sufficient support to find the correct answer.     

Using multidimensional Rasch analysis to validate the Chinese version of the Motivated Strategies for Learning Questionnaire (MSLQ-CV)

This article used the multidimensional random coefficients multinomial logit model to examine the construct validity and detect the substantial differential item functioning (DIF) of the Chinese version of motivated strategies for learning questionnaire (MSLQ-CV). A total of 1,354 Hong Kong junior high school students were administered the MSLQ-CV. Partial credit model was suggested to have a better goodness of fit than that of the rating scale model. Five items with substantial gender or grade DIF were removed from the questionnaire, and the correlations between the subscales indicated that factors of cognitive strategy use and self-regulation had a very high correlation which resulted in a possible combination of the two factors. The test reliability analysis showed that the subscale of test anxiety had a lower reliability compared with the other factors. Finally, the item difficulty and step parameters for the modified 39-item questionnaire were displayed. The order of the step difficulty estimates for some items implied that some grouping of categories might be required in the case of overlapping. Based on these findings, the directions for future research were discussed.     

Development and factor structure of a self-report measure for assessing internalizing symptoms of elementary-age children

The development and factor structure of the Internalizing Symptoms Scale for Children (ISSC), a new self-report measure for assessing internalizing symptomatology in children, is detailed. Development of the ISSC was driven by the lack of a children's self-report instrument designed specifically to assess the broad domain of internalizing symptomatology, as well as research findings showing a high degree of comorbidity among internalizing syndromes (e.g., depression, anxiety, somatic complaints, social withdrawal). Thorough and methodologically rigorous procedures were employed during the development of the ISSC to ensure strong content validity as well as clinical utility. Exploratory and confirmatory factor analytic procedures were utilized on the 54-item ISSC research protocol, resulting in a strong two factor solution for the 48 items retained. Factor 1, Negative Affect/General Distress, includes items that indicate the presence of internalizing symptoms, or in some cases, the absence of optimistic or functional emotional states. Factor 2, Positive Affect, includes items describing positive affect incompatible with internalizing symptoms, or in some cases, items that reflect the absence of internalizing symptoms. Results of the factor analyses are discussed in terms of previous research on affectivity and specific internalizing syndromes or disorders. Potential uses of the ISSC, as well as further research needed, are described. Implications of the present investigation for future assessment and classification studies in the area of child psychopathology are reviewed. © 1997 John Wiley & Sons, Inc.     

Not Read,but Nevertheless Solved? Three Experiments on PIRLS Multiple Choice Reading Comprehension Test Items

Multiple-choice (MC) reading comprehension test items comprise three components: text passage, questions about the text, and MC answers. The construct validity of this format has been repeatedly criticized. In three between-subjects experiments, fourth graders (N ₁ = 230, N ₂ = 340, N ₃ = 194) worked on three versions of MC items from the Progress in International Reading Literacy Study 2001 reading comprehension test with relevant components successively deleted: “original version” (text, questions, MC-answers), “version without text” (questions, MC-answers), “version without text and without questions” (only MC-answers). Answering correctly the MC items became more difficult as the relevant information was eliminated. In the two narrative fictional texts presented, the students' performance of the version without text was not better than chance. Conversely in the informational (fictional) text, the students' performance of the version without text was better than chance. In the third condition, students' performance was never better than chance.     

Multiple dimensions of family engagement in early childhood education: Evidence for a short form of the Family Involvement Questionnaire

The primary aim of this study was to develop and validate a short form of the 42-item Family Involvement Questionnaire (FIQ) for use in preschool. Empirical evidence derived from a representative sample of preschool programs in a large city in New York State with the original version of the FIQ was used to select the items for a 21-item short form. A representative sample of 590 Head Start families was also identified from a large Head Start program in Pennsylvania to serve to validate the short form. Confirmatory factor analysis of the short form substantiated the three robust dimensions of family involvement from the original FIQ. Concurrent measures of parental satisfaction and assessments of children's literacy and mathematics skills along with an examination of family demographic variables supported the validity of the confirmed dimensions. Implications for the use of this multidimensional, short form of family involvement in large-scale program evaluation were discussed.     

Construction and Initial Validation of the Chinese Reading Motivation Questionnaire

This paper describes the development and initial validation of a Chinese reading motivation questionnaire (CRMQ) which was designed to assess Chinese students' reading motivation in Hong Kong. The development of the CRMQ consisted of two steps. In the first study, groups of items were constructed based on achievement motivation theories and existing instruments. The initial version of the CRMQ was administered to a small group of Grade 7 students in Hong Kong and exploratory factor analysis, item‐total correlation, and reliability analyses were carried out to assess its psychometric quality. The CRMQ was then revised and administered to a larger sample of Grade 7 students in the second study. Findings of confirmatory factor analysis provided further validation for the proposed factor structure of the revised questionnaire. In addition, findings indicated that students' reading motivation was positively related to their strategy use, reading comprehension, and academic achievement. The findings of this study could enrich our understanding of Chinese reading motivation among Hong Kong students. Implications of these findings for implementing effective reading instruction in Chinese language teaching are also discussed.     

Development and evaluation of the conceptual inventory of natural selection

Natural selection as a mechanism of evolution is a central concept in biology; yet, most nonbiology‐majors do not thoroughly understand the theory even after instruction. Many alternative conceptions on this topic have been identified, indicating that the job of the instructor is a difficult one. This article presents a new diagnostic test to assess students' understanding of natural selection. The test items are based on actual scientific studies of natural selection, whereas previous tests have employed hypothetical situations that were often misleading or oversimplified. The Conceptual Inventory of Natural Selection (CINS) is a 20‐item multiple choice test that employs common alternative conceptions as distractors. An original 12‐item version of the test was field‐tested with 170 nonmajors in 6 classes and 43 biology majors in 1 class at 3 community colleges. The test scores of one subset of nonmajors (n = 7) were compared with the students' performances in semistructured interviews. There was a positive correlation between the test scores and the interview scores. The current 20‐item version of the CINS was field‐tested with 206 students in a nonmajors' general biology course. The face validity, internal validity, reliability, and readability of the CINS are discussed. Results indicate that the CINS will be a valuable tool for instructors. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 952–978, 2002