An empirical investigation of two variance estimation procedures for use with criterion-referenced tests

This study investigated two procedures for estimating the population standard deviation of nonnormed tests. Two normed tests, both whose population standard deviation was known, were administered to 272 students in grades 3–6. One of the normed tests was treated as a criterion-referenced test; the two variance estimation procedures were applied to the scores from this test. Substantial differences were found between both estimated statistics and the actual standard deviation. The first estimation procedure estimated the standard deviation systematically higher, whereas the second procedure's estimation was systematically lower. These results are discussed in terms of using such procedures for program evaluation.     

Relationships between cognitive diagnosis, CTT, and IRT indices: an empirical investigation

Cognitive diagnosis models (CDMs) continue to generate interest among researchers and practitioners because they can provide diagnostic information relevant to classroom instruction and student learning. However, its modeling component has outpaced its complementary component??test construction. Thus, most applications of cognitive diagnosis modeling involve retrofitting of CDMs to assessments constructed using classical test theory (CTT) or item response theory (IRT). This study explores the relationship between item statistics used in the CTT, IRT, and CDM frameworks using such an assessment, specifically a large-scale mathematics assessment. Furthermore, by highlighting differences between tests with varying levels of diagnosticity using a measure of item discrimination from a CDM approach, this study empirically uncovers some important CTT and IRT item characteristics. These results can be used to formulate practical guidelines in using IRT- or CTT-constructed assessments for cognitive diagnosis purposes.     

An investigation of the relationship between metacognition and mathematics achievement

The aim of this study is to determine fifth-grade students’ metacognitive knowledge and skills and its relationship with mathematics achievements. A total of 242 primary school students from six different schools were participated in the study. Turkish version of Metacognitive Knowledge and Skills Assessment (MSA-TR) was used to measure metacognitive knowledge and skills. The results demonstrated a significant and positive relationship (r = .648, p < .01) between metacognition and mathematics achievement. Furthermore, research results showed that 42% of total variance of mathematics achievement could be explained with metacognitive knowledge and skills.     

The relationships between research and decision making in education: An empirical investigation

Chapter 5 of DETYA’s volume The Impact of Educational Research (Selby-Smith 2000) begins with an examination of the peculiarity of decision making in the VET sector, followed by an examination of the idiosyncratic consequences for the function of research in the sector. Having established the distinctiveness of VET in relation to these two key factors (decision making and research), the chapter then proceeds to explore the linkages between them. The study on which the chapter is founded identified a complex research culture, in which overt forms of impact are difficult to detect, yet where, it is concluded, research nonetheless plays its part. The research which is likely to impact most heavily is that which is conducted around the practical issues with which VET must deal, preferably with a heavy on-site component, and which is carried out by researchers who are prepared to engage most fruitfully with the VET culture, ideally with a long lead time and maximum follow-up to the actual research phase.Chapter 5 contributes to the overall Impact volume in a variety of ways. First, it offers an insight into the enigmatic nature of educational research in general, and especially as it relates to the VET sector. Second, it makes it clear that educational sectors like VET are likely to be affected by research only when its application to their practical needs is clear and it is carried out by people who are committed to working with their realities. Third, there are broader lessons to be taken from the chapter, especially for university researchers who are imputed by the chapter to be among the least likely to effect research that impacts on practical policy and decision making. While unrelated to the main body of The Impact of Educational Research project, Chapter 5 contributes to the overall work through exposing the real world of research impact in what is very likely the least understood of the educational sectors.     

Employing teachers' ratings in selection of achievement tests in reading and mathematics with a behaviorally disturbed population

The usefulness of a particular standardized achievement test with a specific population may be determined largely on the basis of experience. Sixty-six behaviourally disturbed students were administered portions of a test battery including the Reading Recognition subtest of the Peabody Individual Achievement Test (PIAT), PIAT Reading Comprehension, the Reading subtest of the Wide Range Achievement Test (WRAT), and Stanford Diagnostic Reading Test (SDRT); PIAT Mathematics, WRAT Arithmetic, Stanford Diagnostic Mathematics Test (SDMT), and KeyMath Diagnostic Arithmetic Test. Toward the end of the academic year, teachers estimated students' grade levels in reading and mathematics. Results indicated that, in mathematics, the SDMT and the PIAT predicted teachers' ratings equally well and better than the other tests; in reading, all tests predicted teachers' ratings equally well except for the PIAT Reading Comprehension, which performed less well than others. Explanations for these results are offered, together with suggestions for identifying achievement tests suitable to specific populations.     

School psychological services: An empirical comparison of two models

In this study, the traditional diagnostic model of school psychological services was compared with the emerging consultant service model. The study was conducted in an effort to determine the effectiveness of each model in working with teachers in the elementary grades. The two delivery systems were evaluated by comparing them on two variables: (a) the number of school days that elapse from the time of referral until the teacher receives feedback, and (b) the effectiveness of the recommendations as measured by brief questionnaires. The results revealed that the consultant model with its de-emphasis on the administration of time-consuming tests resulted in more immediate feedback for teachers. Responses to the follow-up questionnaires revealed that the consultant service model was as effective, if not more effective, in the teachers' perceptions, when comparing the effectiveness of the recommended intervention strategies. Although the data are more favorable for the consultant service model, they are not conclusive. Since each model meets some teachers' needs, a merging of these two approaches seems more justifiable than abandoning one model in favor of the other.     

An investigation of perfectionism,mental health,achievement, and achievement motivation in adolescents

This study examined the relationship of perfectionism with measures of achievement and achievement motivation and mental health aspects of depression and self‐esteem in high school students. Participants were 123 tenth‐ through twelfth‐grade students. Results of multiple regression analyses indicated that students' personal standards were significant predictors of academic achievement. Students' personal standards also significantly predicted achievement motivation. Analyses of the relationship between perfectionism and depression and self‐esteem found that as students' personal standards increased, their levels of depression decreased and self‐esteem increased. Furthermore, when students experienced a discrepancy between their personal standards and actual performance, their depression levels increased and self‐esteem decreased. © 2000 John Wiley & Sons, Inc.     

Improving interpersonal relations in the college classroom: An empirical investigation

The effect of small interpersonal discussion groups on student interpersonal relations was examined. A Group Psychology class with small interpersonal groups was compared to two other similar-level psychology classes with more traditional formats. One of these controls (a placebo group) had small, academically oriented discussion groups, and the other (a standard control group) was a medium-sized lecture class. TotalN was 258. The quality of within-class interpersonal relations for the experimental group exceeded that of the controls on all dependent variables. These effects, however, did not extend to behavior outside the class. This finding was supported by the results of a two-year follow-up (N=74).     

Indicators of institutional achievement: some theoretical and empirical considerations

This article outlines a number of general approaches to organisational effectiveness, and three approaches to effectiveness in the more specific field of higher education.The literature survey is used to derive a broad framework suggestive of the main causal relationships likely to exist between various areas of institutional achievement, and this framework is used as a background to discussion of empirical evidence.Empirical findings in the field of institutional achievement are sparse and poorly interconnected. The article summarises findings from product portfolio matrix studies and Cameron's work on effectiveness, discusses some aspects of institutional management, and outlines some differences between British and American universities regarding the acquisition of funds.The article concludes with comments on some methodological aspects of assessing institutional achievement.Revised version of a paper prepared for Jornadas Internacionales Sobre Demanda de Education Superior y Rendimiento Academico en la Universidad, Madrid, 9–11 April 1986.     

Teaching Experience and Educational Psychologists' Credibility with Teachers: An empirical investigation

The extent to which educational psychologists' credibility with teachers relies on their own teaching experience is an issue that has been hotly debated in the profession for more than 30 years. It is widely perceived as a key reason for retaining qualified teaching experience as a requirement for training as an educational psychologist (EP). The studies reported in this paper investigate whether teachers know that educational psychologists have been teachers (a logical pre-requisite to affording them high credibility on this basis). The studies also examine the regard in which EPs are held by teachers who know, and teachers who do not know, that EPs have been teachers. Results indicate that teaching experience cannot be regarded as necessary to EPs' credibility with teachers. However, a positive relationship between teaching experience and credibility with teachers, among primary school teachers, raises questions about ways of broadening EPs' pre-course experience.     

An empirical investigation of entrepreneurship intensity in Iranian state universities

The purpose of this study is to propose a framework to evaluate the entrepreneurship intensity (EI) of Iranian state universities. In order to determine EI, a hybrid multi-method framework consisting of Delphi, Analytic Network Process (ANP), and VIKOR is proposed. The Delphi method is used to localize and reduce the number of criteria extracted from a deep literature review, according to the social and economic conditions of Iranian state universities by using an expert panel, including sixty-eight country-wide academicians and practitioners. After that, a group approach to ANP was utilized as an evaluation method to derive the weights of each criterion. Next, the evaluation data were gathered through a questionnaire, and, finally, the compromise ranking of universities was calculated using the VIKOR method. Moreover, this study applies weight-variance analysis (WVA) to suggest improvement actions. The paper proposes an evaluation framework for determining the performance of entrepreneurship development initiatives in universities. By using this framework, twenty-two Iranian state universities are evaluated in terms of their EI, and the results are discussed.     

Stability of self-esteem ratings and their relation to academic achievement: A longitudinal study

In a sample of 380 children, self-esteem as measured by the Coopersmith Self-Esteem Inventory (SEI) became more stable and more highly correlated with school achievement as the children grew older. Subjects taking the SEI at ages 12 and 15 showed greater test-retest consistency (r = .64) than did subjects tested at ages 9 and 12 (r = .42). Correlations between SEI and school achievement scores also increased over the age range from 9 to 15. Children's self-perceptions appear less firmly established, and therefore may be more responsive to intervention, at earlier ages.     

手机禁忌语使用研究——大学生手机禁忌语使用态度调查

禁忌语是语言的一部分,它因语言的发展而产生。对禁忌语的研究不仅在语言学上而且在文化上都有重大意义。语言禁忌反映的是社会禁忌。对于禁忌语使用的态度反映及影响着禁忌语的现状及发展变化。     

Reliability and agreement of student ratings of the classroom environment: A reanalysis of TIMSS data

In educational research, characteristics of the learning environment are generally assessed by asking students to evaluate features of their lessons. The student ratings produced by this simple and efficient research strategy can be analysed from two different perspectives. At the individual level, they represent the individual student’s perception of the learning environment. Scores aggregated to the classroom level reflect perceptions of the shared learning environment, corrected for individual idiosyncrasies. This second approach is often pursued in studies on teaching quality and effectiveness, where student-level ratings are aggregated to the class level to obtain general information about the learning environment. Although this strategy is widely applied in educational research, neither the reliability of aggregated student ratings nor the within-group agreement between the students in a class has been subject to much investigation. The present study introduces and discusses different procedures that have been proposed in the field of organisational psychology to assess the reliability and agreement of students’ ratings of their instruction. The application of the proposed indexes is demonstrated by a reanalysis of student ratings of mathematics instruction obtained in the Third International Mathematics and Science Study (N = 2,064 students in 100 classes).