Environmental,cognitive, and metacognitive influences on text revision: Assessing the evidence

To assess progress in understanding text revision, we review research reported since 1980, when process analyses of writing were beginning (Fitzgerald, 1987). A modernized version of the revision model by Flower, Hayes, Carey, Schriver, and Stratman (1986) was used to organize findings about how revision is influenced by environmentally posed rhetorical problems and actual text variables; by cognitive knowledge, strategies, and representations of the text being revised; by metacognitive understanding, monitoring, and control of knowledge and strategies; by interactions among these environmental, cognitive, and metacognitive influences; and by how working memory limits those interactive influences. These influences have been studied with a rich diversity of research approaches, and even though no part of the modernized model has been studied fully, and even though interactions of the model's parts have been examined minimally, clearly interpretable results have been reported about all of the model's parts. Substantial and encouraging progress has been made toward understanding text revision, and the stage has been set for more progress. We suggest investigations to increase understanding of revision and to promote integration of research and theory about reading and writing.     

Assessing reflective thinking in solving design problems: The development of a questionnaire

Reflection is a critical factor in solving design problems. Using good methods to observe designers' reflection is essential to inform the design of the learning environments that support the development of design problem‐solving skills. In this study, we have developed and validated a novel self‐reporting questionnaire as an efficient instrument to explore reflection, called Assessing Reflective Thinking in Solving Design Problems (ARTiD). This questionnaire has been developed based on the three‐dimensional model for reflective thinking: the timing, the objects and the levels of reflection. A total of 294 undergraduate and graduate students in the fields of engineering, computer science and instructional design were recruited to participate in one of four iterative, formative tests through which reliability and validity analyses were performed to revise and confirm the questionnaire. Examples of participants' reflection patterns were demonstrated to show the practical value of this questionnaire. In conclusion, the final version of ARTiD was presented as a valid instrument to explore students' reflection for research and educational practice. In addition, we found that ARTiD can be used as an effective learning tool to guide student designers' reflections toward better learning and performance.     

Collecting student feedback: a comparison of questionnaire and other methods

A study was conducted comparing the feedback received from students about teaching obtained using different instruments. Twelve first‐ and second‐year undergraduate modules were selected from seven different schools within a single university. Students studying each module were allocated to ‘questionnaire’ and ‘comparator’ groups. ‘Questionnaire’ students completed the standard end‐of‐module questionnaire, whilst ‘comparator’ groups evaluated the modules using ‘rapid feedback’, ‘H form’, focus group and reflective diary methods. The responses of 335 students to questionnaires were compared with those of 160 using the other methods; no results were obtained from the reflective diary students. Only a minority of the issues raised by students using the comparator methods were covered by the questionnaire, and the comparator methods showed different rankings of the issues in common. The key difference between questionnaire and comparator methods was the use of closed and open questions respectively, with comparator methods being more appropriate for formative evaluation.     

A domain-specific account of self-regulated learning: the cognitive and metacognitive activities involved in learning through historical inquiry

Educational researchers have recently begun to conceptualize theoretical constructs and mechanisms of metacognitive activities in terms of the features that are specific to particular academic domains and subject matter. In this paper, we propose a framework of domain-specific metacognition in relation to learning through historical inquiry. The framework postulates that students’ comprehension of historical events is mediated by a state of coherence in understanding the causes that explain why an event occurred. Comprehension breaks down when the causes that explain the occurrence of historical events are unknown, uncertain, or unreported. In order to reinstate coherence in understanding, students engage in cognitive and metacognitive activities in accordance with disciplinary-based practices. Drawing on the existing empirical evidence, we discuss how the study of self-regulatory processes contributes to our understanding of the challenges faced by students while learning about complex historical topics as well as the skills that are required to gain knowledge while investigating the past.     

Applying mathematics with real world connections: metacognitive characteristics of secondary students

This paper reports an intensive study of problem-solving activity of female students at the senior secondary level. The study focussed both on the mathematical processing and the underlying cognitive and metacognitive activities that led to that processing. Response maps were used to analyse and categorize the written responses from individual students while videotaped problem solving sessions and structured and free response interviews probed the students' metacognitive knowledge, strategies, decision making, beliefs and affects. Metacognitive activities were involved in all phases of the solution process with key points in students' solutions identifiable in terms of the cognitive-metacognitive framework of Garofalo and Lester (1985). On average more time was spent on orientation and execution activities with little time being spent on organisation and verification activities, however, the successful groups spent less time on orientation than the other groups. All successful groups displayed a high number of key points where metacognitive decisions could influence cognitive action. Success was accompanied by a tendency to engage in a high number of organisational activities, regulation of execution activities and evaluation activities particularly evaluation of execution but fewer opportunities where metacognitive decisions could influence cognitive actions during orientation.     

Skilled but unaware of it: CAT undermines a test taker's metacognitive competence

We investigated students' metacognitive experiences with regard to feelings of difficulty (FD), feelings of satisfaction (FS), and estimate of effort (EE), employing either computerized adaptive testing (CAT) or computerized fixed item testing (FIT). In an experimental approach, 174 students in grades 10 to 13 were tested either with a CAT or a FIT version of a matrices test. Data revealed that metacognitive experiences were not related to the resulting test scores for CAT: test takers who took the matrices test in an adaptive mode were paradoxically more satisfied with their performance the worse they had performed in terms of the resulting ability parameter. They also rated the test as easier the lower they had performed, but their estimates of effort were higher the better they had performed. For test takers who took the FIT version, completely different results were revealed. In line with previous results, test takers were supposed to base these experiences on the subjectively estimated percentage of items solved. This moderated mediation hypothesis was in parts confirmed, as the relation between the percentage of items solved and FD, FS, and EE was revealed to be mediated by the estimated percentage of items solved. Results are discussed with reference to feedback acceptance, errant self-estimations, and test fairness with regard to a possible false regulation of effort in lower ability groups when using CAT.     

The origin of centrality deficit in text memory and comprehension by poor comprehenders: a think-aloud study

The present study employed a think-aloud method to explore the origin of a centrality deficit (i.e., poor recall of central ideas) found in poor comprehenders (PC). Moreover, utilizing the diverse think-aloud responses, we examined the overall quality of text processing employed by PC during reading, in order to shed more light on the cognitive underpinnings underlying their poor comprehension and memory after reading. To address these goals, adolescents with good and poor comprehension, matched on reading (decoding) skills, were asked to state aloud whatever comes to their mind during the reading of two expository texts. After reading, the participants freely recalled text ideas and answered multiple-choice questions on the texts. Results indicated that PC exhibited lower performance than good comprehenders (GC) on the recall and comprehension tasks. The think-aloud protocols indicated that PC generated fewer responses than GC that reflect high-level, deep text processing, and more responses that reflect low-level, surface text processing. Furthermore, compared to GC, PC reinstated fewer prior text ideas, with this reduction being significantly greater for central than for peripheral ideas. Finally, the proportions of deep processing responses in general were positively associated with participants’ performance on recall and comprehension tasks. These findings suggest that PC exhibit poor text comprehension and memory, particularly of central ideas, because they construct a low-quality, poorly-connected text representation during reading, and produce fewer, less-elaborated retrieval cues for subsequent text comprehension and memory. This explanation is further illuminated in the context of previous findings and theoretical accounts.

     

Preschool teachers' and students' attitudes towards playful preschool activities: a cross-cultural comparison between Germany and the Netherlands

This study compares the attitudes of preschool teachers and students between the Netherlands and Germany towards typical play activities in preschool. The data were responses to short video clips of preschool children's play and elicited the respondents’ attitudes through questionnaires. The data were analysed by classifying the written responses into four categories. The frequencies of the categories were tested with MANOVA with regard to expert–novice position and country. Differences between professionals and novices were found, and for professionals only, the four categories were interrelated, showing a stronger holistic view of early childhood activities. Differences were also found between the countries, and two of the categories seemed especially sensitive to cultural differences. We discuss how reflection on activities can add to a higher degree of professionalism, as well as a more profound understanding of ways to improve preschool teacher training.     

From the lab to the dorm room: metacognitive awareness and use of spaced study

Laboratory studies have demonstrated the long-term memory benefits of studying material in multiple distributed sessions as opposed to one massed session, given an identical amount of overall study time (i.e., the spacing effect). The current study goes beyond the laboratory to investigate whether undergraduates know about the advantage of spaced study, to what extent they use it in their own studying, and what factors might influence its utilization. Results from a web-based survey indicated that participants (n = 285) were aware of the benefits of spaced study and would use a higher level of spacing under ideal compared to realistic circumstances. However, self-reported use of spacing was intermediate, similar to massing and several other study strategies, and ranked well below commonly used strategies such as rereading notes. Several factors were endorsed as important in the decision to distribute study time, including the perceived difficulty of an upcoming exam, the amount of material to learn, how heavily an exam is weighed in the course grade, and the value of the material. Further, level of metacognitive self-regulation and use of elaboration strategies were associated with higher rates of spaced study. Additional research is needed to examine student study habits in a naturalistic setting, and to explore effective ways to encourage behavior change through motivational and teaching techniques.     

Assessing the Support Needs of Children with a Disability in Regular Classes

This paper reports the development of an instrument to assess the support needs of students with a disability in regular classes. The instrument was developed by a University-based research team on behalf of the New South Wales Department of Education and Training, and was used as the basis for providing funding support for over 12,000 students in the year 2000. The developmental process was robust in that it was based on three types of information: assessment approaches being used in other locations; expert judgement by Departmental officers; and statistical analyses of data obtained using an initial form of the instrument. Statistical analysis was based on a final form of the instrument consisting of 11 focus areas structured into three domains - physical needs, learning needs, and social needs of students. These domains had good construct and face validities and high score reliabilities.     

对外汉语听力课教学对策探究——结合调查问卷结果

近年来,对外汉语的听力教学已经有了很大发展,但是,不可否认仍存在很多问题。如何促进听力课课堂教学的改进越来越得到学界的重视。本文在总结以往听力课研究热点问题的基础上,结合针对汉语言专业本科三年级留学生问卷调查的结果,提出几点对外汉语听力课教学的建议及课堂策略。     

Precursors of metamemory in young children: the role of theory of mind and metacognitive vocabulary

This paper describes findings of a longitudinal study that was carried out to examine relationships among different aspects of young children's cognitive development, namely, theory of mind, metacognitive vocabulary, and metamemory, which seem theoretically connected but so far have not been studied simultaneously. In total, 174 children were included in the present analyses who were about 4;6 years of age at the first measurement point. Children were tested at four time points, separated by a testing interval of approximately half a year. At the first time of testing, children completed a set of theory of mind tasks. At each of the following measurement points, measures of metacognitive vocabulary and general vocabulary as well as metamemory were given. Overall, the findings show that theory of mind performance assessed at the age of 4;6 predicts metacognitive knowledge assessed about one and a half years later. Furthermore, they point to a reciprocal relationship between metacognitive vocabulary and metamemory in that comprehension of metacognitive vocabulary predicted later metamemory and, conversely, metamemory significantly predicted later comprehension of metacognitive verbs. This research was supported by a grant from the German Research Foundation (SCHN 315 /20–7) to the German Research Group on Cognitive Development.     

Prior experience shapes metacognitive judgments at the category level: the role of testing and category difficulty

Most metacognition research has focused on aggregate judgments of overall performance or item-level judgments about performance on particular questions. However, metacognitive judgments at the category level, which have not been as extensively explored, also play a role in students’ study strategies, for example, when students determine what topics to study for an exam. We investigated whether category learning judgments (CLJs) were sensitive to differences in the difficulty of general knowledge categories. After either studying or being tested on facts from several categories (e.g., Shakespeare, Astronomy), participants estimated the likelihood that they could correctly answer new questions from those categories on a later test (i.e., they made CLJs). Results of two studies showed that CLJs were sensitive to differences in category difficulty. Further, participants gave lower or more conservative CLJs when they took an initial test as compared to studying questions from the categories. Results are discussed in terms of the value and relevance of CLJs both in educational settings and in theories of metacognition.     

Assessing perceptions of the environment in elementary classrooms: the link with achievement

This paper examines students' perceptions of their classroom environment and the possible effect of these perceptions on math and reading achievement. Additionally, the paper investigates the significance of gender and grade level on students' perceptions of the classroom environment.

Participants were elementary school students in a large urban school district in the western part of the US. Data collected were based on test scores on the Washington Assessment of Student Learning (WASL) and scores on the My Classroom Inventory (MCI) to measure perceptions. Correlation analyses and multivariate analysis of variance (MANOVA) procedures were used to analyse the data. The results indicated that the perceptions of the general classroom environment were significantly related to math and reading achievement, although this was not the case for the individual dimensions of the classroom environment. Gender had no statistically significant association with the students' perceptions of the classroom environment, whereas the grade level had a statistically significant relationship with the perceptions.     

What verbal protocols reveal about the reading strategies of deaf students: a replication study

Deaf students' reading strategies were identified by investigating these students' self-reported thinking during reading. In an earlier study (Schirmer, 2003), 10 elementary-level students attending a state school for the deaf had constructed meaning, monitored comprehension and activated strategies to improve comprehension, and evaluated comprehension, but had not demonstrated each of the reading strategies within these three overarching activities, all observed in previous studies of hearing skilled readers. Also, the students used a considerably greater variety of reading strategies for constructing meaning than for the other two activities. The replication study used the same procedure. Six elementary-level students attending a site-based public school classroom for deaf students thought aloud after reading each page of a short story. Analysis of these verbal reports indicated the participants performed similarly to those in the first study, thus supporting the reliability of results regarding reading strategies of readers who are deaf.     

Use of systemic networks in the development of a questionnaire

The paper discusses the use of systemic networks as a basis for the construction of a questionnaire. The subject of the questionnaire was teachers' views of the philosophy of science. It is argued that systemic networks have potential value in questionnaire construction in such problematic areas, offering help in dealing with both construct and face validity.

The networks used, and the questionnaire based on them, were derived from an analysis of various philosophical positions. The analysis identified distinctions depicting the main philosophical differences, which were then represented in a network. The main systems described are inductivism, hypothetico‐deductivism (e.g., Popper, Lakatos), contextualism (e.g., Kuhn) and relativism (e.g., Feyerabend). Major distinctions turn on the issues of the unity of scientific method, criteria of demarcation, patterns of scientific change and the status of scientific knowledge.     

Within-year oral reading fluency with CBM: a comparison of models

This study examined the type of growth model that best fit within-year growth in oral reading fluency and between-student differences in growth. Participants were 2,465 students in grades 3–5. Hierarchical linear modeling (HLM) analyses modeled curriculum-based measurement (CBM) oral reading fluency benchmark measures in fall, winter, and spring with grade level and student characteristics (including special education and Limited English Proficiency status) as covariates. Results indicated that a discontinuous growth model fit the data better than a linear growth model, with greater growth in the fall than in the spring. Oral reading fluency growth rates also differed by grade and student characteristics. Implications for school practice and research are discussed.     

Students' views on the efficiency of instruction: An exploratory survey of the instructional metacognitive knowledge of university freshmen

Students have conceptions about the relationship between instructional interventions and learning or, in other words, students have instructional metacognitive knowledge. In this study, the efficiency of instructional interventions has been investigated as a specific object of students' instructional metacognitive knowledge. By means of a survey, conceptions about the efficiency of various instructional interventions of 488 freshmen in educational sciences and psychology have been investigated. Two research questions directed this exploratory study: (1) How do students assess the efficiency of instructional interventions; and (2) Do differences in gender, educational background, and/or subject of study affect evaluations of the efficiency of instructional interventions. Results show that respondents regard regular instructional interventions at the university directed toward, or supporting, surface-level processing and reproduction to be highly efficient. The use of technology is conceived as inefficient by these students. The limited number of differences between groups of students also suggests students' conceptions to be both consistent and robust.The study illustrates the need to investigate instructional metacognitive knowledge as distinct from other forms of metacognitive knowledge, and raises questions about the major components and structure of instructional metacognitive knowledge and individual differences in it. The findings suggest the need for the elaboration of a framework to describe instructional interventions.