Evaluation of education quality and neighbourhood well-being: a case study of Independencia,Peru

Information systems can play a vital role in supporting the planning and management of development programs and, as such, they are fundamental to improving people’s health, education, training, and enhancing the transparency of decisions and actions taken by public and private agencies in these and other domains. This paper examines how information systems in general, and geographic information systems (GIS) in particular, can contribute to an understanding of local educational contexts and needs through the provision of information tools that bridge national-level goals and policy to local-level action and outcomes. First, utilising the frameworks from global initiatives such as Education for All and A Framework for Action, direction is provided as to what types of data are required to evaluate education systems and education quality, especially given the absence of detailed local-level data. Second, the relationship between neighbourhood context and the quality of education is assessed. Third, the available educational and contextual information for a case study in the urban district of Independencia, Peru is described. Utilising information available at the local level and general international frameworks, a method is outlined for the analysis of education quality and neighbourhood well-being and is applied to the case of Independencia, Peru.     

Reading literacy in Compulsory Secondary Education: an exploration of the difficulties in the use of information to answer questions / La competencia lectora en la Educación Secundaria Obligatoria: descripción y dificultades del uso de información para responder preguntas

Abstract

This paper is a review of studies about processes and secondary school students’ difficulties with these processes when they use information to answer questions. The PISA program uses this kind of task-oriented reading situation to evaluate reading literacy, which is also a common reading situation in educational settings. Four key strategies are identified to successfully perform this kind of task: decide how to read the information, comprehend the task, decide when to search for information in order to solve the task, and self-regulate that search process. Moreover, this paper provides accurate information about the students’ difficulties in becoming skilled readers when they use information to answer questions. This information might help teachers and educational counselors in the design of interventions to improve reading literacy in schools.     

Text-signaling devices and their effects on reading and memory processes

Signals are writing devices that emphasize aspects of a text's content or structure without adding to the content of the the text. Findings are reviewed for studies of several different types of signaling devices, including: titles, headings, previews, overviews, summaries, typographical cues, recall sentences, number signals, importance indicators, and summary indicators. Most investigations have examined how the presence of signals in a text affects subsequent memory for the text. Virtually all types of signals produce better memory for information they cue in a text, whereas memory for unsignaled information often is unaffected. Less attention has been directed to signaling effects on other cognitive processes, such as attention, basic reading processes, and comprehension. It is argued that an understanding of how signals influence these processes will contribute to the application of signaling research to reading and writing instruction and to our general understanding of reading.     

Evolutionary Maps: A new model for the analysis of conceptual development,with application to the diurnal cycle

This paper presents a model of how children generate concrete concepts from perception through processes of differentiation and integration. The model informs the design of a novel methodology (evolutionary maps or emaps), whose implementation on certain domains unfolds the web of itineraries that children may follow in the construction of concrete conceptual knowledge and pinpoints, for each conception, the architecture of the conceptual change that leads to the scientific concept. Remarkably, the generative character of its syntax yields conceptions that, if unknown, amount to predictions that can be tested experimentally. Its application to the diurnal cycle (including the sun's trajectory in the sky) indicates that the model is correct and the methodology works (in some domains). Specifically, said emap predicts a number of exotic trajectories of the sun in the sky that, in the experimental work, were drawn spontaneously both on paper and a dome. Additionally, the application of the emaps theoretical framework in clinical interviews has provided new insight into other cognitive processes. The field of validity of the methodology and its possible applications to science education are discussed.     

The Competence Screening Questionnaire for Higher Education: Adaptable to the needs of a study programme

There is a lively discussion on how to evaluate competence-based higher education in both evaluation and competence research. The instruments used are often limited to course evaluation or specific competences, taking a rather narrow perspective. Furthermore, the instruments often comprise predetermined competences that cannot be adapted to higher education needs. The aim of this paper is to provide a flexible screening instrument into which practitioners/evaluators of study programmes can themselves insert the competences they are interested in, i.e. competences students ought to acquire through their study programme. The present study describes the development of the Competence Screening Questionnaire for Higher Education (CSQ-HE) in different domains of higher education. Results show that the CSQ-HE provides plausible screening information whilst fulfilling evaluation standards. It can be integrated into a higher education institution’s internal quality management system to demonstrate a programme’s legitimacy and enhance competence-based teaching and learning. Strengths, weaknesses and implications for practice are discussed.     

Linking Physical and Numerical Modelling in Hydrogeology using Sand Tank Experiments and COMSOL Multiphysics

Visualising subsurface processes in hydrogeology and building intuition for how these processes are controlled by changes in forcing is hard for many undergraduate students. While numerical modelling is one way to help undergraduate students explore outcomes of multiple scenarios, many codes are not user‐friendly with respect to defining domains, boundary conditions, and coupling processes, and numerical modelling exercises are also often disconnected from systems that the students understand, limiting their ability to extrapolate what they have learned for other situations. Here, we test the hypothesis that hydrogeology students will better estimate rates of groundwater flow and contaminant transport and the magnitudes of the parameters that control flow and transport by linking physical and numerical models. We present an exercise that links physical and numerical modelling of fluid flow and solute transport using 2‐D ‘ant farm’ sand tanks with parallel models in COMSOL Multiphysics. The sand tank exercises provide students with a way to visualise subsurface flow and transport processes, while COMSOL allows them to explicitly pull apart the mathematics associated with these systems and build intuition for their solutions. Given coupled experimentation and numerical exercises, we find that students will connect processes that they see in the laboratory with the outcomes of numerical models, and the post‐exercise tests indicate that they have an improved understanding of: (1) the magnitude and importance of properties and parameters that control flow and transport and (2) the simplifications made in numerical models of physical systems.     

Dyslexic children show deficits in implicit sequence learning,but not in explicit sequence learning or contextual cueing

Dyslexia is a specific learning disability characterized by difficulties with accurate and/or fluent word recognition and by poor spelling abilities. The absence of other high level cognitive deficits in the dyslexic population has led some authors to propose that non-strategical processes like implicit learning could be impaired in this population. Most studies have addressed this issue by using sequence learning tasks, but so far the results have not been conclusive. We test this hypothesis by comparing the performance of dyslexic children and good readers in both implicit and explicit versions of the sequence learning task, as well as in another implicit learning task not involving sequential information. The results showed that dyslexic children failed to learn the sequence when they were not informed about its presence (implicit condition). In contrast, they learned without significant differences in relation to the good readers group when they were encouraged to discover the sequence and to use it in order to improve their performance (explicit condition). Moreover, we observed that this implicit learning deficit was not extended to other forms of non-sequential, implicit learning such as contextual cueing. In this case, both groups showed similar implicit learning about the information provided by the visual context. These results help to clarify previous contradictory data, and they are discussed in relation to how the implicit sequence learning deficit could contribute to the understanding of dyslexia.     

Observing response processes with eye tracking in international large-scale assessments: evidence from the OECD PIAAC assessment

This paper reports on a pilot study that used eye tracking techniques to make detailed observations of item response processes in the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The lab-based study also recorded physiological responses using measures of pupil diameter and electrodermal activity. The study tested 14 adult respondents as they individually completed the PIAAC computer-based assessment. The eye tracking observations help to fill an ‘explanatory gap’ by providing data on variation in item response processes that are not captured by other sources of process data such as think aloud protocols or computer-generated log files. The data on fixations and saccades provided detailed information on test item response strategies, enabling profiling of respondent engagement and response processes associated with successful performance. Much of that activity does not include the use of the keyboard and mouse, and involves ‘off-screen’ use of pen and paper (and calculator) that are not captured by assessment log-files. In conclusion, this paper points toward an important application of eye tracking in large-scale assessments. This includes insights into response processes in new domains such as adaptive problem-solving that aim to identify individuals’ ability to select and combine resources from the digital and physical environment.     

School Climate: a Review of the Construct,Measurement, and Impact on Student Outcomes

The construct of school climate has received attention as a way to enhance student achievement and reduce problem behaviors. The purpose of this article is to evaluate the existing literature on school climate and to bring to light the strengths, weakness, and gaps in the ways researchers have approached the construct. The central information in this article is organized into five sections. In the first, we describe the theoretical frameworks to support the multidimensionality of school climate and how school climate impacts student outcomes. In the second, we provide a breakdown of the four domains that make up school climate, including academic, community, safety, and institutional environment. In the third, we examine research on the outcomes of school climate. In the fourth, we outline the measurement and analytic methods of the construct of school climate. Finally, we summarize the strengths and limitations of the current work on school climate and make suggestions for future research directions.     

Learning to Predict and Explain: An Integration of Similarity-Based,Theory-Driven,and Explanation-Based Learning

We analyze the types of information that human learners rely on in the acquisition of predictive and explanatory knowledge. We present OCCAM, a computational model of this learning task that integrates three learning methods: similarity-based learning (SBL), explanation-based learning (EBL), and theory-driven learning (TDL). We focus on the strengths and weaknesses of each learning method and describe how they can be integrated in a complementary fashion. The goal of this integration is to provide a learning architecture that accounts for the effects of prior knowledge on human learning. The integration helps to explain how a learner can learn rapidly when new experiences are consistent with prior knowledge while still retaining the ability to learn in novel domains (although more slowly). In addition, we present experimental evidence that an integrated model converges on accurate concepts more rapidly than either method applied individually. OCCAM is unique among learning models in that it can make use of data-intensive learning methods to acquire the knowledge needed for knowledge-intensive learning.     

Metacognition,comprehension monitoring,and the adult reader

This article provides an overview and synthesis of the current literature on metacognition and comprehension monitoring among adult readers. It is organized around three major research questions: (1) How do adults conceptualize their own comprehension-fostering and comprehension-monitoring activities? (2) How effectively do adults evaluate and regulate their ongoing efforts to understand? (3) How successfully do adults assess the final products of their comprehension efforts? Cutting across these broad issues are questions concerning metacognitive differences as a function of reading ability, academic success, domain expertise, developmental level, and task variables. The research reveals that adults' conceptions of how they comprehend and how they monitor their comprehension are quite variable. In general, those who have more expertise, who are better readers, and who are more successful students seem to have greater awareness and control of their own cognitive activities while reading. The research also reveals that adults evaluate and regulate their ongoing efforts to understand, although there is considerable room for improvement in these skills. Finally, the research shows that adults are remarkably unsuccessful at assessing how well they have comprehended a text and whether or not they are ready to take a test on the material. The article closes with a discussion of recent intervention efforts aimed at enhancing the metacognitive skills of adult readers.     

Curriculum Mapping: A Before‐and‐After Look at Faculty Perceptions of Their Courses and the Mapping Process

The increased interest in program‐ and university‐level assessment over the past few decades has led to increased faculty involvement in developing program learning outcomes and performing program assessment activities. Depending on the level of support and encouragement faculty receive from administration and other entities, they may support or resist these activities. Faculty resistance may stem from fear of losing control of their course content, discouragement over previous failed assessment attempts, or confusion from inconsistent leadership. The School of Food Science, a joint program between the Washington State University and the University of Idaho, recently completed a curriculum mapping and assessment exercise that was conducted entirely by faculty. Faculty members teaching undergraduate courses were surveyed about their opinions of the mapping and assessment process both before and after the process was conducted. The goal of the surveys was to evaluate faculty opinion of these processes and how that opinion changed after completing the processes. Faculty members were generally supportive of the mapping and assessment processes, and willing to participate, and this opinion did not change after the processes were complete. The results of the mapping and assessment activities surprised most of the faculty, and they stated that they had ideas to address the issues found during the exercises. Overall, these results are encouraging in terms of faculty support of the mapping and assessment processes. Provided that administrative support of these processes continues and there is consistent leadership, faculty should continue to be supportive of program level assessment.     

Supporting learning with interactive multimedia through active integration of representations

When learners explore dynamic and interactive visualisations they are often not able to interact with them in a systematic and goal-oriented way. Frequently, even supporting learners in processes of discovery learning does not lead to better learning outcomes. This can be due to missing pre-requisite knowledge such as the coherent mental integration of the pictorial and symbolic sources of information. In order to support learners in this process, we encouraged them to interactively and externally relate different static sources of information to each other before exploring dynamic and interactive visualisations. We evaluated the benefit of this instructional support in two experimental studies concerning the domains of statistics and mechanics. It revealed that the active integration of static representations before processing dynamic visualisations resulted in better performance and can provide a basis for a more systematic and goal-oriented experimentation behaviour during simulation-based discovery learning.in final form: 16 November 2004     

Exploring metacognitive strategy use during note-taking for students with learning disabilities

This mixed-methods study analysed over 200 interviews from 20 seventh-grade students with learning disabilities (LD). Students were instructed how to use a note-taking intervention during science lectures. The interview analyses were supported by pre- and post-intervention quantitative data. Data suggest that the intervention helped students identify important information; systematised the process of listening to, interpreting and using that information; and offered students a means by which to organise the information they were hearing. A discussion about metacognition and attention explores how these processes altered students’ awareness of their own learning, as well as how they equipped students with a new strategy for holding onto and translating information from their science lectures into a useful set of notes. These findings have implications for how theorists conceptualise the relationship between metacognition and attention and how teachers use scaffolding to support the learning of students with LD.     

Elementary science textbooks: Their contents,text characteristics,and comprehensibility

The purpose of this article is to present findings from a systematic analysis of elementary-school science textbooks. Comparisons of content domains and vocabulary are presented for the Merrill (1982) and Silver-Burdett (1985) science programs, grades 1–5 as well as the fourth-grade Holt (1980) and fifth-grade McGraw-Hill (1974) texts. Analyses of how each publisher presents information, types of questions, and various text characteristics reveal striking differences between programs. Systematic comparisons of content domains between programs also reveal few instances of “inconsiderate” texts. The textbooks analyzed were selected because they are used in the three school districts participating in our longitudinal study. Results are discussed in light of the differences found between programs regarding textbook content and opportunity to learn, the greater amounts of text and activities within each program, and teachers' probable uses of textbooks, the long-term results of students' exposure to various textbooks, and the need for careful examination of materials in order to determine their quality.     

Talking to children about science is harder than we think: characteristics and metacognitive judgments of explanations provided to children and adults

Adults modify the way they speak to children to support children’s learning across several domains. However, no previous research has studied whether adults change their language when explaining science to children. The current study examined if and how adults change the manner in which they talk about science when providing explanations to children vs. providing explanations to other adults. Participants (N = 81) were video recorded while explaining basic science concepts to children and adults. Recordings were later analyzed to determine if and how participants changed the quality and content of their explanations. The results confirmed that adults did change their explanations when talking to children about science by providing more potentially beneficial, but also disadvantageous, information. Participants perceived that they provided more accurate explanations to children, but appeared to be making metacognitive judgments largely based upon the changes made that could be beneficial to learning. Taken together, this work suggests that science may be a domain in which adults are not well equipped to modify and monitor their language to children.     

Aggression and moral development: integrating social information processing and moral domain models

Social information processing and moral domain theories have developed in relative isolation from each other despite their common focus on intentional harm and victimization, and mutual emphasis on social cognitive processes in explaining aggressive, morally relevant behaviors. This article presents a selective summary of these literatures with the goal of showing how they can be integrated into a single, coherent model. An essential aspect of this integration is Crick and Dodge's (1994) distinction between latent mental structures and online processing. It is argued that moral domain theory is relevant for describing underlying mental structures regarding the nature and boundaries of what is moral, whereas the social information processing model describes the online information processing that affects application of moral structures during peer interactions.     

Doctoral Comprehensive Exams: Standardization,Customization, and Everywhere in Between

Comprehensive examinations mark one of the final student assessments within doctoral programs. Despite the presumed importance of this process, little is known about how it is carried out within the field of criminology and criminal justice. This study examined the structure of comprehensive exams in relevant doctoral programs. The findings reveal considerable variation in how programs organize comprehensive exams. This variation might suggest that programs vary in the objectives they associate with the comprehensive exam process, though other explanations are possible. The discipline may need to open a dialogue on the goals and objectives driving these processes to better understand their fit within doctoral education.     

A protocol analysis of the influence of technology on students' actions,verbal commentary,and thought processes during the performance of acid-base titrations

We investigated students' initial and final understanding of acid-base concepts and their concurrent thought processes and actions during the process of acid-base titrations. Here we report students' actions and thought processes while titrating. Different levels of information were presented by three technologies: chemical indicators, pH meters, and microcomputer-based laboratories. We speculated that the level of information would influence students' actions and thought processes, as expressed in verbal commentary. Data were collected from 14 secondary chemistry students. Each student used one technology to titrate a strong acid, a weak acid, and a polyprotic acid with a strong base. They verbalized their thoughts while titrating. Students then graphed pH versus volume of base and discussed the titration with the investigator. Verbal commentaries were coded and analyzed for patterns in actions and for frequency of statement categories. Drawings were analyzed for shape, scale, and direction; discussions were analyzed for understanding of acid-base neutralization. We found that the technology's level of information affected the focus of students' observations. The microcomputer group focused primarily on the graph; other groups exhibited multiple foci. We speculate the screen display functions as an auxiliary short-term memory. The discussion data also reveal that students held three main ideas about how acids and bases behave when mixed. Implications for instruction are discussed.     

Domain-specific knowledge and memory performance in children

Developmental studies assessing the impact of domain-specific knowledge on memory are discussed. In the first section of the review, different ways through which domain-specific knowledge relates to strategy use in memory tasks are briefly summarized. Empirical evidence indicating nonstrategic effects of the knowledge base are discussed next. In particular, findings based on the expert-novice paradigm are used to compare the knowledge structure and memory performance of experts and novices of different ages, and to explore how individual differences relate to the acquisition and use of domain-specific knowledge. The review shows that domain-specific knowledge permits children to process and remember domain-related information more efficiently, apply strategies more effectively, and integrate novel information more easily than domains for which they have less detailed knowledge. If the knowledge base is particularly rich, it exerts a greater influence than other sources of memory development (i.e., memory capacity, strategies, and metamemory) combined.