Analysing Concept Maps as an Assessment Tool in Teaching Physics and Comparison with the Achievement Tests

Concept mapping is a technique that paves the way to represent knowledge schematically. In this research, concept mapping was used as an assessment method on the impulse–momentum topic. The purpose of this study was to determine teacher candidates’ knowledge about understanding of the concepts of impulse and momentum by comparing and contrasting two different methods; namely, students’ concept maps and an achievement test. The mean of teacher candidates’ concept map scores are extremely low when compared with the scores of the achievement test. In addition, it was seen that although a great number of concepts were written down, not many relationships were established between these concepts. There is a weak correlation between the achievement test and the concept map scores since concept maps assess the students’ knowledge from a conceptual perspective while the achievement tests measure the level of students’ knowledge on the topic and his/her ability to apply this knowledge on different occasions.     

Supporting the Learning Process with Collaborative Concept Mapping Using Computer-Based Communication Tools and Processes

University students are too often challenged by their limited skills in application, investigation, relational thinking, and communication of ideas. In this study, we have combined 3 tools that potentially can support and foster students’ development in the above mentioned areas through student collaboration, concept mapping, and electronic technologies. The participants in this study were 26 students in two intact classes in learning theories. In groups of 3 to 5 students, they were asked to generate 3 concept maps and accompanying prose over the term on 3 major issues in the field of learning. Through the use of interviews, questionnaires, and student generated concept maps, students reportedly enjoyed concept mapping for its organizational and relational properties but preferred sharing their concept maps and dialoguing with one another in a synchronous mode where immediate feedback and flow of thinking could be maintained when involved in constructing maps. Moreover, they did not like the redundancy offered by both prose and concept map outputs, suggesting that while concept mapping can be an arena for generating and generally structuring ideas, prose can be a means of communicating such ideas in a form that is common to most people. This is particularly important for teachers and students who have difficulty navigating through maps alone.     

Development of software to support argumentative reading and writing by means of creating a graphic organizer from an electronic text

This paper describes the development of a software program that supports argumentative reading and writing, especially for novice students. The software helps readers create a graphic organizer from the text as a knowledge map while they are reading and use their prior knowledge to build their own opinion as new information while they think about writing their essays. Readers using this software can read a text, underline important words or sentences, pick up and dynamically cite the underlined portions of the text onto a knowledge map as quotation nodes, illustrate a knowledge map by linking the nodes, and later write their opinion as an essay while viewing the knowledge map; thus, the software bridges argumentative reading and writing. Sixty-three freshman and sophomore students with no prior argumentative reading and writing education participated in a design case study to evaluate the software in classrooms. Thirty-four students were assigned to a class in which each student developed a knowledge map after underlining and/or highlighting a text with the software, while twenty-nine students were assigned to a class in which they simply wrote their essays after underlining and/or highlighting the text without creating knowledge maps. After receiving an instruction regarding a simplified Toulmin’s model followed by instructions for the software usage in argumentative reading and writing along with reading one training text, the students read the target text and developed their essays. The results revealed that students who drew a knowledge map based on the underlining and/or highlighting of the target text developed more argumentative essays than those who did not draw maps. Further analyses revealed that developing knowledge maps fostered an ability to capture the target text’s argument, and linking students’ ideas to the text’s argument directly on the knowledge map helped students develop more constructive essays. Accordingly, we discussed additional necessary scaffolds, such as automatic argument detection and collaborative learning functions, for improving the students’ use of appropriate reading and writing strategies.

     

Semantic networking: The new kid on the block

This article briefly describes the SemNet? software and some of its uses as an educational and research tool, with emphasis on the similarities and differences between concept mapping and semantic networking. A semantic network captures (in part) each concept's position in psychological space, identifying both the other concepts to which it is connected and the nature of the links that bind them. Computer-based semantic networks differ from paper-and-pencil maps in that they are n-dimensional; each concept can be linked to many other concepts; relations are bidirectional; representations can include images, text, and sound; and nets can be very large. Disadvantages of SemNet? networks include (a) the difficulties in obtaining a clear overview and (b) the homogeneous nature of the representations, in which all links look alike. Advantages include the ability to integrate ideas across a large knowledge base, the ease and rapidity of net creation, the ease with which elements (concepts, relations, or propositions) can be found within nets, and the utility of nets as self-study tools. Concept mapping and semantic networking are complementary strategies that can be used effectively in tandem to help students learn, to help teachers teach, and to support cognitive research.     

Exploring evidence of reflective thinking in student artifacts of blogging-mapping tool: a design-based research approach

Reflective learning can assist a learner’s purposeful and conscious manipulation of ideas toward meaningful learning and knowledge integration. Blogs have been used to support reflection, but Blogs usually do not provide overt mechanisms for students to make connections between different parts of an experience, which is integral to reflective activity. A blogging-mapping tool was designed to support the reflective learning process. The tool allowed students to write blog posts, attach up to five keywords to each post, and link the keywords on a concept map. This study aimed to seek patterns of participants’ use of the tool, including evidence of reflective learning, identified as integration between concept maps and blogs. Nine graduate students participated in the study for a semester. Data analysis included examining concept maps for knowledge integration over time. Participants’ various mapping activities implied different levels of thinking. Some participants’ final concept maps showed signs that they tried to integrate knowledge around the content area. Yet, the inconsistent and inconclusive patterns of participants’ concept mapping activities signaled that more strategies were needed to sustain their commitment.     

Problems and issues in the use of concept maps in science assessment

The search for new, authentic science assessments of what students know and can do is well under way. This has unearthed measures of students' hands-on performance in carrying out science investigations, and has been expanded to discover more or less direct measures of students' knowledge structures. One potential finding is concept mapping, the focus of this review. A concept map is a graph consisting of nodes representing concepts and labeled lines denoting the relation between a pair of nodes. A student's concept map is interpreted as representing important aspects of the organization of concepts in his or her memory (cognitive structure). In this article we characterize a concept map used as an assessment tool as: (a) a task that elicits evidence bearing on a student's knowledge structure in a domain, (b) a format for the student's response, and (c) a scoring system by which the student's concept map can be evaluated accurately and consistently. Based on this definition, multiple concept-mapping techniques were found from the myriad of task, response format, and scoring system variations identified in the literature. Moreover, little attention has been paid to the reliability and validity of these variations. The review led us to arrive at the following conclusions: (a) an integrative working cognitive theory is needed to begin to limit this variation in concept-mapping techniques for assessment purposes; (b) before concept maps are used for assessment and before map scores are reported to teachers, students, the public, and policy makers, research needs to provide reliability and validity information on the effect of different mapping techniques; and (c) research on students' facility in using concept maps, on training techniques, and on the effect on teaching is needed if concept map assessments are to be used in classrooms and in large-scale accountability systems. © 1996 John Wiley & Sons, Inc.     

Comparison of the reliability and validity of scores from two concept‐mapping techniques*

This paper reports the results of a study that compared two concept‐mapping techniques, one high‐directed, “fill‐in‐the‐map,” and one low‐directed, “construct‐a‐map‐from‐scratch.” We examined whether: (1) skeleton map scores were sensitive to the sample of nodes or linking lines to be filled in; (2) the two types of skeleton maps were equivalent; and (3) the two mapping techniques provided similar information about students' connected understanding. Results indicated that fill‐in‐the‐map scores were not sensitive to the sample of concepts or linking lines to be filled in. Nevertheless, the fill‐in‐the‐nodes and fill‐in‐the‐lines techniques were not equivalent forms of fill‐in‐the‐map. Finally, high‐directed and low‐directed maps led to different interpretations about students' knowledge structure. Whereas scores obtained under the high‐directed technique indicated that students' performance was close to the maximum possible, the scores obtained with the low‐directed technique revealed that students' knowledge was incomplete compared to a criterion map. We concluded that the construct‐a‐map technique better reflected differences among students' knowledge structure. © 2001 John Wiley & Sons, Inc. J Res Sci Teach 38: 260–278, 2001     

A three-tier system for assessing concept map links: a methodological study

A novel method is described for analysing concept maps for research and analysis purposes. The coding system rates the use, the stability, and the complexity of each link, which is a unique way of representing students' knowledge. The analysis scheme affords a look at how students may integrate new knowledge into their existing structures and may be used for assessment purposes or research on how students learn. This coding system was successfully applied to a sample of 56 complex concept maps that had been generated from student interviews on the topic of chemical bonding. The coding system is of particular use when analysing complex concept maps with a large number of concept nodes and links. The system described here was also particularly useful for assessing complex, non-hierarchical concept maps.     

A time sequence-oriented concept map approach to developing educational computer games for history courses

Concept maps have been recognized as an effective tool for students to organize their knowledge; however, in history courses, it is important for students to learn and organize historical events according to the time of their occurrence. Therefore, in this study, a time sequence-oriented concept map approach is proposed for developing a game-based environment to facilitate students' learning of historical events and their organization during the gaming process. With this approach, students can easily learn the precedence relationships among the historical events that occurred in different time periods with the time sequence-oriented concept map. To evaluate the effectiveness of the proposed approach, a historical role-playing game has been developed for an elementary school history course to examine the students' performance in terms of learning motivation, self-efficacy and learning achievements. A subject unit, the “Siege of Fort Zeelandia by Zheng Cheng-Gong,” was chosen as the history topic. The results show that the proposed approach can significantly enhance the students' learning achievement, but did not affect their learning motivation or self-efficacy for the history course. As a consequence, it is concluded that students can benefit from concept maps in terms of enhancing their learning achievement, but they do not necessarily enjoy using concept maps in game-based learning activities.     

An Investigation of Concept Mapping to Improve the Reading Comprehension of Science Texts

This study investigated how well 74 6th-grade science students represented text structures from a 900-word textbook chapter on soil conservation, given a concept map template with four superordinate terms and 24 unsorted concepts. Findings suggest students were more successful at classifying pre-selected terms under given superordinate categories than they were at fully identifying relevant concept sets and articulating three different relationship types between terms. No significant differences were noted in the mapping performance of students at different reading levels. About two-third of students indicated they enjoyed concept mapping and would prefer to both read and map rather than just read without mapping. Students also expressed a strong preference for mapping in pairs or small groups compared to mapping alone. Multiple recommendations are provided for improving the relational thinking of students tasked with concept mapping expository science texts, including bridging to more open-ended maps, embedding mapping in longer-term inquiry projects, and leveraging collaborative and tool-based scaffolds.     

Effects of Knowledge Maps and Prior Knowledge on Recall of Science Lecture Content

The effects of three types of lecture aids on students' recall of two college-level biology lectures were compared. Students heard audiotaped lectures while viewing either knowledge maps, outlines, or lists of the key terms presented on overhead transparencies. Free-recall tests revealed that listeners with low prior knowledge of biology learned the most when knowledge maps accompanied the lecture and the least when key terms were listed. For listeners with high prior knowledge, however, the opposite was true. An analysis of recall coherence revealed that learners recalled significantly fewer fragmented facts after viewing maps or outlines than after viewing lists. Prior knowledge was a significant factor in all analyses. Results are interpreted in terms of Mayer's cognitive model of assimilation encoding.     

The Synthesis Map Is a Multidimensional Educational Tool That Provides Insight into Students’ Mental Models and Promotes Students’ Synthetic Knowledge Generation

Concept mapping was developed as a method of displaying and organizing hierarchical knowledge structures. Using the new, multidimensional presentation software Prezi, we have developed a new teaching technique designed to engage higher-level skills in the cognitive domain. This tool, synthesis mapping, is a natural evolution of concept mapping, which utilizes embedding to layer information within concepts. Prezi’s zooming user interface lets the author of the presentation use both depth as well as distance to show connections between data, ideas, and concepts. Students in the class Biology of Cancer created synthesis maps to illustrate their knowledge of tumorigenesis. Students used multiple organizational schemes to build their maps. We present an analysis of student work, placing special emphasis on organization within student maps and how the organization of knowledge structures in student maps can reveal strengths and weaknesses in student understanding or instruction. We also provide a discussion of best practices for instructors who would like to implement synthesis mapping in their classrooms.     

Preschoolers' Understanding of Plan and Oblique Maps: The Role of Geometric and Representational Correspondence

To study conditions that affect preschoolers' understanding of maps, we asked 4-and 5-year-olds to place stickers on classroom maps to show locations of objects currently in view. Varied were vantage point (eye level vs. raised oblique), map form (plan vs. oblique), and item type (floor vs. furniture locations). Even though they were working with maps of a familiar referent space, preschoolers evidenced difficulty. While an oblique vantage point did not enhance performance, using the oblique map first aided subsequent performance on the plan map. As predicted, performance on floor locations was worse than on furniture locations. Findings are discussed in relation to performance by adults given the mapping task and preschoolers given a nonreferential sticker placement task. Data suggest the importance of ( a ) iconicity and ( b ) studying geometric as well as representational correspondences in map research.     

Understanding Learner-centredness: Does it consider the diverse needs of individuals?

In light of the significant changes happening in all sectors of our society, we in the education sector and in particular in the universities, have adopted a number of innovative ideas for delivering education. Many of these innovations deal with procedural aspects related to learning and consequently little concern has been shown to individuals' beliefs about knowledge and dispositions for learning. Beliefs and dispositions are powerful tools to effect a more meaningful and sustainable change to how individuals engage in learning. This paper discusses some recent findings from research into university students' beliefs about the nature of knowledge and their conceptions of learning, and identifies the implications for a learner-centred university education. Learners' beliefs both informal and formal may influence the way they approach learning. Do they learn to apply, or learn to understand? The effort they make to learn depends on their perception of how the learning will reward them. The paper also explores the cross-cultural beliefs about knowledge and conceptions of learning.     

The Knowledge Arena as an Extension to the Concept Map: Reflection in Action

The concept map is becoming a ubiquitous tool in education. In recent years there has been a growing interest in “diagramming” or “mapping” ideas to be learned (e.g., Jonassen et al., 1998). The approach has been championed by study skills proponents such as Buzan (1993). Maps of concepts and relationships have been used by many researchers and practitioners to help diagnose misunderstanding, improve study methods and glimpse how learners come to know. In other areas, the representation of knowledge in formalisms such as the Net greatly assisted the development of intelligent tutoring systems (e.g., Sowa, 1983). In order to better understand the claims made for its efficacy, reference to how concept maps have been used and defined will lead to a plausible explanation of the process of “off–loading” of concepts during learning or study (McAleese, 1994, 1998). In order to demonstrate the widespread application of supporting learn ers with external “learning spaces” (c.f. ISLEs/ and REALs—Grabinger et al., 1998; Grabinger & Dunlap, 1995; MacFarlane, 1993), consideration will be given in this paper to techniques that formally represent knowledge in Concept–Relationship–Concept “instances” (Fisher et al., 1990). Other techniques such as reflection journals draw on the same process but are not considered in detail here. The importance of self regulation (Zimmerman, 1990) and self-confrontation (McAleese, 1985) is highlighted in this framework. The map as a mirror or an assistant to learners is well documented (e.g., Vizcarro & Leon, 1998); the question of an external representation of thinking, in the form of a map determining what can be learned as well as what might be learned, is not yet fully known.     

How well do middle school science programs measure up? Findings from Project 2061's curriculum review

The purposes of this study were to examine how well middle school programs support the attainment of key scientific ideas specified in national science standards, and to identify typical strengths and weaknesses of these programs using research‐based criteria. Nine widely used programs were examined by teams of teachers and specialists in research on teaching and learning. Reviewers found that whereas key ideas were generally present in the programs, they were typically buried between detailed or even unrelated ideas. Programs only rarely provided students with a sense of purpose for the units of study, took account of student beliefs that interfere with learning, engaged students with relevant phenomena to make abstract scientific ideas plausible, modeled the use of scientific knowledge so that students could apply what they learned in everyday situations, or scaffolded student efforts to make meaning of key phenomena and ideas presented in the programs. New middle school science programs that reflect findings from learning research are needed to support teachers better in helping students learn key ideas in science. The criteria and findings from this study on the inadequacies in existing programs could serve as guidelines in new curriculum development. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 522–549, 2002     

Accessing Prior Knowledge to Remember Text: A Comparison of Advance Organizers and Maps

Two theories, schema and dual coding, and the conjoint retention model were contrasted to explain the role of geographic familiarity and prior knowledge in map-passage retention. One hundred, eighty-six college students listened to a passage taking place in either a familiar or unfamiliar geographic domain and viewed either a map or no map of either of the two geographic areas. One-third of each group received either a general or specific advance organizer of the passage topic, or no organizer at all. Results revealed that maps function to bridge what learners already know about an area and what they need to remember from a passage. However, prior knowledge of geography is activated by the geographic propositions contained in a passage, with or without a map. Thus, maps serve a mnemonic function of imagery, but learners' prior knowledge of the geography of the map's space mediates the value of the map. Learners are able to generate an image of the map themselves if there are locational markers in the passage, and the geography of those markers are familiar.     

Using concept maps to elicit and study student teachers’ perceptions about inclusive education: a Tanzanian experience

In this study, concept map activities were used to trigger group discussions about inclusive education, with a focus on learners with disabilities. The participants were 226 Tanzanian student teachers. This article reports and discusses how the maps were analysed and what they indicate about the students’ thinking about certain aspects of inclusive education. The results also indicate that concept mapping as an activity in teacher education may be useful and engaging for students. It may help them to organise knowledge and make them aware of their own and others’ understanding of inclusive education practices. An analysis of concept maps constructed by student teachers may also help lecturers to identify views, misconceptions, knowledge gaps and insights about inclusion in education settings.