Relevance matters. Eighteen-month-olds’ use of relevant informative pointing as a predictor of two-year-olds’ language abilities / La relevancia es importante. El uso de gestos deícticos relevantes e informativos por parte de niños de año y medio como factor predictor de las capacidades lingüísticas a los dos años

Abstract

The significance of pointing gestures in the development of linguistic communication is linked to their referential character and formation of common ground in use of gestures and speech. Our longitudinal study aimed to define the nature of this relationship more precisely and to explore whether the relevance vs lack of relevance of a child’s pointing gestures is related to development of language abilities. We developed a special protocol to measure relevant and irrelevant pointing gestures in 18-month-olds, sampled production of spontaneous speech and measured their language comprehension at two years of age. A group of 343 children was tested, and using structural equation modelling we showed that relevant gestures predict the level of development of language production and comprehension. As predicted, this association was not applied to irrelevant gestures. It is likely that a child’s more frequent use of relevant pointing gestures helps the caregiver to recognize the child’s communicative intentions and to comment on his/her behaviour appropriately. The identified developmental/predictive relationship is valid in both mentalistic and teleological interpretation of early communicative development.     

Developing strategic readers: a multimodal analysis of a primary school teacher's use of speech,gesture and artefacts

Research on implementing reading strategy instruction has primarily focused on teachers' verbal communication with limited attention to other semiotic resources such as gesture and artefacts. In this paper, we construct a ‘telling case’ on the basis of how one primary teacher from the United States used speech, gesture and artefacts as a means of communication while instructing her students in reasons to predict when reading. Data sources for this case study consisted of field notes, artefacts and digital video. We analysed the teacher's use of gesture, speech and artefacts from a social semiotic multimodal perspective. Findings indicate that the teacher created meaning by interweaving multiple modes in the communicative contexts of strategy instruction using speech, deictic gestures, metaphoric gestures and artefacts. These findings are important to reading strategy instruction because much of the research and discussion of practice to date has centred on the instruction of reading strategies using teacher and student speech and not attending to the use of semiotic resources beyond speech.     

Engaging ADHD students in tasks with hand gestures: a pedagogical possibility for teachers

This study examines the effects of teachers' speech and hand gestures on the task performances of students with Attention‐Deficit/Hyperactivity Disorder (ADHD). Forty‐five 7½‐year‐old students clinically diagnosed with ADHD participated in the study. The students were asked to solve three sets of puzzles. The teachers supported the students in the tasks by using three different scaffolding modalities: speech‐only, gesture‐only and speech in conjunction with gestures. The results indicate that when the teachers used the scaffolding that contained gesture components (either speech scaffolding in conjunction with gesture scaffolding or gesture‐only scaffolding), the ADHD students were more responsive, focused longer on the tasks and were more successful in completing the tasks. Moreover, teachers' representational and deictic gestures were found to be the most effective gestures in scaffolding. This study suggests that when teachers' hand gestures are used together with speech, they are a powerful pedagogical means to engage ADHD children in tasks.     

Grounded blends and mathematical gesture spaces: developing mathematical understandings via gestures

This paper examines how a person’s gesture space can become endowed with mathematical meaning associated with mathematical spaces and how the resulting mathematical gesture space can be used to communicate and interpret mathematical features of gestures. We use the theory of grounded blends to analyse a case study of two teachers who used gestures to construct a graphical anti-derivative while working on a professional development task in a calculus modelling activity. Results indicate that mathematical gesture spaces can encourage mathematical experimentation, lighten the cognitive load for students and can be limited by a person’s physical constraints.     

A closer look at bilingual students’ use of multimodality in the context of an area comparison problem from a large-scale assessment

In this article, we use multimodality to examine how bilingual students interact with an area task from the National Assessment of Educational Progress in task-based interviews. Using vignettes, we demonstrate how some of these students manipulate the concrete materials, and use gestures, as a primary form of structuring their explanations and making mathematical meaning. We use our results as a basis to challenge the possible deficit perspective of bilingual students’ mathematical knowledge in current assessment practices. Choosing tasks that afford multiple modes of engagement and recognizing multimodal explanations in assessment practices has the potential to move us towards a better understanding of what bilingual students know and can do mathematically.     

Co-thought gestures: Supporting students to successfully navigate map tasks

This study considers the role and nature of co-thought gestures when students process map-based mathematics tasks. These gestures are typically spontaneously produced silent gestures which do not accompany speech and are represented by small movements of the hands or arms often directed toward an artefact. The study analysed 43 students (aged 10–12 years) over a 3-year period as they solved map tasks that required spatial reasoning. The map tasks were representative of those typically found in mathematics classrooms for this age group and required route finding and coordinate knowledge. The results indicated that co-thought gestures were used to navigate the problem space and monitor movements within the spatial challenges of the respective map tasks. Gesturing was most influential when students encountered unfamiliar tasks or when they found the tasks spatially demanding. From a teaching and learning perspective, explicit co-thought gesturing highlights cognitive challenges students are experiencing since students tended to not use gesturing in tasks where the spatial demands were low.     

Working with artefacts: gestures, drawings and speech in the construction of the mathematical meaning of the visual pyramid

This paper reports a part of a study on the construction of mathematical meanings in terms of development of semiotic systems (gestures, speech in oral and written form, drawings) in a Vygotskian framework, where artefacts are used as tools of semiotic mediation. It describes a teaching experiment on perspective drawing at primary school (fourth to fifth grade classes), starting from a concrete experience with a Dürer’s glass to the interpretation of a new artefact. We analyse the long term process of appropriation of the mathematical model of perspective drawing (visual pyramid) through the development of gestures, speech and drawings under the teacher’s guidance.

多模态语料库驱动的中国大学EFL教师课堂语伴手势的产出量研究

话语与伴随手势的数量协同问题长期缺乏实证研究数据支持。在功能协同（同样的语义和语用功能）、结构协同（同在支架话序中）的前提下,本研究使用语料库量化研究方法,探讨了语力话语形式（powerful language forms）与其伴随手势的数量协同机制。研究结果发现,在相同教学功能语境之下,语力话语与伴随手势数量比小于1.3:1大于1:1.3之间时,能实现最佳的交际效果;反之,则会对交际效果产生消极作用。     

Gestures and conceptual integration in mathematical talk

Spontaneous gesture produced in conjunction with speech is considered as both a source of data about mathematical thinking, and as an integral modality in communication and cognition. The analysis draws on a corpus of more than 200 gestures collected during 3 h of interviews with prospective elementary school teachers on the topic of fractions. The analysis examines how gestures express meaning, utilizing the framework of cognitive linguistics to argue that gestures are both composed of, and provide inputs to, conceptual blends for mathematical ideas, and a standard typology drawn from gesture studies is extended to address the function of gestures within mathematics more appropriately. Electronic supplementary material  The online version of the original article (doi:) contains supplementary material, which is available to authorized users.     

Characterizing Students’ Attempts to Explain Observations from Practical Work: Intermediate Phases of Understanding

This study aims to characterize a group of students’ preliminary oral explanations of a scientific phenomenon produced as part of their learning process. The students were encouraged to use their own wordings to test out their own interpretation of observations when conducting practical activities. They presented their explanations orally in the whole class after having discussed and written down an explanation in a small group. The data consists of transcribed video recordings of the presented explanations, observation notes, and interviews. A genre perspective was used to characterize the students’ explanations together with analysis of the students use of scientific terms, gestures, and the language markers “sort of” and “like.” Based on the analysis we argue to separate between event-focused explanations, where the students describe how objects move, and object-focused explanations, where the students describe object properties and interactions. The first type uses observable events and few scientific terms, while the latter contains object properties and tentative use of scientific terms. Both types are accompanied by an extensive use of language markers and gestures. A third category, term-focused explanations, is used when the students only provide superficial explanations by expressing scientific terms. Here, the students’ use of language markers and gestures are low. The analyses shows how students’ explanations can be understood as tentative attempts to build on their current understanding and observations while trying to reach out for a deeper and scientific way of identifying observations and building explanations and new ways of talking.     

了解儿童的手势比言语更重要

当儿童回答或是解释一个问题时，儿童总是在言语表达的同时还用手势来进行解释。当成人或者是教师在给儿童解释问题或是传递信息时，在用语言表达的同时也会用上手势。本文主要是给大家介绍手势在儿童的学习和交流过程中起着关键性的作用，尤其是通过手势对儿童所掌握知识状况的了解比从言语上更重要，以期望对儿童的教育和发展有所启示。     

The role of gestures in the mathematical practices of those who do not see with their eyes

In this paper, we aim to contribute to the discussion of the role of the human body and of the concrete artefacts and signs created by humankind in the constitution of meanings for mathematical practices. We argue that cognition is both embodied and situated in the activities through which it occurs and that mathematics learning involves the appropriation of practices associated with the sets of artefacts that have historically come to represent the body of knowledge we call mathematics. This process of appropriation involves a coordination of a variety of the semiotic resources??spoken and written languages, mathematical representation systems, drawings, gestures and the like??through which mathematical objects and relationships might be experienced and expressed. To highlight the connections between perceptual activities and cultural concepts in the meanings associated with this process, we concentrate on learners who do not have access to the visual field. More specifically, we present three examples of gesture use in the practices of blind mathematics students??all involving the exploration of geometrical objects and relationships. On the basis of our analysis of these examples, we argue that gestures are illustrative of imagined reenactions of previously experienced activities and that they emerge in instructional situations as embodied abstractions, serving a central role in the sense-making practices associated with the appropriation of mathematical meanings.     

Relating Gestures and Speech: An analysis of students' conceptions about geological sedimentary processes

Advances in cognitive science and educational research indicate that a significant part of spatial cognition is facilitated by gesture (e.g. giving directions, or describing objects or landscape features). We aligned the analysis of gestures with conceptual metaphor theory to probe the use of mental image schemas as a source of concept representations for students' learning of sedimentary processes. A hermeneutical approach enabled us to access student meaning-making from students' verbal reports and gestures about four core geological ideas that involve sea-level change and sediment deposition. The study included 25 students from three US universities. Participants were enrolled in upper-level undergraduate courses on sedimentology and stratigraphy. We used semi-structured interviews for data collection. Our gesture coding focused on three types of gestures: deictic, iconic, and metaphoric. From analysis of video recorded interviews, we interpreted image schemas in gestures and verbal reports. Results suggested that students attempted to make more iconic and metaphoric gestures when dealing with abstract concepts, such as relative sea level, base level, and unconformities. Based on the analysis of gestures that recreated certain patterns including time, strata, and sea-level fluctuations, we reasoned that proper representational gestures may indicate completeness in conceptual understanding. We concluded that students rely on image schemas to develop ideas about complex sedimentary systems. Our research also supports the hypothesis that gestures provide an independent and non-linguistic indicator of image schemas that shape conceptual development, and also play a role in the construction and communication of complex spatial and temporal concepts in the geosciences.     

Gesturing for oneself

Most research on gestures (especially in the field of Mathematics Education) has focused on gestures in communication with others. In contrast, here, we focus on gestures which are not directed at others, but which we assume accompany inner speech or embodied thought, such as the gesticulation one makes by touching one??s fingers whilst silently counting; that is, whilst thinking, or communicating with oneself. Typically, these gestures are accompanied by eye gaze, which is detached from others who are present and turned either inwards or towards relevant artefacts present. Additionally, these gestures??whilst structurally similar??are much smaller than ??normal?? gestures used in interpersonal communication, suggesting an attenuation parallel to that found in inner speech. These physical gestures are in effect objectifications for oneself, which we can interpret as a not-quite-yet ??underground?? part of embodied thought. We suggest that they might be particularly vital for understanding the imagistic, visuospatial dimension of mathematics in general and fractions in particular.     

The work of lecturing in high school chemistry

Lecturing is an important aspect of the culture of science education. Perhaps because of the negative associations constructivist educators make with lecturing, little research has been done concerning the generally invisible aspects of the (embodied, lived) work that is required. Traditional research on science lectures focuses on ideas and (mental) concepts that somehow are “gotten across”; and it is interested in identifying verbal content and visual representations science teachers provide. The purpose of this study is to explicitly describe and theorize the living work of lecturing that produces in a societal arena everything from which students can learn. We use two case studies from the chemistry lectures in a tenth-grade Singapore classroom to exemplify the central role of the performative aspects of lecturing. We articulate and exemplify assertions that (a) corporeal performances differentiate and coordinate the contents of lecturing with its pitch, rhythm, and speech volume, and thereby orient students to specific discourse features of chemistry; and (b) corporeal performances differentiate and coordinate layers of talk with prosody, gestures, and body orientation, and thereby make analogies available to students. We conclude that what is visible in lectures (e.g., scientific discourse, analogies) is always the outcome of the (generally unattended to) corporeal labor including gestures, body orientation, and prosodic features (e.g., shifts in pitch) and that this outcome | labor pair constitutes an appropriate unit of understanding lecturing as societal phenomenon.     

READING MATHEMATICS REPRESENTATIONS: AN EYE-TRACKING STUDY

We use eye tracking as a method to examine how different mathematical representations of the same mathematical object are attended to by students. The results of this study show that there is a meaningful difference in the eye movements between formulas and graphs. This difference can be understood in terms of the cultural and social shaping of human perception, as well as in terms of differences between the symbolic and graphical registers.     

The Effectiveness of Mime‐Based Creative Drama Education for Exploring Gesture‐Based User Interfaces

User interfaces that utilise human gestures as input are becoming increasingly prevalent in diverse computing applications. However, few designers possess the deep insight, awareness and experience regarding the nature and usage of gestures in user interfaces to the extent that they are able to exploit the technological affordances and innovate over them. We argue that design students, who will be expected to envision and create such interactions in the future, are constrained as such by their habits that pertain to conventional user interfaces. Design students should gain an understanding of the nature of human gestures and how to use them to add value to UI designs. To this end, we formulated an ‘awareness course’ for design students based on concepts derived from mime art and creative drama. We developed the course iteratively through the involvement of three groups of students. The final version of the course was evaluated by incorporating the perspectives of design educators, an industry expert and the students. We present the details of the course, describe the development process, and discuss the insights revealed by the evaluations.