Open Access Open Access  Restricted Access Subscription or Fee Access

An Indian Corpus of Gestures for Nouns and Verbs: A Preliminary Study

Nikitha M, S P Goswami

Abstract


The study aimed to develop a corpus of comprehensive gestures for a set of nouns and verbs in the Indian context. The study was conducted in the following three phases. Phase 1: Gestural nouns and verbs were selected from the existing word lists. Phase 2: A set of 221 nouns and 122 verbs were enacted and recorded by a professional actor and a cameraman respectively.  Phase 3: Two groups of participants i.e., 15 young (18-39 years) and 15 old (40-69 years) neuro-typical adults participated in the two tasks namely (a) naming and (b) rating tasks. The analyses of the responses revealed maximum uniformity of correct responses between the participants at 85% agreement level for both noun and verb gestures. Thus, a set of 86 noun and 60 verb gesture videos entered the final gesture corpus which satisfied the criteria. Further, the varied responses among the participants in interpreting the gestures and type of gestures have been discussed and documented. The corpus developed can serve as stimulus in various gesture studies. Although the corpus comes with few limitations, the data provided would help the researchers to carefully select the gesture videos based on their purpose of the study.


Keywords


Corpus, gesture, nouns, verbs, stimuli

Full Text:

PDF

References


Chui K. Temporal patterning of speech and iconic gestures in conversational discourse. J. Pragmat. 2005; 37(6): 871–887.

Kita S, Özyürek A. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. J Mem Lang. 2003; 48(1): 16–32.

McNeill D, Bertenthal B, Cole J, Gallagher S. Gesture-first, but no gestures? Behav Brain Sci. 2005; 28(2): 138–139. 4. McNeill D. Hand and mind: What gestures reveal about thought. University of Chicago Press; 1992.

Cook SW, Goldin-Meadow S. The role of gesture in learning: Do children use their hands to change their minds? J. Cogn. Dev. 2006; 7(2): 211–232.

So WC, Coppola M, Licciardello V, Goldin‐Meadow S. The seeds of spatial grammar in the manual modality. Cogn. Sci. 2005; 29(6): 1029–1043.

Ekman P, Friesen WV. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica. 1969; 1(1): 49–98.

Kong AP, Law SP, Kwan CC, et al. A coding system with independent annotations of gesture forms and functions during verbal communication: Development of a database of speech and gesture (DoSaGE). J. Nonverbal Behav. 2015; 39(1): 93–111.

McNeill D. Language and gesture. Cambridge University Press; 2000.

Nehaniv CL. Classifying types of gesture and inferring intent. Procs of the AISB 05 Symposium on Robot Companions. Hatfield, UK. 2005.

Corballis MC. How language evolved from manual gestures. Gesture. 2012; 12(2): 200–226.

Rizzolatti G, Arbib MA. Language within our grasp. Trends Neurosci. 1998; 21(5): 188–194.

Butcher C, Goldin-Meadow S, McNeill D. Gesture and the transition from one-to two-word speech: When hand and mouth come together. Language and Gesture. 2000; 235–257.

Iverson JM, Fagan MK. Infant vocal-motor coordination: precursor to the gesture-speech system? Child Dev. 2004; 75(4): 1053–1066.

Barbieri F, Buonocore A, Dalla Volta R, et al. How symbolic gestures and words interact with each other. Brain Lang. 2009; 110(1): 1–1.

Bernardis P, Gentilucci M. Speech and gesture share the same communication system. Neuropsychologia. 2006; 44(2): 178–190.

Kelly S, Healey M, Özyürek A, Holler J. The processing of speech, gesture, and action during language comprehension. Psychon Bull Rev. 2015; 22(2): 517–523.

Mol L, Krahmer E, van de Sandt-Koenderman M. Gesturing by speakers with aphasia: How does it compare? J. Speech Lang. Hear. 2013; 56(4): 1224–1236.

Papeo L, Rumiati RI. Lexical and gestural symbols in left-damaged patients. Cortex. 2013; 49(6): 1668–1678.

Sekine K, Rose ML. The relationship of aphasia type and gesture production in people with aphasia. Am J Speech Lang Pathol. 2013; 22(4): 662–672.

Agostini B, Papeo L, Galusca CI, et al. A norming study of high-quality video clips of pantomimes, emblems, and meaningless gestures. Behav. Res. Methods. 2019; 51(6): 2817–2826. 22. LeBaron M. Bridging Cultural Conflicts. A New Approach for a Changing World. Jossey Bass; 2003.

Özçalışkan Ş, Lucero C, Goldin-Meadow S. Does language shape silent gesture? Cognition. 2016; 148: 10–18.

Shymala KC, Sunil KR, Vijayetha S. Development and standardization of boston naming test in Kannada Bilinguals (Kannada-English and Telegu-English). 2010. Project, All India Institute of Speech and Hearing, Mysore, India.

Brajesh Priyadarshi, Shyamala KC, Kruthi HR. Development of norms for assessment protocol for lexical semantic deficits using componential analysis (PALSD-K). 2012. Project, All India Institute of Speech and Hearing, Mysore, India.

Goswami SP and Renuka C. Computerized version of manual for adult aphasia therapy in Kannada (CV- MAAT-K). 2013. Project, All India Institute of Speech and Hearing, Mysore, India.

Prarthana S, Prema KS. Mental lexicon of nouns and verbs in adult speakers of Kannada. 2016. Unpublished doctoral thesis. Submitted to the University of Mysore, Mysuru.

Girish KS, Shyamala KC. Standardization of Action Naming Test. 2015. Unpublished master’s dissertation. Submitted to the University of Mysore, Mysuru.

Safa S, Goswami SP. Development of Noun Gesture Corpus. 2019. Unpublished master’s dissertation. Submitted to the University of Mysore, Mysuru.

Anusha C, Goswami SP. Development of Verb Gesture Corpus. 2019. Unpublished master’s dissertation. Submitted to the University of Mysore, Mysuru.




DOI: https://doi.org/10.37591/rrjon.v11i1.2462

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Research & Reviews: Journal of Neuroscience