A Nonverbal Signs Dataset for the Italian Population

Published: 3 February 2025| Version 1 | DOI: 10.17632/vwwmmd99r3.1
Contributors:
,

Description

A Nonverbal Signs Dataset for the Italian Population 1,522 Colorful Stimuli of Spontaneous Social Communication, for experimental settings, including EEG/ERP experiments. The provided stimuli are made available for use with the understanding that proper acknowledgment and citation of the source are required in any resulting work or publication. Proper attribution not only ensures academic integrity but also duly recognizes the effort involved in their development. Should further details regarding citation be needed, the relevant information can be provided upon request. SOURCE and VALIDATION studies: - Proverbio AM, Gabaro V, Orlandi A, Zani A. Semantic brain areas are involved in gesture comprehension: An electrical neuroimaging study. Brain Lang. 2015 Aug;147:30-40. doi: 10.1016/j.bandl.2015.05.002.  - Proverbio AM, Ornaghi L, Gabaro V. How face blurring affects body language processing of static gestures in women and men. Soc Cogn Affect Neurosci. 2018 Jun 1;13(6):590-603. doi: 10.1093/scan/nsy033.

Files

Steps to reproduce

A comprehensive list of spontaneous gestures commonly used in conversation was compiled to create the stimulus set, totaling 187 distinct distinctive and recognizable gestures (nonverbal language). To illustrate these gestures, we photographed six actors (three male and three female), instructing them to produce the gestures naturally via the Stanislavsky Actor’s studio methods. The photographs were taken in a professional studio, where the actors stood before the camera in a white hall under controlled lighting conditions. Each actor received the list of gestures and was asked to express them spontaneously. This process resulted in a total of 1,122 photographs—six for each of the 187 gestures. The gestures could be of three types: iconic (visual representations of referential meaning), deictic (gestures that indicate real, implied or imaginary persons, objects, directions) or emblematic (symbolic and conventional gestures that represent a standard meaning; e.g. the index and middle finger forming a ‘V’ for ‘peace’ or thumbs up for ‘good’). Each gesture was associated with a short verbal label, which could be congruent or incongruent with the image itself.  Half of the images were assigned to the congruent condition, in which gestures were paired with matching verbal descriptions, while the other half were assigned to the incongruent condition, where gestures were paired with mismatched descriptions. The stimuli were carefully balanced so that each actor appeared in an equal number of congruent and incongruent conditions. Each gesture was associated with three congruent and three incongruent stimuli, ensuring that each verbal description appeared six times: three times with congruent images and three times with incongruent ones.

Institutions

University of Milano-Bicocca

Departments

Department of Psychology

Categories

Cognitive Psychology, Behavior (Neuroscience), Perception, Cognitive Neuroscience

Licence