TY - GEN
T1 - Spontaneous synchronization between repetitive speech and rhythmic gesture
AU - Zelic, Gregory
AU - Kim, Jeesun
AU - Davis, Christopher
PY - 2013
Y1 - 2013
N2 - ![CDATA[Although studies have described how motion in diverse biological systems may spontaneously synchronize it is not known whether speech and gesture exhibit such a property. Previous research on the coordination of speech and gesture has focused on pointing or tapping tasks, the structure of which may regulate speech and gesture dynamics. Here we examined whether synchronies might arise between a repetitive utterance and rhythmic finger movement oscillations in a non-intentional paradigm. Participants were instructed to repeatedly utter /ba/ or /sa/ syllables with/without vocalizing, while continuously moving their right index finger in flexion/extension. No instructions about synchronization were given; participants were only told to adopt the most comfortable motions. We expected that the larger amplitude of face motion for /ba/ syllables and vocalized speech would lead to greater influence on the gesture. In contrast, the results showed more synchronization for /sa/ and when syllables were articulated silently. Less perceptive feedback may lead to a reduction in the robustness of the speech component, making it more susceptible to gesture influence.]]
AB - ![CDATA[Although studies have described how motion in diverse biological systems may spontaneously synchronize it is not known whether speech and gesture exhibit such a property. Previous research on the coordination of speech and gesture has focused on pointing or tapping tasks, the structure of which may regulate speech and gesture dynamics. Here we examined whether synchronies might arise between a repetitive utterance and rhythmic finger movement oscillations in a non-intentional paradigm. Participants were instructed to repeatedly utter /ba/ or /sa/ syllables with/without vocalizing, while continuously moving their right index finger in flexion/extension. No instructions about synchronization were given; participants were only told to adopt the most comfortable motions. We expected that the larger amplitude of face motion for /ba/ syllables and vocalized speech would lead to greater influence on the gesture. In contrast, the results showed more synchronization for /sa/ and when syllables were articulated silently. Less perceptive feedback may lead to a reduction in the robustness of the speech component, making it more susceptible to gesture influence.]]
UR - http://handle.uws.edu.au:8081/1959.7/534437
UR - http://avsp2013.loria.fr/
M3 - Conference Paper
SP - 17
EP - 20
BT - Proceedings of the 12th International Conference on Auditory-Visual Speech Processing, 29 August - 1 September 2013, Annecy, France
PB - Inria
T2 - International Conference on Auditory-Visual Speech Processing
Y2 - 29 August 2013
ER -