Abstract
Although typically studied as an auditory phenomenon, prosody can also be conveyed by the visual speech signal, through increased movements of articulators during speech production, or through eyebrow and rigid head movements. This paper aimed to quantify such visual correlates of prosody. Specifically, the study was concerned with measuring the visual correlates of prosodic focus and prosodic phrasing. In the experiment, four participants' speech and face movements were recorded while they completed a dialog exchange task with an interlocutor. Acoustic analysis showed that prosodic contrasts differed on duration, pitch and intensity parameters, which is consistent with previous findings in the literature. The visual data was processed using guided principal component analysis. The results showed that compared to the broad focused statement condition, speakers produced greater movement on both articulatory and non-articulatory parameters for prosodically focused and intonated words.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010: Makuhari, Japan, 26-30 September 2010 |
| Publisher | International Speech Communication Association |
| Pages | 1433-1436 |
| Number of pages | 4 |
| Publication status | Published - 2010 |
| Event | International Speech Communication Association. Conference - Duration: 9 Sept 2012 → … |
Conference
| Conference | International Speech Communication Association. Conference |
|---|---|
| Period | 9/09/12 → … |