Multimodal contribution to speech perception revealed by independent component analysis : a single-sweep EEG case study

Daniel E. Callan; Akiko M. Callan; Christian Kroos; Eric Vatikiotis-Bateson

doi:10.1016/S0926-6410(00)00054-9

Multimodal contribution to speech perception revealed by independent component analysis : a single-sweep EEG case study

Daniel E. Callan
, Akiko M. Callan
, Christian Kroos
, Eric Vatikiotis-Bateson

Research output: Contribution to journal › Article

85 Citations (Scopus)

Abstract

In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.

Original language	English
Journal	Cognitive brain research
DOIs	https://doi.org/10.1016/S0926-6410(00)00054-9
Publication status	Published - 2001

Keywords

cognition
electroencephalography
speech intelligibility

Access to Document

10.1016/S0926-6410(00)00054-9

Cite this

@article{f3a145006f5645a7895a4af9cead5c11,

title = "Multimodal contribution to speech perception revealed by independent component analysis : a single-sweep EEG case study",

abstract = "In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.",

keywords = "cognition, electroencephalography, speech intelligibility",

author = "Callan, \{Daniel E.\} and Callan, \{Akiko M.\} and Christian Kroos and Eric Vatikiotis-Bateson",

year = "2001",

doi = "10.1016/S0926-6410(00)00054-9",

language = "English",

journal = "Cognitive brain research",

issn = "0926-6410",

publisher = "Elsevier B.V.",

}

TY - JOUR

T1 - Multimodal contribution to speech perception revealed by independent component analysis : a single-sweep EEG case study

AU - Callan, Daniel E.

AU - Callan, Akiko M.

AU - Kroos, Christian

AU - Vatikiotis-Bateson, Eric

PY - 2001

Y1 - 2001

N2 - In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.

AB - In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.

KW - cognition

KW - electroencephalography

KW - speech intelligibility

UR - http://handle.uws.edu.au:8081/1959.7/35204

U2 - 10.1016/S0926-6410(00)00054-9

DO - 10.1016/S0926-6410(00)00054-9

M3 - Article

SN - 0926-6410

JO - Cognitive brain research

JF - Cognitive brain research

ER -

Multimodal contribution to speech perception revealed by independent component analysis : a single-sweep EEG case study

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this