Human perception of emotional responses to changes in auditory attributes of humanoid agents

Zhao Zou; Fady Alnajjar; Michael Lwin; Abdullah Al Mahmud; Muhammed Swavaf; Aila Khan; Omar Mubin

doi:10.1007/978-981-99-8715-3_2

Human perception of emotional responses to changes in auditory attributes of humanoid agents

Zhao Zou, Fady Alnajjar, Michael Lwin, Abdullah Al Mahmud, Muhammed Swavaf, Aila Khan, Omar Mubin

Western Sydney University

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

Abstract

Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users' emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

Original language	English
Title of host publication	Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I
Editors	Abdulaziz Al Ali, John-John Cabibihan, Nader Meskin, Silvia Rossi, Wanyue Jiang, Hongsheng He, Shuzhi Sam Ge
Publisher	Springer
Pages	13-21
Number of pages	9
ISBN (Print)	9789819987146
DOIs	https://doi.org/10.1007/978-981-99-8715-3_2
Publication status	Published - 2024
Event	International Conference on Social Robotics - Duration: 3 Dec 2023 → …

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14453 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	International Conference on Social Robotics
Period	3/12/23 → …

Bibliographical note

Publisher Copyright:
© 2024, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Keywords

Auditory features
Avatar
Emotion detection
Human-robot interaction
User experience

Access to Document

10.1007/978-981-99-8715-3_2

Cite this

Zou, Z., Alnajjar, F., Lwin, M., Al Mahmud, A., Swavaf, M., Khan, A., & Mubin, O. (2024). Human perception of emotional responses to changes in auditory attributes of humanoid agents. In A. A. Ali, J.-J. Cabibihan, N. Meskin, S. Rossi, W. Jiang, H. He, & S. S. Ge (Eds.), Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I (pp. 13-21). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14453 LNAI). Springer. https://doi.org/10.1007/978-981-99-8715-3_2

Zou, Zhao ; Alnajjar, Fady ; Lwin, Michael et al. / Human perception of emotional responses to changes in auditory attributes of humanoid agents. Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I. editor / Abdulaziz Al Ali ; John-John Cabibihan ; Nader Meskin ; Silvia Rossi ; Wanyue Jiang ; Hongsheng He ; Shuzhi Sam Ge. Springer, 2024. pp. 13-21 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{215636ebc5744c70b3449fd81b2a50e0,

title = "Human perception of emotional responses to changes in auditory attributes of humanoid agents",

abstract = "Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users' emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.",

keywords = "Auditory features, Avatar, Emotion detection, Human-robot interaction, User experience",

author = "Zhao Zou and Fady Alnajjar and Michael Lwin and {Al Mahmud}, Abdullah and Muhammed Swavaf and Aila Khan and Omar Mubin",

note = "Publisher Copyright: {\textcopyright} 2024, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.; International Conference on Social Robotics ; Conference date: 03-12-2023",

year = "2024",

doi = "10.1007/978-981-99-8715-3_2",

language = "English",

isbn = "9789819987146",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "13--21",

editor = "Ali, {Abdulaziz Al} and John-John Cabibihan and Nader Meskin and Silvia Rossi and Wanyue Jiang and Hongsheng He and Ge, {Shuzhi Sam}",

booktitle = "Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I",

}

Zou, Z, Alnajjar, F, Lwin, M, Al Mahmud, A, Swavaf, M, Khan, A & Mubin, O 2024, Human perception of emotional responses to changes in auditory attributes of humanoid agents. in AA Ali, J-J Cabibihan, N Meskin, S Rossi, W Jiang, H He & SS Ge (eds), Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14453 LNAI, Springer, pp. 13-21, International Conference on Social Robotics, 3/12/23. https://doi.org/10.1007/978-981-99-8715-3_2

Human perception of emotional responses to changes in auditory attributes of humanoid agents. / Zou, Zhao; Alnajjar, Fady; Lwin, Michael et al.
Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I. ed. / Abdulaziz Al Ali; John-John Cabibihan; Nader Meskin; Silvia Rossi; Wanyue Jiang; Hongsheng He; Shuzhi Sam Ge. Springer, 2024. p. 13-21 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14453 LNAI).

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

TY - GEN

T1 - Human perception of emotional responses to changes in auditory attributes of humanoid agents

AU - Zou, Zhao

AU - Alnajjar, Fady

AU - Lwin, Michael

AU - Al Mahmud, Abdullah

AU - Swavaf, Muhammed

AU - Khan, Aila

AU - Mubin, Omar

PY - 2024

Y1 - 2024

N2 - Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users' emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

AB - Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users' emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

KW - Auditory features

KW - Avatar

KW - Emotion detection

KW - Human-robot interaction

KW - User experience

UR - https://hdl.handle.net/1959.7/uws:75399

UR - http://www.scopus.com/inward/record.url?scp=85180628266&partnerID=8YFLogxK

U2 - 10.1007/978-981-99-8715-3_2

DO - 10.1007/978-981-99-8715-3_2

M3 - Conference Paper

SN - 9789819987146

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 13

EP - 21

BT - Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I

A2 - Ali, Abdulaziz Al

A2 - Cabibihan, John-John

A2 - Meskin, Nader

A2 - Rossi, Silvia

A2 - Jiang, Wanyue

A2 - He, Hongsheng

A2 - Ge, Shuzhi Sam

PB - Springer

T2 - International Conference on Social Robotics

Y2 - 3 December 2023

ER -

Zou Z, Alnajjar F, Lwin M, Al Mahmud A, Swavaf M, Khan A et al. Human perception of emotional responses to changes in auditory attributes of humanoid agents. In Ali AA, Cabibihan JJ, Meskin N, Rossi S, Jiang W, He H, Ge SS, editors, Social Robotics: 15th International Conference, ICSR 2023, Doha, Qatar, December 3-7, 2023, Proceedings, Part I. Springer. 2024. p. 13-21. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-981-99-8715-3_2

Human perception of emotional responses to changes in auditory attributes of humanoid agents

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this