Individual differences of emotional expression in speaker's behavioral and autonomic responses

Yoshiko Arimoto, Kazuo Okanoya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The goal of this study is to elucidate differences in speak- ers' emotional expressions in behavioral and autonomic re- sponses. Verbal and non-verbal emotional behaviors of inter- locutors were recorded during two types of dialogs (competi- Tive and cooperative). Autonomic nervous system (ANS) activ- ity (heart rate and skin conductance level) was also recorded as an internal measure of emotional reactions toward an interlocu- Tor. To annotate the emotional states of speakers, the speakers who participated in the recording evaluated their own emotional states (arousal, valence and positivity) and their interlocutor's states along with the time course of the dialogs. The behavioral and autonomic emotional reactions were used as independent variables for speaker-independent and speaker-specific models to predict a speaker's emotion. The results demonstrate that speaker-independent models could explain each emotional state in a certain degree; in contrast, some speaker-specific models could explain each emotional state with moderate or high accu- racy. Moreover, a comparison of the absolute standard partial regression coefficients of each variable of the models revealed that there are two types of emotional expression styles, one in which emotional behavioral expression is dominant and another in which emotional autonomic reaction is dominant.

Original languageEnglish
Title of host publicationProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
PublisherInternational Speech and Communication Association
Pages1101-1105
Number of pages5
Publication statusPublished - 2013
Externally publishedYes
Event14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013 - Lyon, France
Duration: 2013 Aug 252013 Aug 29

Other

Other14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013
CountryFrance
CityLyon
Period13/8/2513/8/29

Fingerprint

Neurology
Skin
Individual Differences
Emotional Expression
Emotion
Emotional State

Keywords

  • Autonomic nervous system activity
  • Emotional speech
  • Facial expressions
  • Spontaneous dialog

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modelling and Simulation

Cite this

Arimoto, Y., & Okanoya, K. (2013). Individual differences of emotional expression in speaker's behavioral and autonomic responses. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (pp. 1101-1105). International Speech and Communication Association.

Individual differences of emotional expression in speaker's behavioral and autonomic responses. / Arimoto, Yoshiko; Okanoya, Kazuo.

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. International Speech and Communication Association, 2013. p. 1101-1105.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Arimoto, Y & Okanoya, K 2013, Individual differences of emotional expression in speaker's behavioral and autonomic responses. in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. International Speech and Communication Association, pp. 1101-1105, 14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013, Lyon, France, 13/8/25.
Arimoto Y, Okanoya K. Individual differences of emotional expression in speaker's behavioral and autonomic responses. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. International Speech and Communication Association. 2013. p. 1101-1105
Arimoto, Yoshiko ; Okanoya, Kazuo. / Individual differences of emotional expression in speaker's behavioral and autonomic responses. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. International Speech and Communication Association, 2013. pp. 1101-1105
@inproceedings{63d4fed73a8444649d445f4356f779d6,
title = "Individual differences of emotional expression in speaker's behavioral and autonomic responses",
abstract = "The goal of this study is to elucidate differences in speak- ers' emotional expressions in behavioral and autonomic re- sponses. Verbal and non-verbal emotional behaviors of inter- locutors were recorded during two types of dialogs (competi- Tive and cooperative). Autonomic nervous system (ANS) activ- ity (heart rate and skin conductance level) was also recorded as an internal measure of emotional reactions toward an interlocu- Tor. To annotate the emotional states of speakers, the speakers who participated in the recording evaluated their own emotional states (arousal, valence and positivity) and their interlocutor's states along with the time course of the dialogs. The behavioral and autonomic emotional reactions were used as independent variables for speaker-independent and speaker-specific models to predict a speaker's emotion. The results demonstrate that speaker-independent models could explain each emotional state in a certain degree; in contrast, some speaker-specific models could explain each emotional state with moderate or high accu- racy. Moreover, a comparison of the absolute standard partial regression coefficients of each variable of the models revealed that there are two types of emotional expression styles, one in which emotional behavioral expression is dominant and another in which emotional autonomic reaction is dominant.",
keywords = "Autonomic nervous system activity, Emotional speech, Facial expressions, Spontaneous dialog",
author = "Yoshiko Arimoto and Kazuo Okanoya",
year = "2013",
language = "English",
pages = "1101--1105",
booktitle = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",
publisher = "International Speech and Communication Association",

}

TY - GEN

T1 - Individual differences of emotional expression in speaker's behavioral and autonomic responses

AU - Arimoto, Yoshiko

AU - Okanoya, Kazuo

PY - 2013

Y1 - 2013

N2 - The goal of this study is to elucidate differences in speak- ers' emotional expressions in behavioral and autonomic re- sponses. Verbal and non-verbal emotional behaviors of inter- locutors were recorded during two types of dialogs (competi- Tive and cooperative). Autonomic nervous system (ANS) activ- ity (heart rate and skin conductance level) was also recorded as an internal measure of emotional reactions toward an interlocu- Tor. To annotate the emotional states of speakers, the speakers who participated in the recording evaluated their own emotional states (arousal, valence and positivity) and their interlocutor's states along with the time course of the dialogs. The behavioral and autonomic emotional reactions were used as independent variables for speaker-independent and speaker-specific models to predict a speaker's emotion. The results demonstrate that speaker-independent models could explain each emotional state in a certain degree; in contrast, some speaker-specific models could explain each emotional state with moderate or high accu- racy. Moreover, a comparison of the absolute standard partial regression coefficients of each variable of the models revealed that there are two types of emotional expression styles, one in which emotional behavioral expression is dominant and another in which emotional autonomic reaction is dominant.

AB - The goal of this study is to elucidate differences in speak- ers' emotional expressions in behavioral and autonomic re- sponses. Verbal and non-verbal emotional behaviors of inter- locutors were recorded during two types of dialogs (competi- Tive and cooperative). Autonomic nervous system (ANS) activ- ity (heart rate and skin conductance level) was also recorded as an internal measure of emotional reactions toward an interlocu- Tor. To annotate the emotional states of speakers, the speakers who participated in the recording evaluated their own emotional states (arousal, valence and positivity) and their interlocutor's states along with the time course of the dialogs. The behavioral and autonomic emotional reactions were used as independent variables for speaker-independent and speaker-specific models to predict a speaker's emotion. The results demonstrate that speaker-independent models could explain each emotional state in a certain degree; in contrast, some speaker-specific models could explain each emotional state with moderate or high accu- racy. Moreover, a comparison of the absolute standard partial regression coefficients of each variable of the models revealed that there are two types of emotional expression styles, one in which emotional behavioral expression is dominant and another in which emotional autonomic reaction is dominant.

KW - Autonomic nervous system activity

KW - Emotional speech

KW - Facial expressions

KW - Spontaneous dialog

UR - http://www.scopus.com/inward/record.url?scp=84906221352&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84906221352&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84906221352

SP - 1101

EP - 1105

BT - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

PB - International Speech and Communication Association

ER -