Individual differences of emotional expression in speaker's behavioral and autonomic responses

Yoshiko Arimoto, Kazuo Okanoya

Research output: Contribution to journalConference article


The goal of this study is to elucidate differences in speak- ers' emotional expressions in behavioral and autonomic re- sponses. Verbal and non-verbal emotional behaviors of inter- locutors were recorded during two types of dialogs (competi- Tive and cooperative). Autonomic nervous system (ANS) activ- ity (heart rate and skin conductance level) was also recorded as an internal measure of emotional reactions toward an interlocu- Tor. To annotate the emotional states of speakers, the speakers who participated in the recording evaluated their own emotional states (arousal, valence and positivity) and their interlocutor's states along with the time course of the dialogs. The behavioral and autonomic emotional reactions were used as independent variables for speaker-independent and speaker-specific models to predict a speaker's emotion. The results demonstrate that speaker-independent models could explain each emotional state in a certain degree; in contrast, some speaker-specific models could explain each emotional state with moderate or high accu- racy. Moreover, a comparison of the absolute standard partial regression coefficients of each variable of the models revealed that there are two types of emotional expression styles, one in which emotional behavioral expression is dominant and another in which emotional autonomic reaction is dominant.

Original languageEnglish
Pages (from-to)1101-1105
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Publication statusPublished - 2013 Jan 1
Event14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013 - Lyon, France
Duration: 2013 Aug 252013 Aug 29



  • Autonomic nervous system activity
  • Emotional speech
  • Facial expressions
  • Spontaneous dialog

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modelling and Simulation

Cite this