Effects of facial expressions on impression evaluation for Japanese stuttering voices

Atsuko Yamazaki, Noriaki Miwa, Kazukiyo Inada, Muhammad Nur Adilin Bin Mohd Anuardi, Mashu Sanjo

Research output: Contribution to journalConference article

Abstract

Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.

Original languageEnglish
Pages (from-to)1360-1367
Number of pages8
JournalProcedia Computer Science
Volume126
DOIs
Publication statusPublished - 2018 Jan 1
Event22nd International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, KES 2018 - Belgrade, Serbia
Duration: 2018 Sep 32018 Sep 5

Fingerprint

Communication
Semantics
Acoustic waves
Experiments

Keywords

  • Facial expressions
  • Impression
  • SD Method
  • Speeh disorder
  • Stuttering

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Effects of facial expressions on impression evaluation for Japanese stuttering voices. / Yamazaki, Atsuko; Miwa, Noriaki; Inada, Kazukiyo; Mohd Anuardi, Muhammad Nur Adilin Bin; Sanjo, Mashu.

In: Procedia Computer Science, Vol. 126, 01.01.2018, p. 1360-1367.

Research output: Contribution to journalConference article

Yamazaki, Atsuko ; Miwa, Noriaki ; Inada, Kazukiyo ; Mohd Anuardi, Muhammad Nur Adilin Bin ; Sanjo, Mashu. / Effects of facial expressions on impression evaluation for Japanese stuttering voices. In: Procedia Computer Science. 2018 ; Vol. 126. pp. 1360-1367.
@article{87a92f5f77fe4a948f33ca375568fef7,
title = "Effects of facial expressions on impression evaluation for Japanese stuttering voices",
abstract = "Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.",
keywords = "Facial expressions, Impression, SD Method, Speeh disorder, Stuttering",
author = "Atsuko Yamazaki and Noriaki Miwa and Kazukiyo Inada and {Mohd Anuardi}, {Muhammad Nur Adilin Bin} and Mashu Sanjo",
year = "2018",
month = "1",
day = "1",
doi = "10.1016/j.procS.2018.08.087",
language = "English",
volume = "126",
pages = "1360--1367",
journal = "Procedia Computer Science",
issn = "1877-0509",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - Effects of facial expressions on impression evaluation for Japanese stuttering voices

AU - Yamazaki, Atsuko

AU - Miwa, Noriaki

AU - Inada, Kazukiyo

AU - Mohd Anuardi, Muhammad Nur Adilin Bin

AU - Sanjo, Mashu

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.

AB - Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.

KW - Facial expressions

KW - Impression

KW - SD Method

KW - Speeh disorder

KW - Stuttering

UR - http://www.scopus.com/inward/record.url?scp=85056659610&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056659610&partnerID=8YFLogxK

U2 - 10.1016/j.procS.2018.08.087

DO - 10.1016/j.procS.2018.08.087

M3 - Conference article

AN - SCOPUS:85056659610

VL - 126

SP - 1360

EP - 1367

JO - Procedia Computer Science

JF - Procedia Computer Science

SN - 1877-0509

ER -