Effects of facial expressions on impression evaluation for Japanese stuttering voices

Atsuko Yamazaki, Noriaki Miwa, Kazukiyo Inada, Muhammad Nur Adilin Bin Mohd Anuardi, Mashu Sanjo

Research output: Contribution to journalConference article


Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.

Original languageEnglish
Pages (from-to)1360-1367
Number of pages8
JournalProcedia Computer Science
Publication statusPublished - 2018 Jan 1
Event22nd International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, KES 2018 - Belgrade, Serbia
Duration: 2018 Sep 32018 Sep 5


  • Facial expressions
  • Impression
  • SD Method
  • Speeh disorder
  • Stuttering

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Effects of facial expressions on impression evaluation for Japanese stuttering voices'. Together they form a unique fingerprint.

  • Cite this