Comparison of native and nonnative speakers' perspective in animated text visualization tool

Nur Syafikah Binti Samsudin, Kazunori Mano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Media conversion technologies such as speech recognition and speech synthesis have gained a lot of attention in recent years. They are applied in various human communication tools through smart phones and personal computers such as in language learning system. However, the learner still have loss in naturalness pronunciation problem because of effects on mother tongue interference. Although the learner can realize that his/her speech is different from the trainer's, the learner still cannot detect or check the precise wrong part in their utterances speech. We indicate these differences by visualizing a learner's wrong and correct pronunciation with speech-to-animated text visualization tool. In this study, we focused on the media conversion process between speech prosodic information and animated text information by using AHP method as the mapping method. The pairwise comparison between both speech and text information were conducted and evaluated by Japanese native and nonnative speakers. Here, we investigated the comparison between native and nonnative speakers' perspective and determined the ideal matching elements between attributes of speech and text information.

Original languageEnglish
Title of host publicationTENCON 2015 - 2015 IEEE Region 10 Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Volume2016-January
ISBN (Electronic)9781479986415
DOIs
Publication statusPublished - 2016 Jan 5
Event35th IEEE Region 10 Conference, TENCON 2015 - Macau, Macao
Duration: 2015 Nov 12015 Nov 4

Other

Other35th IEEE Region 10 Conference, TENCON 2015
CountryMacao
CityMacau
Period15/11/115/11/4

Keywords

  • Animated text
  • Nonlinguistic information
  • Paralinguistic information
  • Speech visualization

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Comparison of native and nonnative speakers' perspective in animated text visualization tool'. Together they form a unique fingerprint.

  • Cite this

    Binti Samsudin, N. S., & Mano, K. (2016). Comparison of native and nonnative speakers' perspective in animated text visualization tool. In TENCON 2015 - 2015 IEEE Region 10 Conference (Vol. 2016-January). [7372934] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/TENCON.2015.7372934