Animated texts application in visualizing speech features for Foreign language learning

Nur Syafikah Binti Samsudin, Kazunori Mano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Pronunciation training aid using media tools such as mobile apps and online web-based system are widely used nowadays. These tools often provide audio-based sample and phonetic style texts that can be used to support the learners train their pronunciation without language teachers. However, the learners still have the difficulty in the learning process, because they found it is hard to detect and locate the mispronounced parts in their own speech while practicing. In this paper, we present a method that enables to visualize speech detailed features such as pitch, intensity and duration into the text forms. The medium to portray those speech features is the animated texts which enable to express the speech features in the attributes of text features such as text size, color, position or motion. By viewing the speech features in the rich text forms like the animated texts, the learners can easily spot their mispronounced parts and correct them. Here, we examined how the actual analyzed speech data can be mapped into the animated texts' features and the effectiveness of using the proposed visualization system in portraying speech pitch, intensity and duration features. The evaluation experiments were surveyed by forty non-native Japanese learners who are Malaysian novice level learners. The experiment subjects appeared to agree with the animated texts as the representative for speech visualization and the daily conversation based speech data appeared to be an easy approach for the novice level.

Original languageEnglish
Title of host publicationTENCON 2017 - 2017 IEEE Region 10 Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1778-1783
Number of pages6
Volume2017-December
ISBN (Electronic)9781509011339
DOIs
Publication statusPublished - 2017 Dec 19
Event2017 IEEE Region 10 Conference, TENCON 2017 - Penang, Malaysia
Duration: 2017 Nov 52017 Nov 8

Other

Other2017 IEEE Region 10 Conference, TENCON 2017
CountryMalaysia
CityPenang
Period17/11/517/11/8

Fingerprint

Visualization
Speech analysis
Application programs
Experiments
Color

Keywords

  • animated texts
  • language learning
  • speech paralinguistic
  • speech prosodic
  • speech visualization

ASJC Scopus subject areas

  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Samsudin, N. S. B., & Mano, K. (2017). Animated texts application in visualizing speech features for Foreign language learning. In TENCON 2017 - 2017 IEEE Region 10 Conference (Vol. 2017-December, pp. 1778-1783). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/TENCON.2017.8228146

Animated texts application in visualizing speech features for Foreign language learning. / Samsudin, Nur Syafikah Binti; Mano, Kazunori.

TENCON 2017 - 2017 IEEE Region 10 Conference. Vol. 2017-December Institute of Electrical and Electronics Engineers Inc., 2017. p. 1778-1783.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Samsudin, NSB & Mano, K 2017, Animated texts application in visualizing speech features for Foreign language learning. in TENCON 2017 - 2017 IEEE Region 10 Conference. vol. 2017-December, Institute of Electrical and Electronics Engineers Inc., pp. 1778-1783, 2017 IEEE Region 10 Conference, TENCON 2017, Penang, Malaysia, 17/11/5. https://doi.org/10.1109/TENCON.2017.8228146
Samsudin NSB, Mano K. Animated texts application in visualizing speech features for Foreign language learning. In TENCON 2017 - 2017 IEEE Region 10 Conference. Vol. 2017-December. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1778-1783 https://doi.org/10.1109/TENCON.2017.8228146
Samsudin, Nur Syafikah Binti ; Mano, Kazunori. / Animated texts application in visualizing speech features for Foreign language learning. TENCON 2017 - 2017 IEEE Region 10 Conference. Vol. 2017-December Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1778-1783
@inproceedings{8940646ea51b43bb8b6e9397d318c70b,
title = "Animated texts application in visualizing speech features for Foreign language learning",
abstract = "Pronunciation training aid using media tools such as mobile apps and online web-based system are widely used nowadays. These tools often provide audio-based sample and phonetic style texts that can be used to support the learners train their pronunciation without language teachers. However, the learners still have the difficulty in the learning process, because they found it is hard to detect and locate the mispronounced parts in their own speech while practicing. In this paper, we present a method that enables to visualize speech detailed features such as pitch, intensity and duration into the text forms. The medium to portray those speech features is the animated texts which enable to express the speech features in the attributes of text features such as text size, color, position or motion. By viewing the speech features in the rich text forms like the animated texts, the learners can easily spot their mispronounced parts and correct them. Here, we examined how the actual analyzed speech data can be mapped into the animated texts' features and the effectiveness of using the proposed visualization system in portraying speech pitch, intensity and duration features. The evaluation experiments were surveyed by forty non-native Japanese learners who are Malaysian novice level learners. The experiment subjects appeared to agree with the animated texts as the representative for speech visualization and the daily conversation based speech data appeared to be an easy approach for the novice level.",
keywords = "animated texts, language learning, speech paralinguistic, speech prosodic, speech visualization",
author = "Samsudin, {Nur Syafikah Binti} and Kazunori Mano",
year = "2017",
month = "12",
day = "19",
doi = "10.1109/TENCON.2017.8228146",
language = "English",
volume = "2017-December",
pages = "1778--1783",
booktitle = "TENCON 2017 - 2017 IEEE Region 10 Conference",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Animated texts application in visualizing speech features for Foreign language learning

AU - Samsudin, Nur Syafikah Binti

AU - Mano, Kazunori

PY - 2017/12/19

Y1 - 2017/12/19

N2 - Pronunciation training aid using media tools such as mobile apps and online web-based system are widely used nowadays. These tools often provide audio-based sample and phonetic style texts that can be used to support the learners train their pronunciation without language teachers. However, the learners still have the difficulty in the learning process, because they found it is hard to detect and locate the mispronounced parts in their own speech while practicing. In this paper, we present a method that enables to visualize speech detailed features such as pitch, intensity and duration into the text forms. The medium to portray those speech features is the animated texts which enable to express the speech features in the attributes of text features such as text size, color, position or motion. By viewing the speech features in the rich text forms like the animated texts, the learners can easily spot their mispronounced parts and correct them. Here, we examined how the actual analyzed speech data can be mapped into the animated texts' features and the effectiveness of using the proposed visualization system in portraying speech pitch, intensity and duration features. The evaluation experiments were surveyed by forty non-native Japanese learners who are Malaysian novice level learners. The experiment subjects appeared to agree with the animated texts as the representative for speech visualization and the daily conversation based speech data appeared to be an easy approach for the novice level.

AB - Pronunciation training aid using media tools such as mobile apps and online web-based system are widely used nowadays. These tools often provide audio-based sample and phonetic style texts that can be used to support the learners train their pronunciation without language teachers. However, the learners still have the difficulty in the learning process, because they found it is hard to detect and locate the mispronounced parts in their own speech while practicing. In this paper, we present a method that enables to visualize speech detailed features such as pitch, intensity and duration into the text forms. The medium to portray those speech features is the animated texts which enable to express the speech features in the attributes of text features such as text size, color, position or motion. By viewing the speech features in the rich text forms like the animated texts, the learners can easily spot their mispronounced parts and correct them. Here, we examined how the actual analyzed speech data can be mapped into the animated texts' features and the effectiveness of using the proposed visualization system in portraying speech pitch, intensity and duration features. The evaluation experiments were surveyed by forty non-native Japanese learners who are Malaysian novice level learners. The experiment subjects appeared to agree with the animated texts as the representative for speech visualization and the daily conversation based speech data appeared to be an easy approach for the novice level.

KW - animated texts

KW - language learning

KW - speech paralinguistic

KW - speech prosodic

KW - speech visualization

UR - http://www.scopus.com/inward/record.url?scp=85044232045&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044232045&partnerID=8YFLogxK

U2 - 10.1109/TENCON.2017.8228146

DO - 10.1109/TENCON.2017.8228146

M3 - Conference contribution

AN - SCOPUS:85044232045

VL - 2017-December

SP - 1778

EP - 1783

BT - TENCON 2017 - 2017 IEEE Region 10 Conference

PB - Institute of Electrical and Electronics Engineers Inc.

ER -