Head pose estimation and movement analysis for speech scene

Rinko Komiya, Takeshi Saitoh, Miharu Fuyuno, Yuko Yamashita, Yoshitaka Nakajima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

Original languageEnglish
Title of host publication2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509008063
DOIs
Publication statusPublished - 2016 Aug 23
Event15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 - Okayama, Japan
Duration: 2016 Jun 262016 Jun 29

Other

Other15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016
CountryJapan
CityOkayama
Period16/6/2616/6/29

Fingerprint

Motion analysis

Keywords

  • Head pose estimation
  • movement analysis
  • speech scene

ASJC Scopus subject areas

  • Computer Science(all)
  • Energy Engineering and Power Technology
  • Control and Optimization

Cite this

Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., & Nakajima, Y. (2016). Head pose estimation and movement analysis for speech scene. In 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings [7550793] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene. / Komiya, Rinko; Saitoh, Takeshi; Fuyuno, Miharu; Yamashita, Yuko; Nakajima, Yoshitaka.

2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2016. 7550793.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Komiya, R, Saitoh, T, Fuyuno, M, Yamashita, Y & Nakajima, Y 2016, Head pose estimation and movement analysis for speech scene. in 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings., 7550793, Institute of Electrical and Electronics Engineers Inc., 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016, Okayama, Japan, 16/6/26. https://doi.org/10.1109/ICIS.2016.7550793
Komiya R, Saitoh T, Fuyuno M, Yamashita Y, Nakajima Y. Head pose estimation and movement analysis for speech scene. In 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2016. 7550793 https://doi.org/10.1109/ICIS.2016.7550793
Komiya, Rinko ; Saitoh, Takeshi ; Fuyuno, Miharu ; Yamashita, Yuko ; Nakajima, Yoshitaka. / Head pose estimation and movement analysis for speech scene. 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2016.
@inproceedings{95adb04c17ad44e5b684c598c91bb5fd,
title = "Head pose estimation and movement analysis for speech scene",
abstract = "Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.",
keywords = "Head pose estimation, movement analysis, speech scene",
author = "Rinko Komiya and Takeshi Saitoh and Miharu Fuyuno and Yuko Yamashita and Yoshitaka Nakajima",
year = "2016",
month = "8",
day = "23",
doi = "10.1109/ICIS.2016.7550793",
language = "English",
booktitle = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Head pose estimation and movement analysis for speech scene

AU - Komiya, Rinko

AU - Saitoh, Takeshi

AU - Fuyuno, Miharu

AU - Yamashita, Yuko

AU - Nakajima, Yoshitaka

PY - 2016/8/23

Y1 - 2016/8/23

N2 - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

AB - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

KW - Head pose estimation

KW - movement analysis

KW - speech scene

UR - http://www.scopus.com/inward/record.url?scp=84988019765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988019765&partnerID=8YFLogxK

U2 - 10.1109/ICIS.2016.7550793

DO - 10.1109/ICIS.2016.7550793

M3 - Conference contribution

AN - SCOPUS:84988019765

BT - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -