Head pose estimation and movement analysis for speech scene

Rinko Komiya; Takeshi Saitoh; Miharu Fuyuno; Yuko Yamashita; Yoshitaka Nakajima

doi:10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene

Rinko Komiya, Takeshi Saitoh, Miharu Fuyuno, Yuko Yamashita, Yoshitaka Nakajima

Department of English

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

Original language	English
Title of host publication	2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings
Editors	Kuniaki Uehara, Masahide Nakamura
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509008063
DOIs	https://doi.org/10.1109/ICIS.2016.7550793
Publication status	Published - 2016 Aug 23
Event	15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 - Okayama, Japan Duration: 2016 Jun 26 → 2016 Jun 29

Publication series

Name	2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

Other

Other	15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016
Country/Territory	Japan
City	Okayama
Period	16/6/26 → 16/6/29

Keywords

Head pose estimation
movement analysis
speech scene

ASJC Scopus subject areas

Computer Science(all)
Energy Engineering and Power Technology
Control and Optimization

Access to Document

10.1109/ICIS.2016.7550793

Cite this

Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., & Nakajima, Y. (2016). Head pose estimation and movement analysis for speech scene. In K. Uehara, & M. Nakamura (Eds.), 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings [7550793] (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene. / Komiya, Rinko; Saitoh, Takeshi; Fuyuno, Miharu; Yamashita, Yuko; Nakajima, Yoshitaka.

2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. ed. / Kuniaki Uehara; Masahide Nakamura. Institute of Electrical and Electronics Engineers Inc., 2016. 7550793 (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Komiya, R, Saitoh, T, Fuyuno, M, Yamashita, Y & Nakajima, Y 2016, Head pose estimation and movement analysis for speech scene. in K Uehara & M Nakamura (eds), 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings., 7550793, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016, Okayama, Japan, 16/6/26. https://doi.org/10.1109/ICIS.2016.7550793

Komiya R, Saitoh T, Fuyuno M, Yamashita Y, Nakajima Y. Head pose estimation and movement analysis for speech scene. In Uehara K, Nakamura M, editors, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2016. 7550793. (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings). https://doi.org/10.1109/ICIS.2016.7550793

Komiya, Rinko ; Saitoh, Takeshi ; Fuyuno, Miharu ; Yamashita, Yuko ; Nakajima, Yoshitaka. / Head pose estimation and movement analysis for speech scene. 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. editor / Kuniaki Uehara ; Masahide Nakamura. Institute of Electrical and Electronics Engineers Inc., 2016. (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings).

@inproceedings{95adb04c17ad44e5b684c598c91bb5fd,

title = "Head pose estimation and movement analysis for speech scene",

abstract = "Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.",

keywords = "Head pose estimation, movement analysis, speech scene",

author = "Rinko Komiya and Takeshi Saitoh and Miharu Fuyuno and Yuko Yamashita and Yoshitaka Nakajima",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 ; Conference date: 26-06-2016 Through 29-06-2016",

year = "2016",

month = aug,

day = "23",

doi = "10.1109/ICIS.2016.7550793",

language = "English",

series = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

editor = "Kuniaki Uehara and Masahide Nakamura",

booktitle = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",

}

TY - GEN

T1 - Head pose estimation and movement analysis for speech scene

AU - Komiya, Rinko

AU - Saitoh, Takeshi

AU - Fuyuno, Miharu

AU - Yamashita, Yuko

AU - Nakajima, Yoshitaka

PY - 2016/8/23

Y1 - 2016/8/23

N2 - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

AB - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

KW - Head pose estimation

KW - movement analysis

KW - speech scene

UR - http://www.scopus.com/inward/record.url?scp=84988019765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988019765&partnerID=8YFLogxK

U2 - 10.1109/ICIS.2016.7550793

DO - 10.1109/ICIS.2016.7550793

M3 - Conference contribution

AN - SCOPUS:84988019765

T3 - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

BT - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

A2 - Uehara, Kuniaki

A2 - Nakamura, Masahide

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016

Y2 - 26 June 2016 through 29 June 2016

ER -

Head pose estimation and movement analysis for speech scene

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this