Head pose estimation and movement analysis for speech scene

Rinko Komiya; Takeshi Saitoh; Miharu Fuyuno; Yuko Yamashita; Yoshitaka Nakajima

doi:10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene

Rinko Komiya, Takeshi Saitoh, Miharu Fuyuno, Yuko Yamashita, Yoshitaka Nakajima

Department of English

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

Original language	English
Title of host publication	2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509008063
DOIs	https://doi.org/10.1109/ICIS.2016.7550793
Publication status	Published - 2016 Aug 23
Event	15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 - Okayama, Japan Duration: 2016 Jun 26 → 2016 Jun 29

Other

Other	15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016
Country	Japan
City	Okayama
Period	16/6/26 → 16/6/29

Fingerprint

Keywords

Head pose estimation
movement analysis
speech scene

ASJC Scopus subject areas

Computer Science(all)
Energy Engineering and Power Technology
Control and Optimization

Cite this

Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., & Nakajima, Y. (2016). Head pose estimation and movement analysis for speech scene. In 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings [7550793] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene. / Komiya, Rinko; Saitoh, Takeshi; Fuyuno, Miharu; Yamashita, Yuko; Nakajima, Yoshitaka.

2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2016. 7550793.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Komiya, R, Saitoh, T, Fuyuno, M, Yamashita, Y & Nakajima, Y 2016, Head pose estimation and movement analysis for speech scene. in 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings., 7550793, Institute of Electrical and Electronics Engineers Inc., 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016, Okayama, Japan, 16/6/26. https://doi.org/10.1109/ICIS.2016.7550793

@inproceedings{95adb04c17ad44e5b684c598c91bb5fd,

title = "Head pose estimation and movement analysis for speech scene",

abstract = "Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.",

keywords = "Head pose estimation, movement analysis, speech scene",

author = "Rinko Komiya and Takeshi Saitoh and Miharu Fuyuno and Yuko Yamashita and Yoshitaka Nakajima",

year = "2016",

month = "8",

day = "23",

doi = "10.1109/ICIS.2016.7550793",

language = "English",

booktitle = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 ; Conference date: 26-06-2016 Through 29-06-2016",

}

TY - GEN

T1 - Head pose estimation and movement analysis for speech scene

AU - Komiya, Rinko

AU - Saitoh, Takeshi

AU - Fuyuno, Miharu

AU - Yamashita, Yuko

AU - Nakajima, Yoshitaka

PY - 2016/8/23

Y1 - 2016/8/23

N2 - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

AB - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

KW - Head pose estimation

KW - movement analysis

KW - speech scene

UR - http://www.scopus.com/inward/record.url?scp=84988019765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988019765&partnerID=8YFLogxK

U2 - 10.1109/ICIS.2016.7550793

DO - 10.1109/ICIS.2016.7550793

M3 - Conference contribution

AN - SCOPUS:84988019765

BT - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016

Y2 - 26 June 2016 through 29 June 2016

ER -

Access to Document

10.1109/ICIS.2016.7550793