A Study on Mobile Robot Control by Hand gesture Detection

Shinichi Ikegami, Chinthaka Premachandra, B. H. Sudantha, S. Sumathipala

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, method of controlling machine with natural control called Natural User Interface has attracted attention. particularly, human hand is considered to be communication media that can communicate information most naturally. In this paper, user hand is detected by following acquired skin color of the user's face, through face detection. After detecting the user hand, hand gesture is determined. Finally, a robot is controlled to have multi movements according to detected several hand gesture patterns. We succeeded in acquiring the skin color information from user's face and detecting both user's hand and hand gesture following that. In this paper, we developed a mobile robot to conduct experiments. We also confirmed that robot can be controlled by human hand gesture.

Original languageEnglish
Title of host publication2018 3rd International Conference on Information Technology Research, ICITR 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728114705
DOIs
Publication statusPublished - 2018 Dec 1
Event3rd International Conference on Information Technology Research, ICITR 2018 - Moratuwa, Sri Lanka
Duration: 2018 Dec 52018 Dec 7

Publication series

Name2018 3rd International Conference on Information Technology Research, ICITR 2018

Conference

Conference3rd International Conference on Information Technology Research, ICITR 2018
CountrySri Lanka
CityMoratuwa
Period18/12/518/12/7

Fingerprint

End effectors
Mobile robots
Skin
Robots
Color
Face recognition
User interfaces
Communication
Experiments
Robot

Keywords

  • Image Processing
  • mobile robot control
  • NUI
  • Raspberry pi

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems and Management
  • Media Technology

Cite this

Ikegami, S., Premachandra, C., Sudantha, B. H., & Sumathipala, S. (2018). A Study on Mobile Robot Control by Hand gesture Detection. In 2018 3rd International Conference on Information Technology Research, ICITR 2018 [8736135] (2018 3rd International Conference on Information Technology Research, ICITR 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICITR.2018.8736135

A Study on Mobile Robot Control by Hand gesture Detection. / Ikegami, Shinichi; Premachandra, Chinthaka; Sudantha, B. H.; Sumathipala, S.

2018 3rd International Conference on Information Technology Research, ICITR 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8736135 (2018 3rd International Conference on Information Technology Research, ICITR 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ikegami, S, Premachandra, C, Sudantha, BH & Sumathipala, S 2018, A Study on Mobile Robot Control by Hand gesture Detection. in 2018 3rd International Conference on Information Technology Research, ICITR 2018., 8736135, 2018 3rd International Conference on Information Technology Research, ICITR 2018, Institute of Electrical and Electronics Engineers Inc., 3rd International Conference on Information Technology Research, ICITR 2018, Moratuwa, Sri Lanka, 18/12/5. https://doi.org/10.1109/ICITR.2018.8736135
Ikegami S, Premachandra C, Sudantha BH, Sumathipala S. A Study on Mobile Robot Control by Hand gesture Detection. In 2018 3rd International Conference on Information Technology Research, ICITR 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8736135. (2018 3rd International Conference on Information Technology Research, ICITR 2018). https://doi.org/10.1109/ICITR.2018.8736135
Ikegami, Shinichi ; Premachandra, Chinthaka ; Sudantha, B. H. ; Sumathipala, S. / A Study on Mobile Robot Control by Hand gesture Detection. 2018 3rd International Conference on Information Technology Research, ICITR 2018. Institute of Electrical and Electronics Engineers Inc., 2018. (2018 3rd International Conference on Information Technology Research, ICITR 2018).
@inproceedings{ff35ab69b9d9460e9c9f9b4ac1c5edf7,
title = "A Study on Mobile Robot Control by Hand gesture Detection",
abstract = "Recently, method of controlling machine with natural control called Natural User Interface has attracted attention. particularly, human hand is considered to be communication media that can communicate information most naturally. In this paper, user hand is detected by following acquired skin color of the user's face, through face detection. After detecting the user hand, hand gesture is determined. Finally, a robot is controlled to have multi movements according to detected several hand gesture patterns. We succeeded in acquiring the skin color information from user's face and detecting both user's hand and hand gesture following that. In this paper, we developed a mobile robot to conduct experiments. We also confirmed that robot can be controlled by human hand gesture.",
keywords = "Image Processing, mobile robot control, NUI, Raspberry pi",
author = "Shinichi Ikegami and Chinthaka Premachandra and Sudantha, {B. H.} and S. Sumathipala",
year = "2018",
month = "12",
day = "1",
doi = "10.1109/ICITR.2018.8736135",
language = "English",
series = "2018 3rd International Conference on Information Technology Research, ICITR 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2018 3rd International Conference on Information Technology Research, ICITR 2018",

}

TY - GEN

T1 - A Study on Mobile Robot Control by Hand gesture Detection

AU - Ikegami, Shinichi

AU - Premachandra, Chinthaka

AU - Sudantha, B. H.

AU - Sumathipala, S.

PY - 2018/12/1

Y1 - 2018/12/1

N2 - Recently, method of controlling machine with natural control called Natural User Interface has attracted attention. particularly, human hand is considered to be communication media that can communicate information most naturally. In this paper, user hand is detected by following acquired skin color of the user's face, through face detection. After detecting the user hand, hand gesture is determined. Finally, a robot is controlled to have multi movements according to detected several hand gesture patterns. We succeeded in acquiring the skin color information from user's face and detecting both user's hand and hand gesture following that. In this paper, we developed a mobile robot to conduct experiments. We also confirmed that robot can be controlled by human hand gesture.

AB - Recently, method of controlling machine with natural control called Natural User Interface has attracted attention. particularly, human hand is considered to be communication media that can communicate information most naturally. In this paper, user hand is detected by following acquired skin color of the user's face, through face detection. After detecting the user hand, hand gesture is determined. Finally, a robot is controlled to have multi movements according to detected several hand gesture patterns. We succeeded in acquiring the skin color information from user's face and detecting both user's hand and hand gesture following that. In this paper, we developed a mobile robot to conduct experiments. We also confirmed that robot can be controlled by human hand gesture.

KW - Image Processing

KW - mobile robot control

KW - NUI

KW - Raspberry pi

UR - http://www.scopus.com/inward/record.url?scp=85068473060&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068473060&partnerID=8YFLogxK

U2 - 10.1109/ICITR.2018.8736135

DO - 10.1109/ICITR.2018.8736135

M3 - Conference contribution

AN - SCOPUS:85068473060

T3 - 2018 3rd International Conference on Information Technology Research, ICITR 2018

BT - 2018 3rd International Conference on Information Technology Research, ICITR 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -