CamTrackPoint

Camera-based pointing stick using transmitted light through finger

Wataru Yamada, Hiroyuki Manabe, Daizo Ikeda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We present CamTrackPoint, a new input interface that can be controlled by finger gestures captured by front or rear cameras of a mobile device. CamTrackPoint mounts a 3D-printed ring on the camera's bezel, and it senses the movements of the user's finger by tracking the light passed through the finger. The proposed method provides mobile devices with a new input interface that offers physical force feedback like a pointing stick. The cost of our method is low as it needs only a simple ring-shaped part on the camera bezel. Moreover, the ring doesn't disturb the functions of the camera, unless a user uses the interface. We implement a prototype for a smartphone; two CamTrackPoint rings are made for the front and rear cameras. We evaluate its performance and characteristics in an experiment. The proposed technique provides smooth scrolling and would give better game experience on the available smartphone.

Original languageEnglish
Title of host publicationUIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages313-320
Number of pages8
ISBN (Electronic)9781450359481
DOIs
Publication statusPublished - 2018 Oct 11
Externally publishedYes
Event31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018 - Berlin, Germany
Duration: 2018 Oct 142018 Oct 17

Publication series

NameUIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Conference

Conference31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018
CountryGermany
CityBerlin
Period18/10/1418/10/17

Fingerprint

Cameras
Smartphones
Mobile devices
Feedback
Costs
Experiments

Keywords

  • Back-of-device interaction
  • Gesture interface
  • Mobile
  • Pointing stick

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Yamada, W., Manabe, H., & Ikeda, D. (2018). CamTrackPoint: Camera-based pointing stick using transmitted light through finger. In UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (pp. 313-320). (UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3242587.3242641

CamTrackPoint : Camera-based pointing stick using transmitted light through finger. / Yamada, Wataru; Manabe, Hiroyuki; Ikeda, Daizo.

UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2018. p. 313-320 (UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yamada, W, Manabe, H & Ikeda, D 2018, CamTrackPoint: Camera-based pointing stick using transmitted light through finger. in UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery, Inc, pp. 313-320, 31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018, Berlin, Germany, 18/10/14. https://doi.org/10.1145/3242587.3242641
Yamada W, Manabe H, Ikeda D. CamTrackPoint: Camera-based pointing stick using transmitted light through finger. In UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc. 2018. p. 313-320. (UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/3242587.3242641
Yamada, Wataru ; Manabe, Hiroyuki ; Ikeda, Daizo. / CamTrackPoint : Camera-based pointing stick using transmitted light through finger. UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2018. pp. 313-320 (UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology).
@inproceedings{76ddcfa48f164baa8e7ebfe2f9b89834,
title = "CamTrackPoint: Camera-based pointing stick using transmitted light through finger",
abstract = "We present CamTrackPoint, a new input interface that can be controlled by finger gestures captured by front or rear cameras of a mobile device. CamTrackPoint mounts a 3D-printed ring on the camera's bezel, and it senses the movements of the user's finger by tracking the light passed through the finger. The proposed method provides mobile devices with a new input interface that offers physical force feedback like a pointing stick. The cost of our method is low as it needs only a simple ring-shaped part on the camera bezel. Moreover, the ring doesn't disturb the functions of the camera, unless a user uses the interface. We implement a prototype for a smartphone; two CamTrackPoint rings are made for the front and rear cameras. We evaluate its performance and characteristics in an experiment. The proposed technique provides smooth scrolling and would give better game experience on the available smartphone.",
keywords = "Back-of-device interaction, Gesture interface, Mobile, Pointing stick",
author = "Wataru Yamada and Hiroyuki Manabe and Daizo Ikeda",
year = "2018",
month = "10",
day = "11",
doi = "10.1145/3242587.3242641",
language = "English",
series = "UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology",
publisher = "Association for Computing Machinery, Inc",
pages = "313--320",
booktitle = "UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology",

}

TY - GEN

T1 - CamTrackPoint

T2 - Camera-based pointing stick using transmitted light through finger

AU - Yamada, Wataru

AU - Manabe, Hiroyuki

AU - Ikeda, Daizo

PY - 2018/10/11

Y1 - 2018/10/11

N2 - We present CamTrackPoint, a new input interface that can be controlled by finger gestures captured by front or rear cameras of a mobile device. CamTrackPoint mounts a 3D-printed ring on the camera's bezel, and it senses the movements of the user's finger by tracking the light passed through the finger. The proposed method provides mobile devices with a new input interface that offers physical force feedback like a pointing stick. The cost of our method is low as it needs only a simple ring-shaped part on the camera bezel. Moreover, the ring doesn't disturb the functions of the camera, unless a user uses the interface. We implement a prototype for a smartphone; two CamTrackPoint rings are made for the front and rear cameras. We evaluate its performance and characteristics in an experiment. The proposed technique provides smooth scrolling and would give better game experience on the available smartphone.

AB - We present CamTrackPoint, a new input interface that can be controlled by finger gestures captured by front or rear cameras of a mobile device. CamTrackPoint mounts a 3D-printed ring on the camera's bezel, and it senses the movements of the user's finger by tracking the light passed through the finger. The proposed method provides mobile devices with a new input interface that offers physical force feedback like a pointing stick. The cost of our method is low as it needs only a simple ring-shaped part on the camera bezel. Moreover, the ring doesn't disturb the functions of the camera, unless a user uses the interface. We implement a prototype for a smartphone; two CamTrackPoint rings are made for the front and rear cameras. We evaluate its performance and characteristics in an experiment. The proposed technique provides smooth scrolling and would give better game experience on the available smartphone.

KW - Back-of-device interaction

KW - Gesture interface

KW - Mobile

KW - Pointing stick

UR - http://www.scopus.com/inward/record.url?scp=85056827029&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056827029&partnerID=8YFLogxK

U2 - 10.1145/3242587.3242641

DO - 10.1145/3242587.3242641

M3 - Conference contribution

T3 - UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

SP - 313

EP - 320

BT - UIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

PB - Association for Computing Machinery, Inc

ER -