Development of a person following robot with vision based target detection

Takashi Yoshimi, Manabu Nishiyama, Takafumi Sonoura, Hideichi Nakamoto, Seiji Tokura, Hirokazu Sato, Fumio Ozaki, Nobuto Matsuhira, Hiroshi Mizoguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

76 Citations (Scopus)

Abstract

We have developed the person following robot "ApriAttenda™" . This robot can accompany a person using vision based target detection and avoid obstacles with ultrasonic sensors while following the person. The robot first identifies an individual with its image processing system by detecting a person's region and recognizing the registered color and texture of his/her clothes. Usually, the person following robot has to detect and recognize the specified person and calculate his/her position in a complicated real-life environment of fixed objects and moving people. Our newly developed algorithm allows the robot to extract a particular individual from a cluttered background, and to find and reconnect with the person if it loses visual contact. Tracking people with stereo vision was realized by systematizing visual and motion control with a robust algorithm that utilizes various characteristics of the image data. The developed algorithm uses several analyses to extract information on the distance to each feature point, speed of target, color and texture of clothes for a stable tracking in many situations including changes of view due to self motion, shifts in lighting and objects similar to the target. The person following robot ApriAttenda™ has been exhibited at Aichi EXPO 2005, and its robust functions and smooth person following capability were successfully demonstrated.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
Pages5286-5291
Number of pages6
DOIs
Publication statusPublished - 2006
Externally publishedYes
Event2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2006 - Beijing
Duration: 2006 Oct 92006 Oct 15

Other

Other2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2006
CityBeijing
Period06/10/906/10/15

Fingerprint

Target tracking
Robots
Textures
Color
Ultrasonic sensors
Stereo vision
Motion control
Image processing
Lighting

Keywords

  • Collision avoidance
  • Image processing
  • Motion control
  • Person following

ASJC Scopus subject areas

  • Control and Systems Engineering

Cite this

Yoshimi, T., Nishiyama, M., Sonoura, T., Nakamoto, H., Tokura, S., Sato, H., ... Mizoguchi, H. (2006). Development of a person following robot with vision based target detection. In IEEE International Conference on Intelligent Robots and Systems (pp. 5286-5291). [4059266] https://doi.org/10.1109/IROS.2006.282029

Development of a person following robot with vision based target detection. / Yoshimi, Takashi; Nishiyama, Manabu; Sonoura, Takafumi; Nakamoto, Hideichi; Tokura, Seiji; Sato, Hirokazu; Ozaki, Fumio; Matsuhira, Nobuto; Mizoguchi, Hiroshi.

IEEE International Conference on Intelligent Robots and Systems. 2006. p. 5286-5291 4059266.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yoshimi, T, Nishiyama, M, Sonoura, T, Nakamoto, H, Tokura, S, Sato, H, Ozaki, F, Matsuhira, N & Mizoguchi, H 2006, Development of a person following robot with vision based target detection. in IEEE International Conference on Intelligent Robots and Systems., 4059266, pp. 5286-5291, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2006, Beijing, 06/10/9. https://doi.org/10.1109/IROS.2006.282029
Yoshimi T, Nishiyama M, Sonoura T, Nakamoto H, Tokura S, Sato H et al. Development of a person following robot with vision based target detection. In IEEE International Conference on Intelligent Robots and Systems. 2006. p. 5286-5291. 4059266 https://doi.org/10.1109/IROS.2006.282029
Yoshimi, Takashi ; Nishiyama, Manabu ; Sonoura, Takafumi ; Nakamoto, Hideichi ; Tokura, Seiji ; Sato, Hirokazu ; Ozaki, Fumio ; Matsuhira, Nobuto ; Mizoguchi, Hiroshi. / Development of a person following robot with vision based target detection. IEEE International Conference on Intelligent Robots and Systems. 2006. pp. 5286-5291
@inproceedings{312a6289b9004af4b5c328c80fa6caa0,
title = "Development of a person following robot with vision based target detection",
abstract = "We have developed the person following robot {"}ApriAttenda™{"} . This robot can accompany a person using vision based target detection and avoid obstacles with ultrasonic sensors while following the person. The robot first identifies an individual with its image processing system by detecting a person's region and recognizing the registered color and texture of his/her clothes. Usually, the person following robot has to detect and recognize the specified person and calculate his/her position in a complicated real-life environment of fixed objects and moving people. Our newly developed algorithm allows the robot to extract a particular individual from a cluttered background, and to find and reconnect with the person if it loses visual contact. Tracking people with stereo vision was realized by systematizing visual and motion control with a robust algorithm that utilizes various characteristics of the image data. The developed algorithm uses several analyses to extract information on the distance to each feature point, speed of target, color and texture of clothes for a stable tracking in many situations including changes of view due to self motion, shifts in lighting and objects similar to the target. The person following robot ApriAttenda™ has been exhibited at Aichi EXPO 2005, and its robust functions and smooth person following capability were successfully demonstrated.",
keywords = "Collision avoidance, Image processing, Motion control, Person following",
author = "Takashi Yoshimi and Manabu Nishiyama and Takafumi Sonoura and Hideichi Nakamoto and Seiji Tokura and Hirokazu Sato and Fumio Ozaki and Nobuto Matsuhira and Hiroshi Mizoguchi",
year = "2006",
doi = "10.1109/IROS.2006.282029",
language = "English",
isbn = "142440259X",
pages = "5286--5291",
booktitle = "IEEE International Conference on Intelligent Robots and Systems",

}

TY - GEN

T1 - Development of a person following robot with vision based target detection

AU - Yoshimi, Takashi

AU - Nishiyama, Manabu

AU - Sonoura, Takafumi

AU - Nakamoto, Hideichi

AU - Tokura, Seiji

AU - Sato, Hirokazu

AU - Ozaki, Fumio

AU - Matsuhira, Nobuto

AU - Mizoguchi, Hiroshi

PY - 2006

Y1 - 2006

N2 - We have developed the person following robot "ApriAttenda™" . This robot can accompany a person using vision based target detection and avoid obstacles with ultrasonic sensors while following the person. The robot first identifies an individual with its image processing system by detecting a person's region and recognizing the registered color and texture of his/her clothes. Usually, the person following robot has to detect and recognize the specified person and calculate his/her position in a complicated real-life environment of fixed objects and moving people. Our newly developed algorithm allows the robot to extract a particular individual from a cluttered background, and to find and reconnect with the person if it loses visual contact. Tracking people with stereo vision was realized by systematizing visual and motion control with a robust algorithm that utilizes various characteristics of the image data. The developed algorithm uses several analyses to extract information on the distance to each feature point, speed of target, color and texture of clothes for a stable tracking in many situations including changes of view due to self motion, shifts in lighting and objects similar to the target. The person following robot ApriAttenda™ has been exhibited at Aichi EXPO 2005, and its robust functions and smooth person following capability were successfully demonstrated.

AB - We have developed the person following robot "ApriAttenda™" . This robot can accompany a person using vision based target detection and avoid obstacles with ultrasonic sensors while following the person. The robot first identifies an individual with its image processing system by detecting a person's region and recognizing the registered color and texture of his/her clothes. Usually, the person following robot has to detect and recognize the specified person and calculate his/her position in a complicated real-life environment of fixed objects and moving people. Our newly developed algorithm allows the robot to extract a particular individual from a cluttered background, and to find and reconnect with the person if it loses visual contact. Tracking people with stereo vision was realized by systematizing visual and motion control with a robust algorithm that utilizes various characteristics of the image data. The developed algorithm uses several analyses to extract information on the distance to each feature point, speed of target, color and texture of clothes for a stable tracking in many situations including changes of view due to self motion, shifts in lighting and objects similar to the target. The person following robot ApriAttenda™ has been exhibited at Aichi EXPO 2005, and its robust functions and smooth person following capability were successfully demonstrated.

KW - Collision avoidance

KW - Image processing

KW - Motion control

KW - Person following

UR - http://www.scopus.com/inward/record.url?scp=34250661914&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34250661914&partnerID=8YFLogxK

U2 - 10.1109/IROS.2006.282029

DO - 10.1109/IROS.2006.282029

M3 - Conference contribution

SN - 142440259X

SN - 9781424402595

SP - 5286

EP - 5291

BT - IEEE International Conference on Intelligent Robots and Systems

ER -