Semi-automated excavation system for partially buried objects using stereo vision-based three-dimensional localization

Kenichi Maruyama, Ryuichi Takase, Yoshihiro Kawai, Takashi Yoshimi, Hironobu Takahashi, Fumiaki Tomita

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

We present a semi-automated excavation system for partially buried objects in unstructured environments. This system is a prototype of an excavation system for abandoned chemical weapons. It integrates three-dimensional (3-D) sensing by a stereo camera system, 3-D object localization, verification by a human operator and robot manipulation. The 3-D object localization method used consists of three steps. (i) Candidate regions are extracted from a range image obtained by an area-based stereo-matching method. (ii) For each region, multiple hypotheses for the position and orientation are generated for each object model. (iii) Each hypothesis is verified and improved by an iterative method. The operator verifies the object localization results and then selects one of the objects as the best object that is suitable for grasping by the robot. The robot grasps objects based on the object localization result. Experiments demonstrate the effectiveness of the proposed excavation system in various unstructured environments, which include objects that are partially buried, inclined, overlapping each other and that have been sprinkled with water.

Original languageEnglish
Pages (from-to)651-670
Number of pages20
JournalAdvanced Robotics
Volume24
Issue number5-6
DOIs
Publication statusPublished - 2010 Apr 14
Externally publishedYes

Fingerprint

Stereo vision
Excavation
Robots
Iterative methods
Mathematical operators
Cameras
Water
Experiments

Keywords

  • Robot system
  • Semi-automated system
  • Stereo vision
  • Three-dimensional object localization
  • Unstructured environments

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Hardware and Architecture
  • Software

Cite this

Semi-automated excavation system for partially buried objects using stereo vision-based three-dimensional localization. / Maruyama, Kenichi; Takase, Ryuichi; Kawai, Yoshihiro; Yoshimi, Takashi; Takahashi, Hironobu; Tomita, Fumiaki.

In: Advanced Robotics, Vol. 24, No. 5-6, 14.04.2010, p. 651-670.

Research output: Contribution to journalArticle

Maruyama, Kenichi ; Takase, Ryuichi ; Kawai, Yoshihiro ; Yoshimi, Takashi ; Takahashi, Hironobu ; Tomita, Fumiaki. / Semi-automated excavation system for partially buried objects using stereo vision-based three-dimensional localization. In: Advanced Robotics. 2010 ; Vol. 24, No. 5-6. pp. 651-670.
@article{e10d37152ba241758b41daffa32dbe10,
title = "Semi-automated excavation system for partially buried objects using stereo vision-based three-dimensional localization",
abstract = "We present a semi-automated excavation system for partially buried objects in unstructured environments. This system is a prototype of an excavation system for abandoned chemical weapons. It integrates three-dimensional (3-D) sensing by a stereo camera system, 3-D object localization, verification by a human operator and robot manipulation. The 3-D object localization method used consists of three steps. (i) Candidate regions are extracted from a range image obtained by an area-based stereo-matching method. (ii) For each region, multiple hypotheses for the position and orientation are generated for each object model. (iii) Each hypothesis is verified and improved by an iterative method. The operator verifies the object localization results and then selects one of the objects as the best object that is suitable for grasping by the robot. The robot grasps objects based on the object localization result. Experiments demonstrate the effectiveness of the proposed excavation system in various unstructured environments, which include objects that are partially buried, inclined, overlapping each other and that have been sprinkled with water.",
keywords = "Robot system, Semi-automated system, Stereo vision, Three-dimensional object localization, Unstructured environments",
author = "Kenichi Maruyama and Ryuichi Takase and Yoshihiro Kawai and Takashi Yoshimi and Hironobu Takahashi and Fumiaki Tomita",
year = "2010",
month = "4",
day = "14",
doi = "10.1163/016918610X493525",
language = "English",
volume = "24",
pages = "651--670",
journal = "Advanced Robotics",
issn = "0169-1864",
publisher = "Taylor and Francis Ltd.",
number = "5-6",

}

TY - JOUR

T1 - Semi-automated excavation system for partially buried objects using stereo vision-based three-dimensional localization

AU - Maruyama, Kenichi

AU - Takase, Ryuichi

AU - Kawai, Yoshihiro

AU - Yoshimi, Takashi

AU - Takahashi, Hironobu

AU - Tomita, Fumiaki

PY - 2010/4/14

Y1 - 2010/4/14

N2 - We present a semi-automated excavation system for partially buried objects in unstructured environments. This system is a prototype of an excavation system for abandoned chemical weapons. It integrates three-dimensional (3-D) sensing by a stereo camera system, 3-D object localization, verification by a human operator and robot manipulation. The 3-D object localization method used consists of three steps. (i) Candidate regions are extracted from a range image obtained by an area-based stereo-matching method. (ii) For each region, multiple hypotheses for the position and orientation are generated for each object model. (iii) Each hypothesis is verified and improved by an iterative method. The operator verifies the object localization results and then selects one of the objects as the best object that is suitable for grasping by the robot. The robot grasps objects based on the object localization result. Experiments demonstrate the effectiveness of the proposed excavation system in various unstructured environments, which include objects that are partially buried, inclined, overlapping each other and that have been sprinkled with water.

AB - We present a semi-automated excavation system for partially buried objects in unstructured environments. This system is a prototype of an excavation system for abandoned chemical weapons. It integrates three-dimensional (3-D) sensing by a stereo camera system, 3-D object localization, verification by a human operator and robot manipulation. The 3-D object localization method used consists of three steps. (i) Candidate regions are extracted from a range image obtained by an area-based stereo-matching method. (ii) For each region, multiple hypotheses for the position and orientation are generated for each object model. (iii) Each hypothesis is verified and improved by an iterative method. The operator verifies the object localization results and then selects one of the objects as the best object that is suitable for grasping by the robot. The robot grasps objects based on the object localization result. Experiments demonstrate the effectiveness of the proposed excavation system in various unstructured environments, which include objects that are partially buried, inclined, overlapping each other and that have been sprinkled with water.

KW - Robot system

KW - Semi-automated system

KW - Stereo vision

KW - Three-dimensional object localization

KW - Unstructured environments

UR - http://www.scopus.com/inward/record.url?scp=77951793805&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77951793805&partnerID=8YFLogxK

U2 - 10.1163/016918610X493525

DO - 10.1163/016918610X493525

M3 - Article

VL - 24

SP - 651

EP - 670

JO - Advanced Robotics

JF - Advanced Robotics

SN - 0169-1864

IS - 5-6

ER -