Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images

Qiuyu Chen, Ryoma Bise, Lin Gu, Yinqiang Zheng, Imari Sato, Jenq Neng Hwang, Sadakazu Aiso, Nobuaki Imanishi

研究成果: Conference contribution

抄録

We propose a fully automatic system to reconstruct and visualize 3D blood vessels in Augmented Reality (AR) system from stereo X-ray images with bones and body fat. Currently, typical 3D imaging technologies are expensive and carrying the risk of irradiation exposure. To reduce the potential harm, we only need to take two X-ray images before visualizing the vessels. Our system can effectively reconstruct and visualize vessels in following steps. We first conduct initial segmentation using Markov Random Field and then refine segmentation in an entropy based post-process. We parse the segmented vessels by extracting their centerlines and generating trees. We propose a coarse-to-fine scheme for stereo matching, including initial matching using affine transform and dense matching using Hungarian algorithm guided by Gaussian regression. Finally, we render and visualize the reconstructed model in a HoloLens based AR system, which can essentially change the way of visualizing medical data. We have evaluated its performance by using synthetic and real stereo X-ray images, and achieved satisfactory quantitative and qualitative results.

元の言語English
ホスト出版物のタイトルProceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017
出版者Institute of Electrical and Electronics Engineers Inc.
ページ99-106
ページ数8
2018-January
ISBN(電子版)9781538610343
DOI
出版物ステータスPublished - 2018 1 19
外部発表Yes
イベント16th IEEE International Conference on Computer Vision Workshops, ICCVW 2017 - Venice, Italy
継続期間: 2017 10 222017 10 29

Other

Other16th IEEE International Conference on Computer Vision Workshops, ICCVW 2017
Italy
Venice
期間17/10/2217/10/29

Fingerprint

Blood vessels
Augmented reality
X rays
Affine transforms
Oils and fats
Bone
Entropy
Irradiation
Imaging techniques

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition

これを引用

Chen, Q., Bise, R., Gu, L., Zheng, Y., Sato, I., Hwang, J. N., ... Imanishi, N. (2018). Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images. : Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017 (巻 2018-January, pp. 99-106). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCVW.2017.20

Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images. / Chen, Qiuyu; Bise, Ryoma; Gu, Lin; Zheng, Yinqiang; Sato, Imari; Hwang, Jenq Neng; Aiso, Sadakazu; Imanishi, Nobuaki.

Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017. 巻 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 99-106.

研究成果: Conference contribution

Chen, Q, Bise, R, Gu, L, Zheng, Y, Sato, I, Hwang, JN, Aiso, S & Imanishi, N 2018, Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images. : Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017. 巻. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 99-106, 16th IEEE International Conference on Computer Vision Workshops, ICCVW 2017, Venice, Italy, 17/10/22. https://doi.org/10.1109/ICCVW.2017.20
Chen Q, Bise R, Gu L, Zheng Y, Sato I, Hwang JN その他. Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images. : Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017. 巻 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 99-106 https://doi.org/10.1109/ICCVW.2017.20
Chen, Qiuyu ; Bise, Ryoma ; Gu, Lin ; Zheng, Yinqiang ; Sato, Imari ; Hwang, Jenq Neng ; Aiso, Sadakazu ; Imanishi, Nobuaki. / Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images. Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017. 巻 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 99-106
@inproceedings{809c4cc895b84b33a235b791c24bb8fe,
title = "Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images",
abstract = "We propose a fully automatic system to reconstruct and visualize 3D blood vessels in Augmented Reality (AR) system from stereo X-ray images with bones and body fat. Currently, typical 3D imaging technologies are expensive and carrying the risk of irradiation exposure. To reduce the potential harm, we only need to take two X-ray images before visualizing the vessels. Our system can effectively reconstruct and visualize vessels in following steps. We first conduct initial segmentation using Markov Random Field and then refine segmentation in an entropy based post-process. We parse the segmented vessels by extracting their centerlines and generating trees. We propose a coarse-to-fine scheme for stereo matching, including initial matching using affine transform and dense matching using Hungarian algorithm guided by Gaussian regression. Finally, we render and visualize the reconstructed model in a HoloLens based AR system, which can essentially change the way of visualizing medical data. We have evaluated its performance by using synthetic and real stereo X-ray images, and achieved satisfactory quantitative and qualitative results.",
author = "Qiuyu Chen and Ryoma Bise and Lin Gu and Yinqiang Zheng and Imari Sato and Hwang, {Jenq Neng} and Sadakazu Aiso and Nobuaki Imanishi",
year = "2018",
month = "1",
day = "19",
doi = "10.1109/ICCVW.2017.20",
language = "English",
volume = "2018-January",
pages = "99--106",
booktitle = "Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Virtual Blood Vessels in Complex Background Using Stereo X-Ray Images

AU - Chen, Qiuyu

AU - Bise, Ryoma

AU - Gu, Lin

AU - Zheng, Yinqiang

AU - Sato, Imari

AU - Hwang, Jenq Neng

AU - Aiso, Sadakazu

AU - Imanishi, Nobuaki

PY - 2018/1/19

Y1 - 2018/1/19

N2 - We propose a fully automatic system to reconstruct and visualize 3D blood vessels in Augmented Reality (AR) system from stereo X-ray images with bones and body fat. Currently, typical 3D imaging technologies are expensive and carrying the risk of irradiation exposure. To reduce the potential harm, we only need to take two X-ray images before visualizing the vessels. Our system can effectively reconstruct and visualize vessels in following steps. We first conduct initial segmentation using Markov Random Field and then refine segmentation in an entropy based post-process. We parse the segmented vessels by extracting their centerlines and generating trees. We propose a coarse-to-fine scheme for stereo matching, including initial matching using affine transform and dense matching using Hungarian algorithm guided by Gaussian regression. Finally, we render and visualize the reconstructed model in a HoloLens based AR system, which can essentially change the way of visualizing medical data. We have evaluated its performance by using synthetic and real stereo X-ray images, and achieved satisfactory quantitative and qualitative results.

AB - We propose a fully automatic system to reconstruct and visualize 3D blood vessels in Augmented Reality (AR) system from stereo X-ray images with bones and body fat. Currently, typical 3D imaging technologies are expensive and carrying the risk of irradiation exposure. To reduce the potential harm, we only need to take two X-ray images before visualizing the vessels. Our system can effectively reconstruct and visualize vessels in following steps. We first conduct initial segmentation using Markov Random Field and then refine segmentation in an entropy based post-process. We parse the segmented vessels by extracting their centerlines and generating trees. We propose a coarse-to-fine scheme for stereo matching, including initial matching using affine transform and dense matching using Hungarian algorithm guided by Gaussian regression. Finally, we render and visualize the reconstructed model in a HoloLens based AR system, which can essentially change the way of visualizing medical data. We have evaluated its performance by using synthetic and real stereo X-ray images, and achieved satisfactory quantitative and qualitative results.

UR - http://www.scopus.com/inward/record.url?scp=85046276135&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046276135&partnerID=8YFLogxK

U2 - 10.1109/ICCVW.2017.20

DO - 10.1109/ICCVW.2017.20

M3 - Conference contribution

AN - SCOPUS:85046276135

VL - 2018-January

SP - 99

EP - 106

BT - Proceedings - 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -