Reconstruction of a 3D model from single 2D image by GAN

研究成果: Conference contribution

抜粋

In this paper, we propose a method for reconstructing the 3D model from a single 2D image. The current cutting-edge methods for 3D reconstruction use the GAN (Generative Adversarial Network) to generate the model. However, the methods require multiple 2D images to reconstruct the 3D model, because all the information of a real object cannot be obtained from only one side, especially the back of the object is invisible. Since rebuilding a 3D model from a single view is an important issue in practical applications, the system requires the ability to obtain information about the surrounding environment of the object more quickly without the need for the object to move around. Therefore, we propose a method for reconstructing 3D models from an image by learning the relationship between 3D model and 2D image. Mainly this method consists of three parts. The first part is the view layer, observing real-world objects and capturing 2D images. The layer searches the related 2D image of the 3D model that exists in the 3D model library. The second part is the corresponding layer. The 2D image corresponding to the 3D model is taken out, and contrast with real-world 2D images of objects. The 2D cross-section of the 3D model is found as the most similar one to the 2D image of the real-world object. The third part is generative layer that based on the model library to find the corresponding 3D model, reconstructing a 3D model that corresponds to the real object by using the GAN.

元の言語English
ホスト出版物のタイトルMulti-disciplinary Trends in Artificial Intelligence - 12th International Conference, MIWAI 2018, Proceedings
編集者Rainer Malaka, Manasawee Kaenampornpan, Duc Dung Nguyen, Nicolas Schwind
出版者Springer Verlag
ページ226-232
ページ数7
ISBN(印刷物)9783030030131
DOI
出版物ステータスPublished - 2018 1 1
イベント12th Multi-disciplinary International Conference on Artificial Intelligence, MIWAI 2018 - Hanoi, Viet Nam
継続期間: 2018 11 182018 11 20

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11248 LNAI
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Other

Other12th Multi-disciplinary International Conference on Artificial Intelligence, MIWAI 2018
Viet Nam
Hanoi
期間18/11/1818/11/20

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント Reconstruction of a 3D model from single 2D image by GAN' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Si, L., & Yasumura, Y. (2018). Reconstruction of a 3D model from single 2D image by GAN. : R. Malaka, M. Kaenampornpan, D. D. Nguyen, & N. Schwind (版), Multi-disciplinary Trends in Artificial Intelligence - 12th International Conference, MIWAI 2018, Proceedings (pp. 226-232). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 11248 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-030-03014-8_20