[논문]Image Based 3D Reconstruction of Texture-less Objects for VR Contents

Hafeez, Jahanzeb; Lee, Seunghyun; Kwon, Soonchul; Hamacher, Alaric

doi:10.7236/ijasc.2017.6.1.9

[국내논문] Image Based 3D Reconstruction of Texture-less Objects for VR Contents 원문보기

International journal of advanced smart convergence, v.6 no.1, 2017년, pp.9 - 17

Hafeez, Jahanzeb (Graduate School of Information Contents, Kwangwoon University) , Lee, Seunghyun (Graduate School of Information Contents, Kwangwoon University) , Kwon, Soonchul (Graduate School of Information Contents, Kwangwoon University) , Hamacher, Alaric (Graduate School of Information Contents, Kwangwoon University)

Abstract ▼ AI-Helper

Recent development in virtual and augmented reality increases the demand for content in many different fields. One of the fast ways to create content for VR is 3D modeling of real objects. In this paper we propose a system to reconstruct three-dimensional models of real objects from the set of two-dimensional images under the assumption that the subject does not has distinct features. We explicitly consider an object that is made of one or more surfaces and radiant constant energy isotropically. We design a low cost portable multi camera rig system that is capable of capturing images simultaneously from all cameras. In order to evaluate the performance of the proposed system, comparison is made between 3D model and a CAD model. A simple algorithm is also proposed to acquire original texture or color of the subject. Using best pattern found after the experiments, 3D model of the Pyeongchang Olympic Mascot "Soohorang" is created to use as VR content.

Keyword

AI 본문요약
AI-Helper

* AI 자동 식별 결과로 적합하지 않은 문장이 있을 수 있으니, 이용에 유의하시기 바랍니다.

가설 설정

In Figure 6, difference is clear between two models. In Figure 6(b) model reconstructed with images acquired under the projection of pattern, is more accurate and complete. However, model in Figure 6(a) is inaccurate and useless which is created with the images without projection.

제안 방법

In this paper, we address the problem of reconstructing 3D model of the objects of unrecognizable texture and made of smooth surfaces, from a collection of cameras. This is one of the classical problems in computer vision and broad literature exists [11].
The purpose of mesh simplification is to provide better 3D model of the object by removing the unwanted vertices and faces of the mesh.
Further, we consider this pattern to reconstruct 3D model of the Pyeongchang Olympic Mascot “Soohorang” because the surface of the Olympic Mascot is smooth and weekly textured . We also obtain another dataset with no projction to compare the resultant model with first model that is reconstructed with the dataset acquired under the projection of tiled lines pattern. Moreover, this dataset is also used to obtain the origional texture of the Olympic Mascot.

대상 데이터

In university of Calgary, a system was designed for the reconstruction of a torso surface. This system was made of several amateur cameras fixed on four metal arms. Four projectors were also used in order to provide artificial markers onto the surface of torso.

이론/모형

The detection of distinct features of the surface is a prerequisite for image matching. In the proposed method, these features are extracted using SIFT algorithm, which is a feature point detector [12]. The detected features describe the image rotation, image scale, noise, exposure and contrast changes.

참고문헌 (26)

A.S.R. Junior, E. C. W. Gonzales, L. Valente, and B. Feijo, "First steps towards Live-action Virtual Reality Games," SBC J. Interact. Syst., Vol. 7, No. 1, pp. 3-16, November 2016.
J. Torrente, B.A. Del, A. Serrano-Laguna, J.A. Vallejo-Pinto, P. Moreno-Ger, and B. Fernandez-Manjon, "Towards a low cost adaptation of educational games for people with disabilities," Comput. Sci. Inf. Syst., Vol. 11, No. 1, pp. 369-391, January 2014.

상세보기
A. Hamacher, S.J. Kim, S.T. Cho, S. Pardesahi, S.H. Lee, S.J. Eun, T.K. Whangbo, "Application of Virtual, Augmented, and Mixed Reality to Urology," Int. Neurourol. J., Vol. 20, No. 3, pp. 172-181, September 2016.

상세보기
F. Bruno, S. Bruno, G. De Sensi, M.-L. Luchi, S. Mancuso, and M. Muzzupappa, "From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition," J. Cult. Herit., Vol. 11, No. 1, pp. 42-49, March 2010.

상세보기
E. Madrigal, S. Prajapati, and J. C. Hernandez-Prera, "Introducing a Virtual Reality Experience in Anatomic Pathology Education," Am. J. Clin. Pathol., Vol. 146, No. 4, pp. 462-468, October 2016.

상세보기
F. Carroll, "Designing (for) experiences in photorealistic VR environments," New Rev. Hypermedia Multimed., Vol. 16, No. 1-2, pp. 181-194, April 2010.

상세보기
S. Aromaa and K. Vaananen, "Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design," Appl. Ergon., Vol. 56, pp. 11-18, September 2016.

상세보기
J. Hafeez, A. Hamacher, H. Son, S. Pardeshi, and S.H. Lee, "Workflow Evaluation for Optimized Image - Based 3D Model Reconstruction," in the Proc. of International Conference on Electronics, Electrical Engineering, Computer Science (EEECS) : Innovation and Convergence, vol. 2, pp. 62-65, 2016.
I. Detchev, A. Habib, and Y.-C. Chang, "Image Matching and Surface Registration for 3D Reconstruction of a Scoliotic Torso," GEOMATICA, Vol. 65, No. 2, pp. 175-187, June 2011.

상세보기
J. Schoning and G. Heidemann, "Evaluation of Multi-view 3D Reconstruction Software," in Proc. Of 16th International Conf. on Computer Analysis of Images and Patterns, pp. 450-461 2015.
C. Santagati, L. Inzerillo, and F. Di Paola, "Image-Based Modeling Techniques For Architectural Heritage 3d Digitalization: Limits And Potentialities," Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. XL-5, No. W2, pp. 555-560, September 2013.
D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int. J. Comput. Vis., Vol. 60, No. 2, pp. 91-110, November 2004.

상세보기
M. Maruyama and S. Abe, "Range sensing by projecting multiple slits with random cuts," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 15, No. 6, pp. 647-651, June 1993.

상세보기
S. Mahadevan, H. Pandzo, M. Bennamoun, and L. Williams, "A 3D acquisition and modelling system," in Proc. Of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 3, pp. 1941-1944, 2001.
S.Y. Chen and Y.F. Li, "Automatic sensor placement for model-based robot vision," IEEE Trans. Syst. Man Cybern. Part B Cybern., Vol. 34, No. 1, pp. 393-408, February 2004.
S. Larsson and J.A.P. Kjellander, "Path Planning for Laser Scanning with an Industrial Robot," Robot Auton Syst, Vol. 56, No. 7, pp. 615-624, July 2008.

상세보기
S. Paulus, J. Behmann, A.-K. Mahlein, L. Plumer, and H. Kuhlmann, "Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping," Sensors, Vol. 14, No. 2, pp. 3001-3018, February 2014.

상세보기
A. Hosseininaveh, R. Yazdan, A. Karami, M. Moradi, and F. Ghorbani, "A Low-Cost and Portable System for 3D Reconstruction of Texture-Less Objects," ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. 15, pp. 327-332, December 2015.
C. Wu, "Towards Linear-Time Incremental Structure from Motion," in Proceedings of the 2013 International Conference on 3D Vision, pp. 127-134, 2013.
C. Wu, S. Agarwal, B. Curless, and S. M. Seitz, "Multicore Bundle Adjustment," in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3057-3064, 2011.
Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multiview Stereopsis," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 32, No. 8, pp. 1362-1376, August 2010.

상세보기
M. Kazhdan, M. Bolitho, and H. Hoppe, "Poisson Surface Reconstruction," in Proceedings of the Fourth Eurographics Symposium on Geometry Processing, pp. 61-70, 2006.
Y. Wang, W. Wang, and E. Wu, "Optimizing the Parameters for Patch-based Texture Synthesis," in Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, pp. 75-82, 2006.
MeshLab, (version 1.3.4), http://meshlab.sourceforge.net/.
CloudCompare, (version 2.7.0), http://www.cloudcompare.org/.
P.J. Besl and H.D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, February 1992.

상세보기

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

[국내논문] Image Based 3D Reconstruction of Texture-less Objects for VR Contents 원문보기

Abstract ▼ AI-Helper

Keyword

AI 본문요약
AI-Helper

가설 설정

제안 방법

대상 데이터

이론/모형

참고문헌 (26)

이 논문을 인용한 문헌

저자의 다른 논문 :

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

연합인증

[국내논문] Image Based 3D Reconstruction of Texture-less Objects for VR Contents 원문보기

Abstract ▼ AI-Helper

Keyword

AI 본문요약 엑셀 다운로드 AI-Helper

가설 설정

제안 방법

대상 데이터

이론/모형

참고문헌 (26)

이 논문을 인용한 문헌

저자의 다른 논문 :

Hafeez, Jahanzeb (2) 이승현 (77) 권순철 (37) Hamacher, Alaric (3)

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

AI 본문요약
AI-Helper