[논문]A Unified Framework for Street-View Panorama Stitching

Li, Li; Yao, Jian; Xie, Renping; Xia, Menghan; Zhang, Wei

doi:10.3390/s17010001

A Unified Framework for Street-View Panorama Stitching 원문보기

Sensors, v.17 no.1, 2017년, pp.1 -

Li, Li (School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China) , Yao, Jian (li.li@whu.edu.cn (L.L.)) , Xie, Renping (renping.xie@whu.edu.cn (R.X.)) , Xia, Menghan (menghx@whu.edu.cn (M.X.)) , Zhang, Wei (School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China)

Abstract ▼ AI-Helper

In this paper, we propose a unified framework to generate a pleasant and high-quality street-view panorama by stitching multiple panoramic images captured from the cameras mounted on the mobile platform. Our proposed framework is comprised of four major steps: image warping, color correction, optimal seam line detection and image blending. Since the input images are captured without a precisely common projection center from the scenes with the depth differences with respect to the cameras to different extents, such images cannot be precisely aligned in geometry. Therefore, an efficient image warping method based on the dense optical flow field is proposed to greatly suppress the influence of large geometric misalignment at first. Then, to lessen the influence of photometric inconsistencies caused by the illumination variations and different exposure settings, we propose an efficient color correction algorithm via matching extreme points of histograms to greatly decrease color differences between warped images. After that, the optimal seam lines between adjacent input images are detected via the graph cut energy minimization framework. At last, the Laplacian pyramid blending algorithm is applied to further eliminate the stitching artifacts along the optimal seam lines. Experimental results on a large set of challenging street-view panoramic images captured form the real world illustrate that the proposed system is capable of creating high-quality panoramas.

주제어

참고문헌 (55)

1. Du Q. Raksuntorn N. Orduyilmaz A. Bruce L.M. Automatic registration and mosaicking for airborne multispectral image sequences Photogramm. Eng. Remote Sens. 2008 74 169 181 10.14358/PERS.74.2.169

상세보기
2. Chon J. Kim H. Lin C.S. Seam-line determination for image mosaicking: A technique minimizing the maximum local mismatch and the global cost ISPRS J. Photogramm. Remote Sens. 2010 65 86 92 10.1016/j.isprsjprs.2009.09.001

상세보기
3. Wan Y. Wang D. Xiao J. Lai X. Xu J. Automatic determination of seamlines for aerial image mosaicking based on vector roads alone ISPRS J. Photogramm. Remote Sens. 2013 76 1 10 10.1016/j.isprsjprs.2012.11.002

상세보기
4. Pan J. Zhou Q. Wang M. Seamline Determination Based on Segmentation for Urban Image Mosaicking IEEE Trans. Geosci. Remote Sens. Lett. 2014 11 1335 1339 10.1109/LGRS.2013.2293197

상세보기
5. Pang S. Sun M. Hu X. Zhang Z. SGM-based seamline determination for urban orthophoto mosaicking ISPRS J. Photogramm. Remote Sens. 2016 112 1 12 10.1016/j.isprsjprs.2015.11.007

상세보기
6. Kerschner M. Seamline detection in colour orthoimage mosaicking by use of twin snakes ISPRS J. Photogramm. Remote Sens. 2001 56 53 64 10.1016/S0924-2716(01)00033-8

상세보기
7. Soille P. Morphological image compositing IEEE Trans. Pattern Anal. Mach. Intell. 2006 28 673 683 10.1109/TPAMI.2006.99 16640255

상세보기
8. Yang Y. Gao Y. Li H. Han Y. An algorithm for remote sensing image mosaic based on valid area Proceedings of the International Symposium on Image and Data Fusion (ISIDF) Tengchong, China 9–11 August 2011
9. Li X. Hui N. Shen H. Fu Y. Zhang L. A robust mosaicking procedure for high spatial resolution remote sensing images ISPRS J. Photogramm. Remote Sens. 2015 109 108 125 10.1016/j.isprsjprs.2015.09.009

상세보기
10. Agarwala A. Dontcheva M. Agrawala M. Drucker S. Colburn A. Curless B. Salesin D. Cohen M. Interactive Digital Photomontage ACM Trans. Graph. (TOG) 2004 23 294 302 10.1145/1015706.1015718

상세보기
11. Szeliski R. Image alignment and stitching: A tutorial Found. Trends ® Comput. Graph. Vis. 2006 2 1 104 10.1561/0600000009

상세보기
12. Brown M. Lowe D.G. Automatic panoramic image stitching using invariant features Int. J. Comput. Vis. 2007 74 59 73 10.1007/s11263-006-0002-3

상세보기
13. Gracias N. Mahoor M. Negahdaripour S. Gleason A. Fast image blending using watersheds and graph cuts Image Vis. Comput. 2009 27 597 607 10.1016/j.imavis.2008.04.014

상세보기
14. Prados R. Garcia R. Gracias N. Escartin J. Neumann L. A novel blending technique for underwater gigamosaicing IEEE J. Ocean. Eng. 2012 37 626 644 10.1109/JOE.2012.2204152

상세보기
15. Philip S. Summa B. Tierny J. Bremer P.T. Pascucci V. Distributed Seams for Gigapixel Panoramas IEEE Trans. Vis. Comput. Graph. 2015 21 350 362 10.1109/TVCG.2014.2366128 26357067

상세보기
16. Kwatra V. Schödl A. Essa I. Turk G. Bobick A. Graphcut Textures Image and Video Synthesis Using Graph Cuts ACM Trans. Graph. (TOG) 2003 22 277 286 10.1145/882262.882264

상세보기
17. Yu L. Holden E.J. Dentith M.C. Zhang H. Towards the automatic selection of optimal seam line locations when merging optical remote-sensing images Int. J. Remote Sens. 2012 33 1000 1014 10.1080/01431161.2010.545083

상세보기
18. Mills S. McLeod P. Global seamline networks for orthomosaic generation via local search ISPRS J. Photogramm. Remote Sens. 2013 75 101 111 10.1016/j.isprsjprs.2012.11.003

상세보기
19. Li L. Yao J. Lu X. Tu J. Shan J. Optimal seamline detection for multiple image mosaicking via graph cuts ISPRS J. Photogramm. Remote Sens. 2016 113 1 16 10.1016/j.isprsjprs.2015.12.007

상세보기
20. Kass M. Witkin A. Terzopoulos D. Snakes: Active contour models Int. J. Comput. Vis. 1988 1 321 331 10.1007/BF00133570

상세보기
21. Dijkstra E.W. A note on two problems in connexion with graphs Numerische Mathematik 1959 1 269 271 10.1007/BF01386390

상세보기
22. Bellman R. Dynamic Programming Princeton University Press Princeton, NJ, USA 1957
23. Boykov Y. Veksler O. Zabih R. Fast approximate energy minimization via graph cuts IEEE Trans. Pattern Anal. Mach. Intell. 2001 23 1222 1239 10.1109/34.969114

상세보기
24. Glasbey C.A. Mardia K.V. A review of image-warping methods J. Appl. Stat. 1998 25 155 171 10.1080/02664769823151

상세보기
25. Lee S.Y. Chwa K.Y. Hahn J.K. Shin S.Y. Image morphing using deformation techniques J. Vis. Comput. Animat. 1996 7 3 23 10.1002/(SICI)1099-1778(199601)7:1 3.0.CO;2-U

상세보기
26. Liao J. Lima R.S. Nehab D. Hoppe H. Sander P.V. Yu J. Automating image morphing using structural similarity on a halfway domain ACM Trans. Graph. (TOG) 2014 33 1 12 10.1145/2629494

상세보기
27. Liu F. Gleicher M. Automatic image retargeting with fisheye-view warping Proceedings of the ACM Symposium on User Interface Software and Technology Seattle, WA, USA 23–26 October 2005 153 162
28. Lin S.S. Yeh I.C. Lin C.H. Lee T.Y. Patch-based image warping for content-aware retargeting IEEE Trans. Multimed. 2013 15 359 368 10.1109/TMM.2012.2228475

상세보기
29. Zaragoza J. Chin T.J. Brown M. Suter D. As-projective-as-possible image stitching with moving DLT Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Portland, OR, USA 23–28 June 2013 2339 2346
30. Lin C.C. Pankanti S.U. Ramamurthy K.N. Aravkin A.Y. Adaptive as-natural-as-possible image stitching Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Boston, MA, USA 7–12 June 2015 1155 1163
31. Bookstein F.L. Principal warps: Thin-plate splines and the decomposition of deformations IEEE Trans. Pattern Anal. Mach. Intell. 1989 11 567 585 10.1109/34.24792

상세보기
32. Alexa M. Cohen-Or D. Levin D. As-Rigid-As-Possible Shape Interpolation Proceedings of the Internationl Conference on Computer Graphics and Interactive Techniques Conference (SIGGRAPH) New Orleans, LA, USA 23–28 July 2000 157 164
33. Igarashi T. Moscovich T. Hughes J.F. As-rigid-as-possible shape manipulation ACM Trans. Graph. (TOG) 2005 24 1134 1141 10.1145/1073204.1073323

상세보기
34. Schaefer S. McPhail T. Warren J. Image deformation using moving least squares ACM Trans. Graph. (TOG) 2006 25 533 540 10.1145/1141911.1141920

상세보기
35. Levin D. The approximation power of moving least-squares Math. Comput. Am. Math. Soc. 1998 67 1517 1531 10.1090/S0025-5718-98-00974-0

상세보기
36. Chen T.L. Geman S. Image warping using radial basis functions J. Appl. Stat. 2014 41 242 258 10.1080/02664763.2013.838667

상세보기
37. Lee S. Wolberg G. Shin S.Y. Scattered data interpolation with multilevel B-splines IEEE Trans. Vis. Comput. Graph. 1997 3 228 244 10.1109/2945.620490

상세보기
38. Yao J. Modeling and Rendering from Multiple Views Ph.D. Thesis The Chinse University of Hong Kong Hong Kong, China 2006
39. Yao J. Cham W.K. 3D modeling and rendering from multiple wide-baseline images by match propagation Signal Process.: Image Commun. 2006 21 506 518 10.1016/j.image.2006.03.005

상세보기
40. Xu W. Mulligan J. Performance evaluation of color correction approaches for automatic multi-view image and video stitching Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) San Francisco, CA, USA 13–18 June 2010 263 270
41. Tian G.Y. Gledhill D. Taylor D. Clarke D. Colour correction for panoramic imaging Proceedings of the International Conference on Information Visualisation London, UK 10–12 July 2002 Volume 215 483 488
42. Xiong Y. Pulli K. Fast panorama stitching for high-quality panoramic images on mobile phones IEEE Trans. Consum. Electron. 2010 56 298 306 10.1109/TCE.2010.5505931

상세보기
43. Hwang Y. Lee J.Y. Kweon I.S. Kim S.J. Color transfer using probabilistic moving least squares Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Columbus, OH, USA 23–28 June 2014 3342 3349
44. Yamamoto K. Oi R. Color correction for multi-view video using energy minimization of view networks Int. J. Autom. Comput. 2008 5 234 245 10.1007/s11633-008-0234-5

상세보기
45. Lowe D. Distinctive Image Features from Scale-Invariant Keypoints Int. J. Comput. Vis. 2004 60 91 110 10.1023/B:VISI.0000029664.99615.94

상세보기
46. Fecker U. Barkowsky M. Kaup A. Histogram-based prefiltering for luminance and chrominance compensation of multiview video IEEE Trans. Circuits Syst. Video Technol. 2008 18 1258 1267 10.1109/TCSVT.2008.926997

상세보기
47. Uyttendaele M. Eden A. Skeliski R. Eliminating ghosting and exposure artifacts in image mosaics Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) Kauai, HI, USA 8–14 December 2001 Volume 2 509 516
48. Porter T. Duff T. Compositing Digital Images ACM SIGGRAPH Comput. Graph. 1984 18 253 259 10.1145/964965.808606

상세보기
49. Burt P.J. Adelson E.H. A multiresolution spline with application to image mosaics ACM Trans. Graph. (TOG) 1983 2 217 236 10.1145/245.247

상세보기
50. Pérez P. Gangnet M. Blake A. Poisson image editing ACM Trans. Graph. (TOG) 2003 22 313 318 10.1145/882262.882269

상세보기
51. Levin A. Zomet A. Peleg S. Weiss Y. Seamless image stitching in the gradient domain Proceedings of the European Conference on Computer Vision (ECCV) Prague, Czech Republic 11–14 May 2004
52. Yao J. Cham W.K. Robust multi-view feature matching from multiple unordered views Pattern Recognit. 2007 40 3081 3099 10.1016/j.patcog.2007.02.011

상세보기
53. Bay H. Tuytelaars T. Gool L.V. SURF: Speeded up Robust Features Comput. Vis. Image Underst. 2006 110 404 417
54. HaCohen Y. Shechtman E. Goldman D.B. Lischinski D. Optimizing color consistency in photo collections ACM Trans. Graph. (TOG) 2013 32 38:1 38:10 10.1145/2461912.2461997

상세보기
55. Liu L. Hua Y. Zhao Q. Huang H. Bovik A.C. Blind image quality assessment by relative gradient statistics and adaboosting neural network Signal Process.: Image Commun. 2015 40 1 15 10.1016/j.image.2015.10.005

상세보기

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

A Unified Framework for Street-View Panorama Stitching 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (55)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트