[논문]NRLI-UAV: Non-rigid registration of sequential raw laser scans and images for low-cost UAV LiDAR point cloud quality improvement

Li, Jianping; Yang, Bisheng; Chen, Chi; Habib, Ayman

doi:10.1016/j.isprsjprs.2019.10.009

NRLI-UAV: Non-rigid registration of sequential raw laser scans and images for low-cost UAV LiDAR point cloud quality improvement

ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing (ISPRS), v.158, 2019년, pp.123 - 145

Li, Jianping (State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University) , Yang, Bisheng (State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University) , Chen, Chi (State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University) , Habib, Ayman (Lyles School of Civil Engineering, Purdue University)

Abstract ▼ AI-Helper

Abstract Accurate registration of light detection and ranging (LiDAR) point clouds and images is a prerequisite for integrating the spectral and geometrical information collected by low-cost unmanned aerial vehicle (UAV) systems. Most registration approaches take the directly georeferenced LiDAR point cloud as a rigid body, based on the assumption that the high-precision positioning and orientation system (POS) in the LiDAR system provides sufficient precision, and that the POS errors are negligible. However, due to the large errors of the low-precision POSs commonly used in the low-cost UAV LiDAR systems (ULSs), dramatic deformation may exist in the directly georeferenced ULS point cloud, resulting in non-rigid transformation between the images and the deformed ULS point cloud. As a result, registration may fail when using a rigid transformation between the images and the directly georeferenced LiDAR point clouds. To address this problem, we proposed NRLI-UAV, which is a non-rigid registration method for registration of sequential raw laser scans and images collected by low-cost UAV systems. NRLI-UAV is a two-step registration method that exploits trajectory correction and discrepancy minimization between the depths derived from structure from motion (SfM) and the raw laser scans to achieve LiDAR point cloud quality improvement. Firstly, the coarse registration procedure utilizes global navigation satellite system (GNSS) and inertial measurement unit (IMU)-aided SfM to obtain accurate image orientation and corrects the errors of the low-precision POS. Secondly, the fine registration procedure transforms the original 2D-3D registration to 3D-3D registration. This is performed by setting the oriented images as the reference, and iteratively minimizing the discrepancy between the depth maps derived from SfM and the raw laser scans, resulting in accurate registration between the images and the LiDAR point clouds. In addition, an improved LiDAR point cloud is generated in the mapping frame. Experiments were conducted with data collected by a low-cost UAV system in three challenging scenes to evaluate NRLI-UAV. The final registration errors of the images and the LiDAR point cloud are less than one pixel in image space and less than 0.13 m in object space. The LiDAR point cloud quality was also evaluated by plane fitting, and the results show that the LiDAR point cloud quality is improved by 8.8 times from 0.45 m (root-mean-square error [RMSE] of plane fitting) to 0.05 m (RMSE of plane fitting) using NRLI-UAV, demonstrating a high level of automation, robustness, and accuracy.

주제어

참고문헌 (86)

ISPRS J. Photogramm. Remote Sens. Abayowa 106 68 2015 10.1016/j.isprsjprs.2015.05.006 Automatic registration of optical aerial imagery to a LiDAR point cloud for generation of city models

상세보기
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. Ali-Sisto 10 1197 2017 10.1109/JSTARS.2016.2615099 Forest change detection by using point clouds from dense image matching together with a LiDAR-derived terrain model

상세보기
ACM Allen 612 2002 Articulated body deformation from range scan data, ACM Transactions on Graphics (TOG)
Int. Archives Photogram. Remote Sensing Amhar 32 16 1998 The generation of true orthophotos using a 3D building model in conjunction with a conventional DTM
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. Awad 10 2067 2017 10.1109/JSTARS.2017.2653061 Toward Robust Segmentation Results Based on Fusion Methods for Very High Resolution Optical Image and LiDAR Data

상세보기
Int. Soc. Optics Photonics Besl 586 1992 Method for registration of 3-D shapes, Sensor Fusion IV: Control Paradigms and Data Structures
Bosse 4312 2009 2009 IEEE International Conference on Robotics and Automation Continuous 3D scan-matching with a spinning 2D laser
Brenneke 188 2003 Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453) Using 3d laser range data for slam in outdoor environments
Brown 21 2007 Global non-rigid alignment of 3-D scans, ACM Transactions on Graphics (TOG)
Remote Sensing Chang 11 1009 2019 10.3390/rs11091009 GNSS/INS/LiDAR-SLAM Integrated Navigation System Based on Graph Optimization

상세보기
Chang 1459 2008 Automatic registration for articulated shapes, Computer Graphics Forum
Image Vis. Comput. Chetverikov 23 299 2005 10.1016/j.imavis.2004.05.007 Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm

상세보기
ETRI J. Choi 33 506 2011 10.4218/etrij.11.1610.0046 Precise geometric registration of aerial imagery and LIDAR data

원문보기 상세보기
Int. J. Comput. Vision Corsini 102 91 2013 10.1007/s11263-012-0552-5 Fully automatic registration of image sets on approximate geometry

상세보기
ISPRS J. Photogramm. Remote Sens. Cucci 130 1 2017 10.1016/j.isprsjprs.2017.05.008 Bundle adjustment with raw inertial observations in UAV applications

상세보기
Sensors Cui 17 70 2017 10.3390/s17010070 Line-based registration of panoramic images and LiDAR point clouds for mobile mapping

상세보기
Dai 4132 2016 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Rolling shutter camera relative pose: Generalized epipolar geometry
Elbahnasawy 417 2018 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS) Image-assisted GNSS/INS navigation for UAV-based mobile mapping systems during GNSS outages
ISPRS J. Photogramm. Remote Sens. Feng 151 15 2019 10.1016/j.isprsjprs.2019.03.002 Robust registration for remote sensing images by combining and localizing feature-and area-based methods

상세보기
IEEE Trans. Rob. Forster 33 1 2017 10.1109/TRO.2016.2597321 On-Manifold Preintegration for Real-Time Visual-Inertial Odometry

상세보기
Photogramm. Eng. Remote Sens. Fryer 52 51 1986 Lens distortion for close-range photogrammetry
García-Moreno 104 2013 Mexican Conference on Pattern Recognition LIDAR and panoramic camera extrinsic calibration approach using a pattern plane
Remote Sensing Gharibi 10 581 2018 10.3390/rs10040581 True orthophoto generation from aerial frame images and LiDAR Data: an update

상세보기
Photogramm. Eng. Remote Sens. Glira 82 945 2016 10.14358/PERS.82.12.945 Rigorous Strip adjustment of UAV-based laserscanning data including time-dependent correction of trajectory errors

상세보기
Sensors Gong 13 1902 2013 10.3390/s130201902 3D LIDAR-camera extrinsic calibration using an arbitrary trihedron

상세보기
ISPRS J. Photogramm. Remote Sens. Gressin 79 240 2013 10.1016/j.isprsjprs.2013.02.019 Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge

상세보기
Guo 2943 2013 2013 IEEE International Conference on Robotics and Automation An analytical least-squares solution to the line scan LIDAR-camera extrinsic calibration problem
Photogramm. Eng. Remote Sens. Habib 71 699 2005 10.14358/PERS.71.6.699 Photogrammetric and LiDAR data registration using linear features

상세보기
Int. Archives Photogramm. Remote Sensing Habib 32 55 1999 A new approach for matching surfaces from laser scanners and optical scanners
Habib, A.F., Kersting, A.P., Ruifang, Z., Al-Durgham, M., Kim, C., Lee, D.C., 2010. Lidar strip adjustment using conjugate linear features in overlapping strips. 37.
ISPRS J. Photogramm. Remote Sens. He 142 278 2018 10.1016/j.isprsjprs.2018.06.011 Three-point-based solution for automated motion parameter estimation of a multi-camera indoor mapping system with planar motion constraint

상세보기
Hedborg 1434 2012 2012 IEEE Conference on Computer Vision and Pattern Recognition Rolling shutter bundle adjustment
ISPRS Annals Photogramm., Remote Sensing Spatial Inform. Sci. Hofmann 2 181 2014 10.5194/isprsannals-II-5-181-2014 Skyline matching based camera orientation from images and mobile mapping point clouds

상세보기
Commun. Statistics-Theory Methods Holland 6 813 1977 10.1080/03610927708827533 Robust regression using iteratively reweighted least-squares

상세보기
Comput. Vis. Image Underst. Hosni 117 620 2013 10.1016/j.cviu.2013.01.007 Secrets of adaptive support weight techniques for local stereo matching

상세보기
InertialExplore 2013 Post-Processing Software
ISPRS J. Photogramm. Remote Sens. Jaakkola 65 514 2010 10.1016/j.isprsjprs.2010.08.002 A low-cost multi-sensoral mobile mapping system and its feasibility for tree measurements

상세보기
ISPRS J. Photogramm. Remote Sens. Jende 141 86 2018 10.1016/j.isprsjprs.2018.04.017 A fully automatic approach to register mobile mapping and airborne imagery to support the correction of platform trajectories in GNSS-denied urban areas

상세보기
ISPRS J. Photogramm. Remote Sens. Ji 105 1 2015 10.1016/j.isprsjprs.2015.03.005 Particle filtering methods for georeferencing panoramic image sequence in complex urban scenes

상세보기
ISPRS J. Photogramm. Remote Sens. Jiang 142 222 2018 10.1016/j.isprsjprs.2018.06.009 Hierarchical motion consistency constraint for efficient geometrical verification in UAV stereo image matching

상세보기
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. Kang 10 1651 2017 10.1109/JSTARS.2016.2628775 A bayesian-network-based classification method integrating airborne LiDAR data with optical images

상세보기
KSCE J. Civ. Eng. Kwak 10 365 2006 10.1007/BF02830090 Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information

상세보기
Photogramm. Eng. Remote Sens. Lee 82 699 2016 10.14358/PERS.82.9.699 An individual tree-based automated registration of aerial images to lidar data in a forested area

상세보기
ISPRS J. Photogramm. Remote Sens. Li 136 41 2018 10.1016/j.isprsjprs.2017.12.005 Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features

상세보기
Remote Sensing Li 11 717 2019 10.3390/rs11060717 3D forest mapping Using A Low-Cost UAV laser scanning system: investigation and comparison

상세보기
Rob. Auton. Syst. Li 112 201 2019 10.1016/j.robot.2018.11.009 Semi-direct monocular visual and visual-inertial SLAM with loop closure detection

상세보기
Geophysics Li 66 1660 2001 10.1190/1.1487109 Ellipsoid, geoid, gravity, geodesy, and geophysics

상세보기
Remote Sens. Liu 8 82 2016 10.3390/rs8020082 A linear feature-based approach for the registration of unmanned aerial vehicle remotely-sensed images and airborne LiDAR data

상세보기
Int. J. Comput. Vision Lowe 60 91 2004 10.1023/B:VISI.0000029664.99615.94 Distinctive image features from scale-invariant keypoints

상세보기
Mastin 2639 2009 2009 IEEE conference on computer vision and pattern recognition Automatic registration of LIDAR and optical images of urban scenes
Int. Archives Photogramm., Remote Sens. Spatial Inform. Sci. Mian 40 397 2015 10.5194/isprsarchives-XL-1-W4-397-2015 Direct georeferencing on small unmanned aerial platforms for improved reliability and accuracy of mapping without the need for ground control points

상세보기
ISPRS Annals Photogramm., Remote Sens. Spatial Inform. Sci. Miled 3 25 2016 10.5194/isprs-annals-III-1-25-2016 Hybrid online mobile laser scanner calibration through image alignment by mutual information

상세보기
IEEE Trans. Geosci. Remote Sens. Palenichka 48 2864 2010 10.1109/TGRS.2010.2043677 Automatic extraction of control points for the registration of optical satellite and LiDAR images

상세보기
Sensors Park 14 5333 2014 10.3390/s140305333 Calibration between color camera and 3D LIDAR instruments with a polygonal planar board

상세보기
ISPRS J. Photogramm. Remote Sens. Parmehr 88 28 2014 10.1016/j.isprsjprs.2013.11.015 Automatic registration of optical imagery with 3D LiDAR data using statistical similarity

상세보기
Pekelny 399 2008 Articulated object reconstruction and markerless motion capture from depth video, Computer Graphics Forum
ISPRS J. Photogramm. Remote Sens. Polewski 152 79 2019 10.1016/j.isprsjprs.2019.04.004 Scale invariant line-based co-registration of multimodal aerial data using L1 minimization of spatial and angular deviations

상세보기
ACM Trans. Graphics (TOG) Pons-Moll 34 120 2015 10.1145/2766993 Dyna: A model of dynamic human shape in motion

상세보기
IEEE Trans. Rob. Qin 34 1004 2018 10.1109/TRO.2018.2853729 Vins-mono: A robust and versatile monocular visual-inertial state estimator

상세보기
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. Ravi 11 1694 2018 10.1109/JSTARS.2018.2812796 Simultaneous System Calibration of a Multi-LiDAR Multicamera Mobile Mapping Platform

상세보기
IEEE Trans. Geosci. Remote Sens. Ravi PP 1 2018 Bias impact analysis and calibration of terrestrial mobile LiDAR system with several spinning multibeam laser scanners
Appl. Sci. Ravi 8 297 2018 10.3390/app8020297 Bias impact analysis and calibration of UAV-based mobile LiDAR system with spinning multi-beam laser scanner

상세보기
Schonberger 4104 2016 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Structure-from-motion revisited
Schönberger 501 2016 European Conference on Computer Vision Pixelwise view selection for unstructured multi-view stereo
Shin 273 2004 Position Location and Navigation Symposium, 2004. PLANS 2004 An unscented Kalman filter for in-motion alignment of low-cost IMUs
J. Field Rob. Sibley 27 587 2010 10.1002/rob.20360 Sliding window filter with application to planetary landing

상세보기
Skaloud 2006 Reliability of direct georeferencing phase 0
Int. Archives Photogramm., Remote Sens. Spatial Inform. Sci. Skaloud 40 123 2014 10.5194/isprsarchives-XL-3-W1-123-2014 Mapping with MAV: Experimental Study on the Contribution of Absolute and Relative Aerial Position Control

상세보기
ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Takai Sci 277 2013 10.5194/isprsannals-II-5-W2-277-2013 Accurate registration of MMS point clouds of urban areas using trajectory

상세보기
IEEE Trans. Visual Comput. Graphics Tam 19 1199 2013 10.1109/TVCG.2012.310 Registration of 3D point clouds and meshes: a survey from rigid to nonrigid

상세보기
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. Teo 6 2229 2013 10.1109/JSTARS.2012.2237543 Automatic co-registration of optical satellite images and airborne LiDAR data using relative and absolute orientations

상세보기
Triggs 298 1999 International Workshop on Vision Algorithms: Theory and Practice Bundle Adjustment - A Modern Synthesis
Remote Sens. Wallace 4 1519 2012 10.3390/rs4061519 Development of a UAV-LiDAR system with application to forest inventory

상세보기
Wang 33 2012 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops Automatic registration of mobile LiDAR and spherical panoramas
Med. Image Anal. Wells 1 35 1996 10.1016/S1361-8415(01)80004-9 Multi-modal volume registration by maximization of mutual information

상세보기
Wu 127 2013 2013 International Conference on 3DTV-Conference Towards linear-time incremental structure from motion
Int. J. Remote Sens. Yan 39 1713 2018 10.1080/01431161.2017.1410248 Automatic non-rigid registration of multi-strip point clouds from mobile laser scanning systems

상세보기
ISPRS J. Photogramm. Remote Sens. Yang 101 262 2015 10.1016/j.isprsjprs.2014.12.025 Automatic registration of UAV-borne sequent images and LiDAR data

상세보기
ISPRS J. Photogramm. Remote Sens. Yang 81 19 2013 10.1016/j.isprsjprs.2013.04.002 A shape-based segmentation method for mobile laser scanning point clouds

상세보기
Yang 1175 2018 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) A robust pose graph approach for city scale LiDAR mapping
IEEE Trans. Autom. Sci. Eng. Yang 14 39 2017 10.1109/TASE.2016.2550621 Monocular visual-inertial state estimation with online initialization and camera-IMU extrinsic calibration

상세보기
Yu 1722 2015 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Semantic alignment of LiDAR data at city scale
Autonomous Robots Zhang 41 401 2017 10.1007/s10514-016-9548-2 Low-drift and real-time lidar odometry and mapping

상세보기
IEEE Trans. Geosci. Remote Sens. Zhang 53 976 2015 10.1109/TGRS.2014.2331234 LiDAR strip adjustment using multifeatures matched with aerial images

상세보기
IEEE Trans. Pattern Anal. Mach. Intell. Zhao 1305 2005 10.1109/TPAMI.2005.152 Alignment of continuous video onto 3D point clouds

상세보기
Zhao 1866 2016 2016 IEEE International Conference on Robotics and Automation (ICRA) 2D-image to 3D-range registration in urban environments via scene categorization and combination of similarity measurements

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

NRLI-UAV: Non-rigid registration of sequential raw laser scans and images for low-cost UAV LiDAR point cloud quality improvement

Abstract ▼ AI-Helper

주제어

참고문헌 (86)

이 논문을 인용한 문헌

관련 콘텐츠

원문 URL 링크

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트