[논문]Calibration and Noise Identification of a Rolling Shutter Camera and a Low-Cost Inertial Measurement Unit

Lee, Chang-Ryeol; Yoon, Ju Hong; Yoon, Kuk-Jin

doi:10.3390/s18072345

Calibration and Noise Identification of a Rolling Shutter Camera and a Low-Cost Inertial Measurement Unit 원문보기

Sensors, v.18 no.7, 2018년, pp.2345 -

Lee, Chang-Ryeol (School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Korea) , Yoon, Ju Hong (crlee@gist.ac.kr) , Yoon, Kuk-Jin (Korea Electronics Technology Institute (KETI), Seongnam-si 13509, Korea)

Abstract ▼ AI-Helper

A low-cost inertial measurement unit (IMU) and a rolling shutter camera form a conventional device configuration for localization of a mobile platform due to their complementary properties and low costs. This paper proposes a new calibration method that jointly estimates calibration and noise parameters of the low-cost IMU and the rolling shutter camera for effective sensor fusion in which accurate sensor calibration is very critical. Based on the graybox system identification, the proposed method estimates unknown noise density so that we can minimize calibration error and its covariance by using the unscented Kalman filter. Then, we refine the estimated calibration parameters with the estimated noise density in batch manner. Experimental results on synthetic and real data demonstrate the accuracy and stability of the proposed method and show that the proposed method provides consistent results even with unknown noise density of the IMU. Furthermore, a real experiment using a commercial smartphone validates the performance of the proposed calibration method in off-the-shelf devices.

주제어

참고문헌 (44)

1. Alves J. Lobo J. Dias J. Camera-Inertial Sensor Modeling and Alignment for Visual Navigation Mach. Intell. Robot. Control 2003 5 103 112
2. Kelly J. Sukhatme G.S. Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-Calibration Int. J. Robot. Res. 2011 30 56 79 10.1177/0278364910382802

상세보기
3. Laurent Kneip M.C. Siegwart R. Robust Real-Time Visual Odometry with a Single Camera and an IMU Proceedings of the British Machine Vision Conference Dundee, UK 29 August–2 September 2011
4. Huang G. Kaess M. Leonard J.J. Towards Consistent Visual-Inertial Navigation Proceedings of the IEEE International Conference on Robotics and Automation Hong Kong, China 31 May–7 June 2014
5. Liu Y. Chen Z. Zheng W. Wang H. Liu J. Monocular Visual-Inertial SLAM: Continuous Preintegration and Reliable Initialization Sensors 2017 17 2613 10.3390/s17112613 29135966

상세보기
6. Caruso D. Eudes A. Sanfourche M. Vissière D. Besnerais G.L. A Robust Indoor/Outdoor Navigation Filter Fusing Data from Vision and Magneto-Inertial Measurement Unit Sensors 2017 17 2795 10.3390/s17122795 29207537

상세보기
7. Chatfield A.B. Fundamentals of High Accuracy Inertial Navigation Reston V.A. American Institute of Aeronautics and Astronautics, Inc. Reston, VA, USA 1997
8. Rogers R.M. Applied Mathematics in Integrated Navigation Systems American Institute of Aeronautics and Astronautics Reston, VA, USA 2003 Volume 1
9. Hall J.J. Williams R.L. II Grass F. Inertial measurement unit calibration platform J. Robot. Syst. 2000 17 623 632 10.1002/1097-4563(200011)17:11 3.0.CO;2-7

상세보기
10. Meingast M. Geyer C. Sastry S. Geometric models of rolling-shutter cameras arXiv 2005 cs/0503076
11. Ringaby E. Forssén P.E. Efficient video rectification and stabilisation for cell-phones Int. J. Comput. Vis. 2012 96 335 352 10.1007/s11263-011-0465-8

상세보기
12. Oth L. Furgale P. Kneip L. Siegwart R. Rolling Shutter Camera Calibration Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Portland, OR, USA 23–28 June 2013
13. Tedaldi D. Pretto A. Menegatti E. A Robust and Easy to Implement Method for IMU Calibration without External Equipments Proceedings of the IEEE International Conference on Robotics and Automation Hong Kong, China 31 May–7 June 2014
14. Mirzaei F.M. Roumeliotis S.I. A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation IEEE Trans. Robot. Autom. 2008 24 1143 1156 10.1109/TRO.2008.2004486

상세보기
15. Furgale P. Rehder J. Siegwar R. Unified Temporal and Spatial Calibration for Multi-Sensor Systems Proceedings of the IEEE International Conference on Robotics and Automation Tokyo, Japan 3–7 November 2013
16. Zachariah D. Jansson M. Joint calibration of an inertial measurement unit and coordinate transformation parameters using a monocular camera Proceedings of the International Conference on Indoor Positioning and Indoor Navigation Zurich, Switzerland 15–17 September 2010
17. Li M. Yu H. Zheng X. Mourikis A.I. High-fidelity sensor modeling and self-calibration in vision-aided inertial navigation Proceedings of the IEEE International Conference on Robotics and Automation Hong Kong, China 31 May–7 June 2014
18. Lee C.R. Yoon J.H. Yoon K.J. Robust Calibration of an Ultralow-Cost Inertial Measurement Unit and a Camera: Handling of Severe System Uncertainty Proceedings of the IEEE International Conference on Robotics and Automation Hong Kong, China 31 May–7 June 2014
19. Rehder J. Nikolic J. Schneider T. Hinzmann T. Siegwart R. Extending kalibr: Calibrating the Extrinsics of Multiple IMUs and of Individual Axes Proceedings of the IEEE International Conference on Robotics and Automation Stockholm, Sweden 16–21 May 2016
20. Rockett P.I. Performance assessment of feature detection algorithms: A methodology and case study on corner detectors IEEE Trans. Image Process. 2003 12 1668 1676 10.1109/TIP.2003.818041 18244720

상세보기
21. Graebe S. Theory and Implementation of Gray Box Identification Ph.D. Thesis Royal Institute of Technology Stockholm, Sweden 1990
22. Ljung L. System Identification: Theory for the User Prentice Hall PTR Upper Saddle River, NJ, USA 1999
23. Hol J.D. Schön T.B. Gustafsson F. Modeling and Calibration of Inertial and Vision Sensors Int. J. Robot. Res. 2010 29 231 244 10.1177/0278364909356812

상세보기
24. Hartley R. Zisserman A. Multiple View Geometry in Computer Vision Cambridge University Press Cambridge, UK 2003
25. O’Sullivan L. Corke P. Empirical modelling of rolling shutter effect Proceedings of the IEEE International Conference on Robotics and Automation Hong Kong, China 31 May–7 June 2014
26. Nebot E. Durrant-Whyte H. Initial calibration and alignment of low-cost inertial navigation units for land vehicle applications J. Robot. Syst. 1999 16 81 92 10.1002/(SICI)1097-4563(199902)16:2 3.0.CO;2-9

상세보기
27. Kim A. Golnaraghi M. Initial calibration of an inertial measurement unit using an optical position tracking system Proceedings of the IEEE Position Location and Navigation Symposium (PLANS) Monterey, CA, USA 26–29 April 2004
28. Cheuk C.M. Lau T.K. Lin K.W. Liu Y. Automatic calibration for inertial measurement unit Proceedings of the IEEE Control Automation Robotics & Vision (ICARCV) Guangzhou, China 5–7 December 2012
29. Dong-Si T. Mourikis A.I. Initialization in Vision-aided Inertial Navigation with Unknown Camera-IMU Calibration Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems Vilamoura, Portugal 7–12 October 2012
30. Fleps M. Mair E. Ruepp O. Suppa M. Burschka D. Optimization based IMU camera calibration Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems San Francisco, CA, USA 25–30 September 2011
31. Blázquez M. Colomina I. Relative INS/GNSS aerial control in integrated sensor orientation: Models and performance ISPRS J. Photogramm. Remote Sens. 2012 67 120 133 10.1016/j.isprsjprs.2011.11.003

상세보기
32. Cucci D.A. Rehak M. Skaloud J. Bundle adjustment with raw inertial observations in UAV applications ISPRS J. Photogramm. Remote Sens. 2017 130 1 12 10.1016/j.isprsjprs.2017.05.008

상세보기
33. Karpenko A. Jacobs D. Baek J. Levoy M. Digital Video Stabilization and Rolling Shutter Correction Using Gyroscopes Technical Report Stanford University Stanford, CA, USA 2011
34. Li M. Mourikis A.I. Online Temporal Calibration for Camera-IMU Systems: Theory and Algorithms Int. J. Robot. Res. 2014 33 947 964 10.1177/0278364913515286

상세보기
35. Li M. Mourikis A.I. Vision-aided Inertial Navigation with Rolling-Shutter Cameras Int. J. Robot. Res. 2014 33 1490 1507 10.1177/0278364914538326

상세보기
36. Board I. IEEE Standard Specification Format Guide and Test Procedure for Single-Axis Interferometric Fiber Optic Gyros IEEE Standard IEEE Piscataway, NJ, USA 1998 952 1997
37. Vaccaro R.J. Zaki A.S. Statistical modeling of rate gyros IEEE Trans. Instrum. Meas. 2012 61 673 684 10.1109/TIM.2011.2171609

상세보기
38. Mohamed A. Schwarz K. Adaptive Kalman filtering for INS/GPS J. Geodesy 1999 73 193 203 10.1007/s001900050236

상세보기
39. Nikolic J. Furgale P. Melzer A. Siegwart R. Maximum likelihood identification of inertial sensor noise model parameters IEEE Sens. J. 2016 16 163 176 10.1109/JSEN.2015.2476668

상세보기
40. Albl C. Kukelova Z. Pajdla T. R6P-Rolling Shutter Absolute Camera Pose Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Boston, MA, USA 7–12 June 2015
41. Ljung L. Soderstrom T. Theory and Practice of Recursive Identification MIT Press Cambridge, MA, USA 1987
42. Van der Merwe R. Sigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models Ph.D. Thesis Oregon Health & Science University Portland, OR, USA 2004
43. Maye J. Furgale P. Siegwart R. Self-supervised Calibration for Robotic Systems Proceedings of the IEEE Intelligent Vehicles Symposium Gold Coast, Australia 23–26 June 2013
44. Lin Y. Gao F. Qin T. Gao W. Liu T. Wu W. Yang Z. Shen S. Autonomous aerial navigation using monocular visual-inertial fusion J. Field Robot. 2018 35 23 51 10.1002/rob.21732

상세보기

LOADING...

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

Calibration and Noise Identification of a Rolling Shutter Camera and a Low-Cost Inertial Measurement Unit 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (44)

이 논문을 인용한 문헌

연구과제 타임라인

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

연합인증

Calibration and Noise Identification of a Rolling Shutter Camera and a Low-Cost Inertial Measurement Unit 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (44)

이 논문을 인용한 문헌

연구과제 타임라인

전체(0) 논문(0) 특허(0) 보고서(0)

전체(0) 논문(0) 특허(0) 보고서(0)

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트