Method and system for dynamically calibrating vehicular cameras
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
B60R-011/04
G03B-043/00
H04N-017/00
G06T-003/40
G06T-007/80
출원번호
US-0113412
(2012-04-25)
등록번호
US-9834153
(2017-12-05)
국제출원번호
PCT/CA2012/000378
(2012-04-25)
§371/§102 date
20141024
(20141024)
국제공개번호
WO2012/145822
(2012-11-01)
발명자
/ 주소
Gupta, Nikhil
Faraji, Hilda
He, Daan
Rathi, Ghanshyam
출원인 / 주소
MAGNA ELECTRONICS INC.
대리인 / 주소
Gardner, Linn, Burkhart & Flory, LLP
인용정보
피인용 횟수 :
3인용 특허 :
185
초록▼
A method of dynamically calibrating a given camera relative to a reference camera of a vehicle includes identifying an overlapping region in an image frame provided by the given camera and an image frame provided by the reference camera and selecting at least a portion of an object in the overlapped
A method of dynamically calibrating a given camera relative to a reference camera of a vehicle includes identifying an overlapping region in an image frame provided by the given camera and an image frame provided by the reference camera and selecting at least a portion of an object in the overlapped region of the reference image frame. Expected pixel positions of the selected object portion in the given image frame is determined based on the location of the selected object portion in the reference image frame, and pixel positions of the selected object portion are located as detected in the given image frame. An alignment of the given camera is determined based on a comparison of the pixel positions of the selected object portion in the given image frame to the expected pixel positions of the selected object portion in the given image frame.
대표청구항▼
1. A method of dynamically calibrating a given vehicular camera relative to a reference camera attached to the vehicle, the given camera and the reference camera comprising pixelated imaging arrays, said method comprising: providing a plurality of cameras at the vehicle so that the cameras have resp
1. A method of dynamically calibrating a given vehicular camera relative to a reference camera attached to the vehicle, the given camera and the reference camera comprising pixelated imaging arrays, said method comprising: providing a plurality of cameras at the vehicle so that the cameras have respective exterior fields of view, the cameras capturing image data;selecting from the plurality of cameras a reference camera and a given camera, wherein the selected reference camera and the selected given camera have overlapping fields of view;capturing an actual given image frame of image data by the given camera;capturing an actual reference image frame of image data by the reference camera;identifying an overlapping region in the actual given image frame of image data captured by the given camera and the actual reference image frame of image data captured by the reference camera;selecting at least one object or at least a portion of an object present in the overlapping region of the actual reference image frame captured by the reference camera;determining expected pixel positions of the selected object or object portion for a predicted given image frame as would be captured by the given camera based on the location of the selected object or object portion in the actual reference image frame captured by the reference camera;locating, via processing of the actual given image frame captured by the given camera, actual pixel positions of the selected object or object portion as detected in the actual given image frame captured by the given camera; anddetermining alignment of the given camera based at least in part on a comparison of the actual pixel positions of the selected object or object portion in the actual given image frame captured by the given camera to the expected pixel positions of the selected object or object portion for the predicted given image frame. 2. The method of claim 1, wherein the reference camera comprises a forward viewing camera of the vehicle and the given camera comprises a camera disposed at a side of the vehicle. 3. The method of claim 2, wherein said method first determines whether the forward viewing camera is calibrated. 4. The method of claim 3, wherein said method determines the calibration of the forward viewing camera by processing the image frame captured by the forward viewing camera to determine a location of a vanishing point in the image frame and comparing the determined vanishing point to a predetermined location in the image frame. 5. The method of claim 1, including removing distortion in the location of the pixel positions in the actual given image frame for the selected object or object portion caused by use of a wide angle camera lens in the given camera. 6. The method of claim 5, including removing distortion in locations of pixel positions in the actual reference image frame for the selected object or object portion caused by use of a wide angle camera lens in the reference camera. 7. The method of claim 5, wherein the reference camera comprises a forward viewing camera and the given camera comprises a side camera of the vehicle. 8. The method of claim 1, wherein the reference camera comprises a forward viewing camera and the given camera comprises a side camera of the vehicle, and wherein the given camera is disposed at a side mirror of the vehicle. 9. The method of claim 1, wherein the reference camera comprises a rearward viewing camera and the given camera comprises a side camera of the vehicle, and wherein the given camera is disposed at a side mirror of the vehicle. 10. The method of claim 1, wherein the given camera comprises a side camera of the vehicle. 11. The method of claim 1, wherein the reference camera and the given camera are part of a surround view vision system of the equipped vehicle. 12. The method of claim 11, wherein the reference camera comprises one of a forward viewing camera and a rearward viewing camera, and wherein the given camera comprises one of a driver side camera and a passenger side camera. 13. The method of claim 12, wherein the system comprises multiple given cameras including a driver side camera and a passenger side camera. 14. A method of dynamically calibrating a given vehicular camera relative to a reference camera attached to the vehicle, the given camera and the reference camera comprising pixelated imaging arrays, said method comprising: providing a plurality of cameras at the vehicle so that the cameras have respective exterior fields of view, the cameras capturing image data;selecting from the plurality of cameras a reference camera and a given camera, wherein the selected reference camera and the selected given camera have overlapping fields of view;capturing an actual given image frame of image data by the given camera;capturing an actual reference image frame of image data by the reference camera;identifying an overlapping region in the actual given image frame of image data captured by the given camera and the reference image frame of image data captured by the reference camera;wherein the reference camera and the given camera are part of a surround view vision system of the vehicle;wherein the given camera comprises one of a driver side camera at a driver side mirror of the vehicle and a passenger side camera at a passenger side mirror of the vehicle;wherein the reference camera comprises one of a forward viewing camera at a front portion of the vehicle and a rearward viewing camera at a rear portion of the vehicle;selecting at least one object or at least a portion of an object present in the overlapping region of the actual reference image frame captured by the reference camera;determining expected pixel positions of the selected object or object portion for a predicted given image frame as would be captured by the given camera based on the location of the selected object or object portion in the actual reference image frame captured by the reference camera;locating, via processing of the actual given image frame captured by the given camera, actual pixel positions of the selected object or object portion as detected in the actual given image frame captured by the given camera; anddetermining alignment of the given camera based at least in part on a comparison of the actual pixel positions of the selected object or object portion in the actual given image frame captured by the given camera to the expected pixel positions of the selected object or object portion for the predicted given image frame. 15. The method of claim 14, including removing distortion in the location of the pixel positions in the actual given image frame for the selected object or object portion caused by use of a wide angle camera lens in the given camera. 16. The method of claim 15, including removing distortion in locations of pixel positions in the actual reference image frame for the selected object or object portion caused by use of a wide angle camera lens in the reference camera. 17. A method of dynamically calibrating a given vehicular camera relative to a reference camera attached to the vehicle, the given camera and the reference camera comprising pixelated imaging arrays, said method comprising: providing a plurality of cameras at the vehicle so that the cameras have respective exterior fields of view, the cameras capturing image data;selecting from the plurality of cameras a reference camera and a given camera, wherein the selected reference camera and the selected given camera have overlapping fields of view;capturing an actual given image frame of image data by the given camera;capturing an actual reference image frame of image data by the reference camera;determining whether the given camera is calibrated;responsive to determining that the given camera is calibrated, identifying an overlapping region in the actual given image frame of image data captured by the given camera and the actual reference image frame of image data captured by the reference camera;selecting at least one object or at least a portion of an object in the overlapping region of the actual reference image frame captured by the reference camera;determining expected pixel positions of the selected object or object portion for a predicted given image frame as would be captured by the given camera based on the location of the selected object or object portion in the actual reference image frame captured by the reference camera;locating, via processing of the actual given image frame captured by the given camera, actual pixel positions of the selected object or object portion as detected in the actual given image frame captured by the given camera; anddetermining alignment of the given camera based at least in part on a comparison of the actual pixel positions of the selected object or object portion in the actual given image frame captured by the given camera to the expected pixel positions of the selected object or object portion for the predicted given image frame. 18. The method of claim 17, wherein said method determines the calibration of the forward viewing camera by processing the image frame of the forward viewing camera to determine a location of a vanishing point in the image frame and comparing the determined vanishing point to a predetermined location in the image frame. 19. The method of claim 17, wherein the reference camera and the given camera are part of a surround view vision system of the equipped vehicle. 20. The method of claim 19, wherein the reference camera comprises one of a forward viewing camera at a front portion of the vehicle and a rearward viewing camera at a rear portion of the vehicle, and wherein the given camera comprises one of a driver side camera at a driver side of the vehicle and a passenger side camera at a passenger side of the vehicle.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (185)
Strumolo, Gary Steven, 360° vision system for a vehicle.
Salmeen, Irving Toivo; Miller, Ronald Hugh; DiMeo, David M.; Strumolo, Gary Steven; Dassanayake, Mahendra Somasara; Alles, Sheran Anthony; Wagner, David Anthony, Adaptive vehicle communication controlled lighting system.
Sato Jun (Cambridge GB2) Saiki Mitsuyoshi (Tsukuba JPX), Apparatus which detects lines approximating an image by repeatedly narrowing an area of the image to be analyzed and inc.
Chen Min-Hsiung (3F. No. 10 ; Alley 102 ; Lane 109 ; Der-Hsin E. Rd. Taipei TWX), Automatic luminosity control device for car and motor bicycle headlamps.
Van Lente Paul S. (Holland MI) Suman Michael J. (Holland MI) Zeinstra Mark L. (Holland MI) DeVree William S. (Holland MI), Electrical control system for vehicle options.
Hatae,Yasuhiko; Usui,Shuji; Nakamura,Yoshifumi, Emergency information notifying system, and apparatus, method and moving object utilizing the emergency information notifying system.
Stein, Gideon S.; Shashua, Amnon; Gdalyahu, Yoram; Liyatan, Harel, Fusion of far infrared and visible images in enhanced obstacle detection in automotive applications.
Wilson David T. (Torrance CA) Wreede John E. (Azusa CA) Gunther John E. (Torrance CA) Arns James A. (Saline MI), Holographic parking assistance device.
Stam, Joseph S.; Mart, Gregory A.; Berends, Keith H.; Bush, Gregory S.; Roberts, John K.; Pierce, Mark W.; Bechtel, Jon H.; Walstra, Eric J.; Rycenga, Brock R., Image acquisition and processing methods for automatic vehicular exterior lighting control.
Lelong Pierre (Nogent/Sur/Marne FRX) Dalm Govert (Veldhoven NLX) Klijn Jan (Breda NLX), Image processing method and device for constructing an image from adjacent images.
Takano Kazuaki,JPX ; Monzi Tatsuhiko,JPX ; Tanaka Yasunari,JPX ; Ondoh Eiryoh,JPX ; Shioya Makoto,JPX, Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to su.
Denny, Patrick Eoghan; Raab, Tycho Lorenz Roland; Sharman, Lloyd Anthony, Method and apparatus for calibrating an image capturing device, and a method and apparatus for outputting image frames from sequentially captured image frames with compensation for image capture device offset.
Yung, Wai Lam; Bittner, Wilfried Alois Anton; Lam, Yat Wah; Chan, Sai Chak; Chan, Wah Pong; Ng, Kwong Lam; Zimmermann, Thomas Paul Richard, Method and apparatus for locating and measuring the distance to a target.
Trissel Richard G. (Cardiff CA) DeFoe Douglas N. (Escondido CA), Optical collimating device employing cholesteric liquid crystal and a non-transmissive reflector.
Bottesch H. Werner (R.D. #6 ; Box 374 Danville PA 17821) Freas David A. (P.O. Box 324 Mifflinville PA 18631), Passive vehicle presence detection system.
Bamji,Cyrus, RGBZ (red, green, blue, z-depth) filter system usable with sensor systems, including sensor systems with synthetic mirror enhanced three-dimensional imaging.
Schofield Kenneth (Holland MI) Larson Mark L. (Grand Haven MI) Vadas Keith J. (Coopersville MI), Rearview vision system for vehicle including panoramic view.
Tsuchiya Hideaki (Mitaka JPX) Hanawa Keiji (Chofu JPX) Saneyoshi Keiji (Tokyo JPX), Running guide apparatus for vehicle capable of keeping safety at passing through narrow path and the method thereof.
Borcherts Robert H. (Ann Arbor MI) Jurzak Jacek L. (Rochester Hills MI) Liou Shih-Ping (Ann Arbor MI) Yeh Tse-Liang A. (Rochester Hills MI), System and method for automatically steering a vehicle within a lane in a road.
Stein Gideon P. ; Shashua Amnon,ILX, System and method for directly estimating three-dimensional structure of objects in a scene and camera motion from three two-dimensional views of the scene.
Stein, Gideon P.; Mano, Ofer, System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion.
Stam, Joseph S.; Bechtel, Jon H.; Reese, Spencer D.; Roberts, John K.; Tonar, William L.; Poe, G. Bruce; Newhouse, Douglas J., System for controlling exterior vehicle lights.
Alves James F. (Camarillo CA) Cacnio Gerry R. (Los Angeles CA) Stevens David R. (Simi Valley CA), Video image processor and method for detecting vehicles.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.