Vehicle vision system using kinematic model of vehicle motion
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-001/02
B60R-001/00
출원번호
US-0282029
(2014-05-20)
등록번호
US-9205776
(2015-12-08)
발명자
/ 주소
Turk, James
출원인 / 주소
MAGNA ELECTRONICS INC.
대리인 / 주소
Gardner, Linn, Burkhart & Flory, LLP
인용정보
피인용 횟수 :
12인용 특허 :
228
초록▼
A vision system of a vehicle includes a camera disposed at the vehicle and having a field of view exterior of the vehicle. The camera is operable to capture frames of image data. Responsive to image processing by an image processor of captured image data, a control is operable to determine objects p
A vision system of a vehicle includes a camera disposed at the vehicle and having a field of view exterior of the vehicle. The camera is operable to capture frames of image data. Responsive to image processing by an image processor of captured image data, a control is operable to determine objects present in the field of view of the camera. Responsive to vehicle data, the control determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle. The control determines movement of an object relative to the vehicle via image processing of at least two frames of captured image data during driving of the vehicle by the driver of the vehicle. The control compares the determined relative movement of the object to the determined vehicle motion vector, and responsive to the comparison, the control may determine a misalignment of the camera.
대표청구항▼
1. A vision system of a vehicle comprising: a camera disposed at a vehicle and having a field of view exterior of the vehicle;wherein said camera comprises a two dimensional array of a plurality of photosensing elements;wherein said camera is operable to capture frames of image data;a control, said
1. A vision system of a vehicle comprising: a camera disposed at a vehicle and having a field of view exterior of the vehicle;wherein said camera comprises a two dimensional array of a plurality of photosensing elements;wherein said camera is operable to capture frames of image data;a control, said control comprising an image processor operable to process image data captured by said camera;wherein, responsive to image processing of captured image data, said control is operable to determine objects present in the field of view of said camera;wherein, responsive to vehicle data, said control determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle;wherein the vehicle data includes at least two of (i) steering information of the vehicle, (ii) speed of the vehicle and (iii) distance traveled by the vehicle;wherein said control determines movement of an object relative to the vehicle via image processing of at least two frames of captured image data during driving of the vehicle by the driver of the vehicle;wherein said control compares the determined relative movement of the object to the determined vehicle motion vector; andwherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said control determines a misalignment of said camera. 2. The vision system of claim 1, wherein the vehicle data is communicated to the control via a communication bus of the vehicle. 3. The vision system of claim 1, wherein a kinematic model comprising a bicycle model is used to represent vehicle motion. 4. The vision system of claim 3, wherein said kinematic model utilizes at least one of (i) a wheel steering angle, (ii) a wheel pulse, (iii) a heading angle and (iv) translational vehicle motion. 5. The vision system of claim 1, wherein the vehicle data includes (i) steering information of the vehicle, (ii) speed of the vehicle and (iii) distance traveled by the vehicle. 6. The vision system of claim 1, wherein, responsive to a determined misalignment of said camera, said vision system is operable to calibrate said camera. 7. The vision system of claim 1, wherein said control compares the determined vehicle motion vector to an object vector determined between a first position of the object captured in a first frame of image data and a second position of the object captured in a second frame of image data. 8. The vision system of claim 7, wherein said control determines a misalignment of said camera responsive to a difference between a direction or magnitude of the determined vehicle motion vector and a direction or magnitude of the determined object vector. 9. The vision system of claim 1, wherein said vision system comprises a plurality of cameras disposed at the vehicle, each having a respective field of view exterior of the vehicle. 10. The vision system of claim 9, wherein image data captured by at least some of said plurality of cameras is used for a surround view system of the vehicle. 11. The vision system of claim 10, wherein said plurality of cameras comprises (i) a rear camera disposed at a rear portion of the vehicle and having a rearward field of view, (ii) a driver side camera disposed at a driver side exterior rearview mirror assembly of the vehicle and at least having a generally sideward and rearward field of view and (iii) a passenger side camera disposed at a passenger side exterior rearview mirror assembly of the vehicle and at least having a generally sideward and rearward field of view. 12. The vision system of claim 1, wherein said camera comprises a CMOS camera. 13. A vision system of a vehicle comprising: a plurality of cameras disposed at a vehicle, each having a respective field of view exterior of the vehicle;wherein said plurality of cameras comprises (i) a rear camera disposed at a rear portion of the vehicle and having a rearward field of view, (ii) a driver side camera disposed at a driver side of the vehicle and at least having a generally sideward and rearward field of view and (iii) a passenger side camera disposed at a passenger side of the vehicle and at least having a generally sideward and rearward field of view;wherein said cameras are operable to capture frames of image data;a control, said control comprising an image processor operable to process image data captured by said cameras;wherein, responsive to image processing of captured image data, said control is operable to determine objects present in the fields of view of said cameras;wherein, responsive to vehicle data, said control determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle;wherein the vehicle data includes at least two of (i) steering information of the vehicle, (ii) speed of the vehicle and (iii) distance traveled by the vehicle;wherein said control determines movement of an object relative to the vehicle via image processing of at least two frames of image data captured by at least one of said cameras during driving of the vehicle by the driver of the vehicle;wherein said control compares the determined relative movement of the object to the determined vehicle motion vector; andwherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said control determines a misalignment of said at least one of said cameras. 14. The vision system of claim 13, wherein each of said cameras comprises a two dimensional array of a plurality of photosensing elements. 15. The vision system of claim 13, wherein the vehicle data is communicated to the control via a communication bus of the vehicle. 16. The vision system of claim 13, wherein, responsive to a determined misalignment of said at least one of said cameras, said vision system is operable to calibrate said at least one of said cameras. 17. The vision system of claim 13, wherein said control compares the determined vehicle motion vector to an object vector determined between a first position of the object captured in a first frame of image data by said at least one of said cameras and a second position of the object captured in a second frame of image data by said at least one of said cameras. 18. The vision system of claim 17, wherein said control determines a misalignment of said at least one of said cameras responsive to a difference between a direction or magnitude of the determined vehicle motion vector and a direction or magnitude of the determined object vector. 19. A vision system of a vehicle comprising: a plurality of cameras disposed at a vehicle, each having a respective field of view exterior of the vehicle;wherein said plurality of cameras comprises (i) a rear camera disposed at a rear portion of the vehicle and having a rearward field of view, (ii) a driver side camera disposed at a driver side of the vehicle and at least having a generally sideward and rearward field of view and (iii) a passenger side camera disposed at a passenger side of the vehicle and at least having a generally sideward and rearward field of view;wherein each of said cameras comprises a two dimensional array of a plurality of photosensing elements;wherein said cameras are operable to capture frames of image data;a control, said control comprising an image processor operable to process image data captured by said cameras;wherein, responsive to image processing of captured image data, said control is operable to determine objects present in the fields of view of said cameras;wherein, responsive to vehicle data, said control determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle;wherein the vehicle data includes at least two of (i) steering information of the vehicle, (ii) speed of the vehicle and (iii) distance traveled by the vehicle;wherein the vehicle data is communicated to the control via a communication bus of the vehicle;wherein said control determines movement of an object relative to the vehicle via image processing of at least two frames of image data captured by at least one of said cameras during driving of the vehicle by the driver of the vehicle;wherein said control compares the determined relative movement of the object to the determined vehicle motion vector;wherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said control determines a misalignment of said at least one of said cameras; andwherein, responsive to a determined misalignment of said at least one of said cameras, said vision system is operable to calibrate said at least one of said cameras. 20. The vision system of claim 19, wherein said control compares the determined vehicle motion vector to an object vector determined between a first position of the object captured in a first frame of image data by said at least one of said cameras and a second position of the object captured in a second frame of image data by said at least one of said cameras, and wherein said control determines a misalignment of said at least one of said cameras responsive to a difference between a direction or magnitude of the determined vehicle motion vector and a direction or magnitude of the determined object vector.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (228)
Strumolo, Gary Steven, 360° vision system for a vehicle.
Salmeen, Irving Toivo; Miller, Ronald Hugh; DiMeo, David M.; Strumolo, Gary Steven; Dassanayake, Mahendra Somasara; Alles, Sheran Anthony; Wagner, David Anthony, Adaptive vehicle communication controlled lighting system.
Sato Jun (Cambridge GB2) Saiki Mitsuyoshi (Tsukuba JPX), Apparatus which detects lines approximating an image by repeatedly narrowing an area of the image to be analyzed and inc.
Chen Min-Hsiung (3F. No. 10 ; Alley 102 ; Lane 109 ; Der-Hsin E. Rd. Taipei TWX), Automatic luminosity control device for car and motor bicycle headlamps.
Wood Robert B. (Hillsboro OR) Thomas Mark A. (Lake Oswego OR) Desmond John P. (Portland OR), Automobile head-up display system with reflective aspheric surface.
Van Lente Paul S. (Holland MI) Suman Michael J. (Holland MI) Zeinstra Mark L. (Holland MI) DeVree William S. (Holland MI), Electrical control system for vehicle options.
Hatae,Yasuhiko; Usui,Shuji; Nakamura,Yoshifumi, Emergency information notifying system, and apparatus, method and moving object utilizing the emergency information notifying system.
Stein, Gideon S.; Shashua, Amnon; Gdalyahu, Yoram; Liyatan, Harel, Fusion of far infrared and visible images in enhanced obstacle detection in automotive applications.
Wilson David T. (Torrance CA) Wreede John E. (Azusa CA) Gunther John E. (Torrance CA) Arns James A. (Saline MI), Holographic parking assistance device.
Stam, Joseph S.; Mart, Gregory A.; Berends, Keith H.; Bush, Gregory S.; Roberts, John K.; Pierce, Mark W.; Bechtel, Jon H.; Walstra, Eric J.; Rycenga, Brock R., Image acquisition and processing methods for automatic vehicular exterior lighting control.
Lelong Pierre (Nogent/Sur/Marne FRX) Dalm Govert (Veldhoven NLX) Klijn Jan (Breda NLX), Image processing method and device for constructing an image from adjacent images.
Takano Kazuaki,JPX ; Monzi Tatsuhiko,JPX ; Tanaka Yasunari,JPX ; Ondoh Eiryoh,JPX ; Shioya Makoto,JPX, Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to su.
Denny, Patrick Eoghan; Raab, Tycho Lorenz Roland; Sharman, Lloyd Anthony, Method and apparatus for calibrating an image capturing device, and a method and apparatus for outputting image frames from sequentially captured image frames with compensation for image capture device offset.
Yung, Wai Lam; Bittner, Wilfried Alois Anton; Lam, Yat Wah; Chan, Sai Chak; Chan, Wah Pong; Ng, Kwong Lam; Zimmermann, Thomas Paul Richard, Method and apparatus for locating and measuring the distance to a target.
Trissel Richard G. (Cardiff CA) DeFoe Douglas N. (Escondido CA), Optical collimating device employing cholesteric liquid crystal and a non-transmissive reflector.
Bottesch H. Werner (R.D. #6 ; Box 374 Danville PA 17821) Freas David A. (P.O. Box 324 Mifflinville PA 18631), Passive vehicle presence detection system.
Bamji,Cyrus, RGBZ (red, green, blue, z-depth) filter system usable with sensor systems, including sensor systems with synthetic mirror enhanced three-dimensional imaging.
Schofield Kenneth (Holland MI) Larson Mark L. (Grand Haven MI) Vadas Keith J. (Coopersville MI), Rearview vision system for vehicle including panoramic view.
Tsuchiya Hideaki (Mitaka JPX) Hanawa Keiji (Chofu JPX) Saneyoshi Keiji (Tokyo JPX), Running guide apparatus for vehicle capable of keeping safety at passing through narrow path and the method thereof.
Schofield Kenneth (Holland) Gahan Richard J. (Holland) Schierbeek Kenneth L. (Zeeland) Larson Mark L. (Grand Haven MI), Single sensor adaptive drive circuit for rearview mirror system.
Borcherts Robert H. (Ann Arbor MI) Jurzak Jacek L. (Rochester Hills MI) Liou Shih-Ping (Ann Arbor MI) Yeh Tse-Liang A. (Rochester Hills MI), System and method for automatically steering a vehicle within a lane in a road.
Stein Gideon P. ; Shashua Amnon,ILX, System and method for directly estimating three-dimensional structure of objects in a scene and camera motion from three two-dimensional views of the scene.
Stein, Gideon P.; Mano, Ofer, System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion.
Stam, Joseph S.; Bechtel, Jon H.; Reese, Spencer D.; Roberts, John K.; Tonar, William L.; Poe, G. Bruce; Newhouse, Douglas J., System for controlling exterior vehicle lights.
Alves James F. (Camarillo CA) Cacnio Gerry R. (Los Angeles CA) Stevens David R. (Simi Valley CA), Video image processor and method for detecting vehicles.
Kenneth Schofield ; Mark L. Larson ; Keith J. Vadas, Vision system for a vehicle including an image capture device and a display system having a long focal length.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.