System and method for evaluating the perception system of an autonomous vehicle
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06T-007/223
G06T-007/231
G06T-007/20
B60R-001/00
출원번호
US-0587680
(2017-05-05)
등록번호
US-9911030
(2018-03-06)
발명자
/ 주소
Zhu, Jiajun
Urmson, Christopher Paul
Haehnel, Dirk
Fairfield, Nathaniel
Smith, Russell Leigh
출원인 / 주소
Waymo LLC
대리인 / 주소
Lener, David, Littenberg, Krumholz & Mentlik, LLP
인용정보
피인용 횟수 :
0인용 특허 :
115
초록▼
A method and apparatus are provided for optimizing one or more object detection parameters used by an autonomous vehicle to detect objects in images. The autonomous vehicle may capture the images using one or more sensors. The autonomous vehicle may then determine object labels and their correspondi
A method and apparatus are provided for optimizing one or more object detection parameters used by an autonomous vehicle to detect objects in images. The autonomous vehicle may capture the images using one or more sensors. The autonomous vehicle may then determine object labels and their corresponding object label parameters for the detected objects. The captured images and the object label parameters may be communicated to an object identification server. The object identification server may request that one or more reviewers identify objects in the captured images. The object identification server may then compare the identification of objects by reviewers with the identification of objects by the autonomous vehicle. Depending on the results of the comparison, the object identification server may recommend or perform the optimization of one or more of the object detection parameters.
대표청구항▼
1. A method for optimizing object detection performed by autonomous vehicles, the method comprising: receiving, by one or more computing devices having one or more processors, sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes a first object labels applied by
1. A method for optimizing object detection performed by autonomous vehicles, the method comprising: receiving, by one or more computing devices having one or more processors, sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes a first object labels applied by the autonomous vehicle, each of the first object labels corresponding to a computed speed of a particular object of the sensor data;receiving, by the one or more computing devices, a one or more second object labels not applied by the autonomous vehicle for the sensor data corresponding to a computed speed of the particular object;determining, by the one or more computing devices, differences in speed between corresponding objects of the first object labels and one or more second object labels;determining, by the one or more computing devices, a number and value of differences in speed based on the determined differences; andgenerating, by the one or more computing devices, a recommendation for an adjustment of at least one object detection parameter of at least one of a plurality of sensors based on the determined number and value of differences in speed in order to optimize object detection. 2. The method of claim 1, wherein the one or more second object labels include labels generated at least in part by one or more processors of a second computing device. 3. The method of claim 1, further comprising, for each given object of the sensor data, determining a computed speed for an object label by determining a distance that the given object has traveled in a series of images based on a rate at which the series of images were captured. 4. The method of claim 3, wherein the series of images includes laser point cloud images. 5. The method of claim 1, further comprising displaying on a display device the recommendation. 6. The method of claim 1, further comprising reconfiguring the autonomous vehicle according to the recommendation. 7. The method of claim 1, further comprising: determining a difference between a first value indicating a quantity of the first object labels applied by the autonomous vehicle and a second value indicating a quantity of the one or more second object labels; anddetermining whether the autonomous vehicle has met a predetermined missed object threshold corresponding to a maximum allowable quantity of object labels not applied by the autonomous vehicle by comparing the difference to the threshold, and wherein the recommendation is generated further based on the determination of whether the vehicle has met the predetermined missed object threshold. 8. The method of claim 7, further comprising for each given one of the first object labels, determining an object label ratio corresponding to an area of intersection between a given one and a given one or more second object labels and an area of union between the given one and the given one or more second object labels, and wherein the recommendation is generated further based on the ratio. 9. The method of claim 1, further comprising for each given one of the first object labels, determining an object label ratio corresponding to an area of intersection between a given one and a given one or more second object labels and an area of union between the given one and the given one or more second object labels, and wherein the recommendation is generated further based on any determined ratios. 10. The method of claim 9, further comprising: determining an average object label ratio value for each of the determine object label ratios; andcomparing the average object label ratio value to an object label ratio threshold to determine whether the object label ratio threshold has been met, and wherein the recommendation is generated further based on the determination of whether the object label ratio threshold has been met. 11. A system for optimizing object detection performed by autonomous vehicles, the system comprising one or more computing devices having one or more processors configured to: receive sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes first object labels applied by the autonomous vehicle, each of the first object labels corresponding to a computed speed of a particular object of the sensor data;receive one or more second object labels not applied by the autonomous vehicle for the sensor data corresponding to a computed speed of the particular object;determine differences in speed between corresponding objects of the first object labels and one or more second object labels;determining, by the one or more computing devices, a number and value of differences in speed based on the determined differences; andgenerate a recommendation for an adjustment of at least one object detection parameter of at least one of a plurality of sensors based on the determined number and value of differences in speed in order to optimize object detection. 12. The system of claim 11, wherein the one or more second object labels include labels generated at least in part by one or more processors of a second computing device. 13. The system of claim 11, wherein the one or more processors are further configured to, for each given object of the sensor data, determine a computed speed for an object label by determining a distance that the given object has traveled in a series of images based on a rate at which the series of images were captured. 14. The system of claim 11, further comprising the vehicle. 15. The system of claim 11, further comprising a display device, and wherein the one or more processors are further configured to display the recommendation on the display device. 16. The system of claim 11, wherein the one or more processors are further configured to reconfigure the autonomous vehicle according to the recommendation. 17. The system of claim 11, wherein the one or more processors are further configured to: determine a difference between a first value indicating a quantity of the first object labels applied by the autonomous vehicle and a second value indicating a quantity of the one or more second object labels;determine whether the autonomous vehicle has met a predetermined missed object threshold corresponding to a maximum allowable quantity of object labels not applied by the autonomous vehicle by comparing the difference to the threshold; andgenerate the recommendation further based on the determination of whether the vehicle has met the predetermined missed object threshold. 18. The system of claim 17, wherein the one or more processors are further configured to: for each given one of the first object labels, determine an object label ratio corresponding to an area of intersection between a given one and a given one or more second object labels and an area of union between the given one and the given one or more second object labels; andgenerate the recommendation further based on the ratio. 19. The system of claim 11, wherein the one or more processors are further configured to: for each given one of the first object labels, determine an object label ratio corresponding to an area of intersection between a given one and a given one or more second object labels and an area of union between the given one and the given one or more second object labels; andgenerate the recommendation further based on any determined ratios. 20. The system of claim 19, wherein the one or more processors are further configured to: determine an average object label ratio value for each of the determine object label ratios;compare the average object label ratio value to an object label ratio threshold to determine whether the object label ratio threshold has been met; andgenerate the recommendation further based on the determination of whether the object label ratio threshold has been met.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (115)
Oda, Tamami; Watanabe, Tomo; Sato, Tsuyoshi, AUTOMATIC VEHICLE GUIDANCE SYSTEM, CONTROL APPARATUS IN AUTOMATIC VEHICLE GUIDANCE SYSTEM, AUTOMATIC VEHICLE GUIDANCE METHOD, AND COMPUTER-READABLE DATA RECORDED MEDIUM IN WHICH AUTOMATIC VEHICLE GUI.
Huang, Jihua; Lin, William C.; Chin, Yuen-Kwok, Adaptive vehicle control system with driving style recognition based on maneuvers at highway on/off ramps.
Isogai Akira,JPX ; Takagi Kiyokazu,JPX, Automatic deceleration control system, vehicle-to-obstacle distance control system, and system program storage medium for vehicle.
Latarnik Michael (Friedrichsdorf DEX) Kolbe Alexander (Gross Zimmern DEX) Honus Klaus (Frankfurt am Main DEX), Circuit configuration and method for controlling a traction slip control system with brake and/or engine management.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
Wimmer, Martin; Meurle, Juergen; Sacher, Heike; Siedersberger, Karl-Heinz; Scheiffert, Fabian; Ehrhart, Franziska, Device for the automated driving of a motor vehicle, motor vehicle having such a device and method for operating a motor vehicle.
Brett B. Stewart ; James W. Thompson, Geographic-based communication service system with more precise determination of a user's known geographic location.
Holloway,Lane Thomas; Kobrosly,Walid M.; Malik,Nadeem; Quiller,Marques Benjamin, Limiting and controlling motor vehicle operation functions enabled for each of a group of drivers of the vehicle.
Niem, Wolfgang; Ibele, Philipp, Method and device for recognizing road signs in the vicinity of a vehicle and for synchronization thereof to road sign information from a digital map.
Christopher Kenneth Hoover Wilson ; Seth Olds Rogers ; Patrick Wyatt Langley, Method and system for autonomously developing or augmenting geographical databases by mining uncoordinated probe data.
Bhogal, Kulvir S.; Peterson, Robert R.; Seacat, Lisa A.; Talbot, Mark W., Method and system to alert user of local law via the Global Positioning System (GPS).
Toepfer Bernhard (Stuttgart DEX) Reiner Michael (Fellbach DEX) Klein Bodo (Borsinghausen DEX), Method of determining a wear-dependent braking force distribution.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Kinney, Powell McVay; Dooner, Matthew Taylor; Wilson, Bruce Mackie; Schneider, Jr., Carl Reimers; Goeller, Keith Brian, Navigation and control system for autonomous vehicles.
O Connor, Michael L.; Bell, Thomas; Eglington, Michael L.; Leckie, Lars; Gutt, Gregory M.; Zimmerman, Kurt R., Rapid adjustment of trajectories for land vehicles.
Rao Prithvi N. (Pittsburgh PA) Shin Dong Hun (Pittsburgh PA) Whittaker William L. (Pittsburgh PA) Kleimenhagen Karl W. (Peoria IL) Singh Sanjiv J. (Pittsburgh PA) Kemner Carl A. (Peoria Heights IL) B, System and method for enabling an autonomous vehicle to track a desired path.
Barrett,David S.; Allard,James; Filippov,Misha; Pack,Robert Todd; Svendsen,Selma, System and method for processing safety signals in an autonomous vehicle.
Norris, William Robert; Allard, James; Filippov, Mikhail O.; Haun, Robert Dale; Turner, Christopher David Glenn; Gilbertson, Seth; Norby, Andrew Julian, Systems and methods for switching between autonomous and manual operation of a vehicle.
Nagda, Paresh; Li, Wenbin; Howlett, Julia; Fan, Rodric C.; Yang, Xinnong; Fay, James D., Using location data to determine traffic and route information.
Harumoto,Satoshi; Yamato,Toshitaka; Takeuchi,Hiroshi; Maeno,Yoshihiko; Miyamoto,Naotoshi; Sakiyama,Kazuhiro, Vehicle control apparatus, vehicle control method, and computer program.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.