Machine learning systems and techniques to optimize teleoperation and/or planner decisions
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-001/02
G05D-001/08
G06N-007/00
G06N-099/00
G05D-001/00
출원번호
US-0393228
(2016-12-28)
등록번호
US-10048683
(2018-08-14)
발명자
/ 주소
Levinson, Jesse Sol
Sibley, Gabriel Thurston
Rege, Ashutosh Gajanan
출원인 / 주소
Zoox, Inc.
대리인 / 주소
Lee & Hayes, PLLC
인용정보
피인용 횟수 :
0인용 특허 :
18
초록▼
A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an a
A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an autonomous vehicle, a simulator, or a teleoperator) to undertake based on suboptimal autonomous vehicle performance and/or changes in detected sensor data (e.g., new buildings, landmarks, potholes, etc.). The application may determine a subset of trajectories based on a number of decisions and interactions when resolving an anomaly due to an event or condition. The application may use aggregated sensor data from multiple autonomous vehicles to assist in identifying events or conditions that might affect travel (e.g., using semantic scene classification). An optimal subset of trajectories may be formed based on recommendations responsive to semantic changes (e.g., road construction).
대표청구항▼
1. An autonomous vehicle comprising: one or more processors;a communication interface, the communication interface configured to establish a communications link between the autonomous vehicle and one or more other devices or autonomous vehicles;one or more sensors; andmemory having stored thereon pr
1. An autonomous vehicle comprising: one or more processors;a communication interface, the communication interface configured to establish a communications link between the autonomous vehicle and one or more other devices or autonomous vehicles;one or more sensors; andmemory having stored thereon processor-executable instructions that, when executed by the one or more processors, configure the autonomous vehicle to perform operations comprising: obtaining sensor data from the one or more sensors;detecting, from the sensor data, an event, the event being associated with operation of the autonomous vehicle;determining a type of the event;requesting, via the communication interface, a teleoperator command based, at least in part, on the type of the event;receiving via the communication interface a teleoperator command; andcontrolling the autonomous vehicle based, at least in part, on the teleoperator command. 2. The autonomous vehicle as claim 1 recites, wherein the communication link comprises two or more networks or subnetworks, the two or more networks or subnetworks configured to provide the communication link and a redundant communication link, and further wherein each of the one or more networks or subnetworks comprise one or more of a cellular network or a data network. 3. The autonomous vehicle as claim 1 recites, wherein the communication interface is configured to implement a communications protocol, the communications protocol comprising one or more of a real time encryption protocol or a quality of service. 4. The autonomous vehicle as claim 1 recites, wherein the teleoperator command is determined based, at least in part, on policy data. 5. The autonomous vehicle as claim 4 recites, further comprising: a communication event detector, the communication event detector configured to output a communication level, andwherein the operations further comprise selecting, based at least in part, on the communication level updated policy data. 6. The autonomous vehicle of claim 5, wherein the updated policy data comprises instructions configured to control the autonomous vehicle to navigate out of a region. 7. The autonomous vehicle as claim 1 recites, the operations further comprising: based at least in part on the type of the event, determining a confidence level that indicates a probability that the event will impact operation of the autonomous vehicle, the type of the event indicating a criticality of the event; andwherein detecting the event or determining the type of the event includes one or more of:determining that the autonomous vehicle is approaching a region,determining a time of day,determining a position of the sun,determining that there is one or more of traffic or an accident,determining that the autonomous vehicle has been immobile for a threshold amount of time,determining that the confidence level is below a threshold, ordetermining that previously determined confidence levels exhibit a decreasing trend. 8. A method comprising: obtaining sensor data from one or more sensors, the one or more sensors located on an autonomous vehicle;determining based, at least in part, on the sensor data that a type of event has occurred;transmitting a request for a teleoperator command based, at least in part, on the type of event;receiving, via a communication interface, a teleoperator command, the teleoperator command based, at least in part, on one or more of policy data or the type of event; andcontrolling the autonomous vehicle based, at least in part, on the teleoperator command, wherein the communication interface is configured to send and receive one or more data messages over a communication link, wherein the type of event includes one or more of: the autonomous vehicle approaching a region,a time of day,a position of the sun,traffic,an accident,the autonomous vehicle has been immobile for a threshold amount of time, ora confidence level determined from the sensor data is below a threshold. 9. The method of claim 8, wherein the communications link is configured to transmit and receive the one or more data messages between the autonomous vehicle and another device. 10. The method of claim 8, wherein the another device includes another autonomous vehicle. 11. The method of claim 8, wherein the one or more sensors comprise at least one of a LIDAR, a radar, a sonar, or an image capture device. 12. The method of claim 8, wherein the communications link is configured to provide a primary communication link and a redundant communication link, the redundant communication link being between the autonomous vehicle and another device. 13. The method of claim 8, wherein the one or more data message is encrypted. 14. The method of claim 8, wherein the policy data is updated to create updated policy data based, at least in part, on the type of event, the updated policy data comprising instructions to control the autonomous vehicle to avoid a region, and wherein the region comprises a geographic location where a bandwidth of one or more networks does not meet a threshold bandwidth for forming the communications link or successfully transmitting data over the communications link. 15. The method of claim 8, wherein the communication link comprises one or more of a cellular network or a data network. 16. The method of claim 8, wherein the confidence level is calculated by the autonomous vehicle based, at least in part, on the type of event, and indicates a probability that a course of action chosen by the autonomous vehicle will result in safe operation of the autonomous vehicle. 17. The method of claim 8 further comprising directing an available bandwidth of the communications link to be adjusted to maintain at least a threshold bandwidth. 18. One or more non-transitory computer-readable media storing computer-executable instructions configured to program one or more computing devices to perform operations comprising: monitoring operation of one or more autonomous vehicles based at least in part on data received from the one or more autonomous vehicles;detecting, from the monitoring, an event at an autonomous vehicle of the one or more autonomous vehicles associated with operation of the autonomous vehicle; andobtaining sensor data from the autonomous vehicle based, at least in part, on the detecting of the event, the obtaining including one or more of: transmitting, via a communication interface, instructions to the autonomous vehicle to transmit the sensor data for reception by the one or more computing devices, orreceiving, via the communication interface, the sensor data contemporaneously with the event from the autonomous vehicle,wherein the communication interface configured to send and receive one or more data messages over a communication link. 19. One or more non-transitory computer-readable media as claim 18 recites, wherein the operations further comprise: determining a type of the event, the type indicating a probability that the event will impact nominal driving operation of the autonomous vehicle; andwherein the obtaining is further based at least in part on the type of the event. 20. The one or more non-transitory computer-readable media of claim 18, the operations further comprising establishing, via the communication interface, the communication link via a first communication channel and a redundant communication link via an alternate communication channel, wherein establishing the redundant communication link includes establishing the redundant communication link with another autonomous vehicle. 21. The one or more non-transitory computer-readable media of claim 20, wherein establishing the alternate communication link with the first autonomous vehicle includes dispatching a second autonomous vehicle to park at a location to establish a peer-to-peer network with the autonomous vehicle.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (18)
Yavnai Arie,ILX, Autonomous command and control unit for mobile platform.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.