Unmanned aerial vehicle camera calibration as part of departure or arrival at a materials handling facility
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-003/00
G08G-005/00
B64C-039/02
B64D-047/08
H04N-007/18
G06K-009/62
H04N-017/00
G06T-007/60
G06T-007/40
G06K-009/52
출원번호
US-0188904
(2016-06-21)
등록번호
US-9972212
(2018-05-15)
발명자
/ 주소
Sperindeo, Samuel
Barash, Benji
Schoenberg, Yves Albers
Buchmueller, Daniel
출원인 / 주소
Amazon Technologies, Inc.
대리인 / 주소
Athorus, PLLC
인용정보
피인용 횟수 :
1인용 특허 :
9
초록▼
This disclosure describes systems, methods, and apparatus for automating the verification of aerial vehicle sensors as part of a pre-flight, flight departure, in-transit flight, and/or delivery destination calibration verification process. At different stages, aerial vehicle sensors may obtain senso
This disclosure describes systems, methods, and apparatus for automating the verification of aerial vehicle sensors as part of a pre-flight, flight departure, in-transit flight, and/or delivery destination calibration verification process. At different stages, aerial vehicle sensors may obtain sensor measurements about objects within an environment, the obtained measurements may be processed to determine information about the object, as presented in the measurements, and the processed information may be compared with the actual information about the object to determine a variation or difference between the information. If the variation is within a tolerance range, the sensor may be auto adjusted and operation of the aerial vehicle may continue. If the variation exceeds a correction range, flight of the aerial vehicle may be aborted and the aerial vehicle routed for a full sensor calibration.
대표청구항▼
1. A camera calibration verification method, comprising: navigating an unmanned aerial vehicle (UAV) over a marker at known position;obtaining, with a camera coupled to the UAV, an image of the marker as the UAV is navigating over the marker;processing the image to generate processed information cor
1. A camera calibration verification method, comprising: navigating an unmanned aerial vehicle (UAV) over a marker at known position;obtaining, with a camera coupled to the UAV, an image of the marker as the UAV is navigating over the marker;processing the image to generate processed information corresponding to the marker as represented in the image;comparing the processed information with actual information about the marker;determining if a variation determined from the comparison of the processed information and the actual information is within a tolerance range; andin response to determining that the variation is within a tolerance range, continuing a flight of the UAV toward a destination. 2. The method of claim 1, wherein: the processed information provides an indication of at least one of a size, a shape, or a color of the marker as represented in the image; andthe comparing includes comparing at least one of the size, the shape, or the color of the marker as indicated in the processed information with a known size, a known shape, or a known color of the marker. 3. The method of claim 1, wherein navigating includes navigating the UAV along a defined flight path over the marker. 4. The method of claim 1, further comprising: determining if the variation exceeds a correction threshold; andin response to determining that the variation exceeds a correction threshold, aborting the flight of the UAV toward the destination. 5. The method of claim 1, further comprising: in response to determining that the variation is within a tolerance range, software correcting a calibration of the camera based at least in part on the variation; andcontinuing the flight of the UAV toward the destination. 6. An aerial vehicle calibration system, comprising: a marker positioned within a materials handling facility;an aerial vehicle;a camera coupled to the aerial vehicle;a computing system configured to at least: receive an image from the camera, the image including a representation of the marker and obtained as the aerial vehicle is navigating such that the marker is in a field of view of the camera;process the image to determine a variation between at least one aspect of the marker as represented in the image with at least one known aspect of the marker;determine that the variation does not exceed a threshold;determine that the variation is within a tolerance range; andadjust a calibration of the camera based at least in part on the variation. 7. The aerial vehicle calibration system of claim 6, wherein the computing system is included in the aerial vehicle. 8. The aerial vehicle calibration system of claim 6, wherein: the computing system is part of an aerial vehicle management system that is remote from the aerial vehicle; andthe computing system is further configured to at least: subsequent to adjusting the calibration of the camera, send instructions that cause the aerial vehicle to navigate such that the marker is within the field of view of the camera;send instructions that cause the camera to obtain a second image of the marker;receive the second image; andprocess the second image to determine that the at least one aspect of the marker as represented in the second image corresponds to the at least one known aspect of the marker. 9. The aerial vehicle calibration system of claim 6, wherein the image is obtained as the aerial vehicle navigates a defined flight path. 10. The aerial vehicle calibration system of claim 6, wherein the marker is representative of a marker positioned at a delivery destination. 11. The aerial vehicle calibration system of claim 6, wherein the computing system is further configured to at least: receive a plurality of images from the camera, each image including a respective representation of the marker;process each of the plurality of images to determine a respective variation between at least one of a size of the marker as represented in each of the plurality of images, a shape of the marker as represented in each of the plurality of images, a color of the marker as represented in each of the plurality of images, or a pattern of the marker as represented in each of the plurality of images with at least one of a known size of the marker, a known shape of the marker, a known color of the marker, or a known pattern of the marker;determine that the variations are each within a tolerance range; andadjust the calibration of the camera based at least in part on at least one of the variations. 12. The aerial vehicle calibration system of claim 6, wherein the calibration of the camera is software adjusted based at least in part on the variation. 13. The aerial vehicle calibration system of claim 6, further comprising: a distance determining element positioned adjacent an aerial vehicle departure location of the materials handling facility;the computing system further configured to at least: receive from the distance determining element a measured distance between the distance determining element and the aerial vehicle;receive from the aerial vehicle an altitude of the aerial vehicle; anddetermine that a variation between the measured distance and the altitude is within an altitude tolerance range. 14. The aerial vehicle calibration system of claim 6, further comprising: a distance determining element positioned adjacent an aerial vehicle departure location of the materials handling facility;the computing system further configured to at least: receive from the distance determining element a measured distance between the distance determining element and the aerial vehicle;receive from the aerial vehicle an altitude of the aerial vehicle;determine that a variation between the measured distance and the altitude exceeds an altitude tolerance range; andcause an altitude as measured by the aerial vehicle to be altered to account for the variation between the measured distance and the altitude. 15. The aerial vehicle calibration system of claim 6, wherein the computing system is further configured to at least: process the image to determine a distance variation between a relative position of the marker as determined by the aerial vehicle and an actual position of the marker;determine that the distance variation is within a distance tolerance range; andadjust a position of the aerial vehicle as registered by the aerial vehicle based at least in part on the distance variation. 16. A camera calibration method, comprising: navigating an unmanned aerial vehicle (UAV) such that a marker at a known position is within a field of view of a camera coupled to the UAV;obtaining, with the camera, an image of the marker while the marker is within the field of view of the camera;processing the image to generate processed information corresponding to the marker as represented in the image;determining a variation between the processed information and actual information about the marker; andadjusting a calibration of the camera based at least in part on the variation. 17. The camera calibration method of claim 16, wherein: the processed information includes at least one of a shape of the marker as represented in the image, a size of the marker as represented in the image, a color of the marker as represented in the image, or a pattern of the marker as represented in the image; anddetermining the variation includes comparing at least one of the shape of the marker, the size of the marker, the color of the marker, or the pattern of the marker as indicated in the processed information with at least one of an actual size of the marker, an actual shape of the marker, an actual color of the marker, or an actual pattern of the marker. 18. The camera calibration method of claim 16, further comprising: determining that the variation can be adjusted without a full calibration of the camera; andwherein adjusting includes software adjusting the calibration of the camera. 19. The camera calibration method of claim 16, further comprising: determining a position of the marker as determined by the UAV;determining a difference between the position and an actual position of the marker; andadjusting a navigation component of the UAV based at least in part on the difference. 20. The camera calibration method of claim 16, wherein the camera is at least one of a digital still camera, a digital video camera, a thermal imaging camera, or a stereographic camera.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (9)
Gutnick David L. (Ramat Aviv ILX) Rosenberg Eugene (Raanana ILX) Belsky Igal (Ramat Aviv ILX) Zinaida Zosim (Kefar Sava ILX), a
상세보기
Feher Kornel J. (6314 Friars Rd. San Diego CA 92108), Aircraft damage assessment and surveillance system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.