Automatic flight control for UAV based solid modeling
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-003/00
B64C-019/00
B64C-039/02
G05D-001/00
G05D-001/10
G06T-017/05
G06T-017/10
출원번호
US-0054882
(2010-09-30)
등록번호
US-8965598
(2015-02-24)
국제출원번호
PCT/US2010/050829
(2010-09-30)
§371/§102 date
20130812
(20130812)
국제공개번호
WO2012/044297
(2012-04-05)
발명자
/ 주소
Kruglick, Ezekiel
출원인 / 주소
Empire Technology Development LLC
대리인 / 주소
Turk IP Law, LLC
인용정보
피인용 횟수 :
17인용 특허 :
16
초록▼
Technologies are generally described for controlling a flight path of a UAV based image capture system for solid modeling. Upon determining an initial movement path based on an estimate of a structure to be modeled, images of the structure to be modeled may be captured and surface hypotheses formed
Technologies are generally described for controlling a flight path of a UAV based image capture system for solid modeling. Upon determining an initial movement path based on an estimate of a structure to be modeled, images of the structure to be modeled may be captured and surface hypotheses formed for unobserved surfaces based on the captured images. A normal vector and a viewing cone may be computed for each hypothesized surface. A set of desired locations may be determined based on the viewing cones for the entire structure to be modeled and a least impact path for the UAV determined based on the desired locations and desired flight parameters.
대표청구항▼
1. An automatic unmanned aerial vehicle (UAV) flight control system for solid modeling, the system comprising: a UAV with an onboard camera;a controller capable of communication with a flight control module of the UAV, the controller configured to: determine an initial movement path based on an esti
1. An automatic unmanned aerial vehicle (UAV) flight control system for solid modeling, the system comprising: a UAV with an onboard camera;a controller capable of communication with a flight control module of the UAV, the controller configured to: determine an initial movement path based on an estimate of a structure to be modeled;capture images of the structure to be modeled;form surface hypotheses for unobserved surfaces based on the captured images;determine missing surface information from the surface hypotheses; anddetermine a least impact path for the UAV based on the missing surface information and desired flight parameters. 2. The system according to claim 1, wherein the initial movement path is determined based on one of user definition and automatic estimation of an outline of the structure to be modeled. 3. The system according to claim 1, wherein the controller is further configured to determine a normal vector and a viewing cone for each surface with the missing surface information. 4. The system according to claim 3, wherein the controller is further configured to determine a set of desired locations based on the viewing cones for an entirety of the structure to be modeled. 5. The system according to claim 4, wherein the controller is further configured to determine a confidence interval associated with each viewing cone, the confidence interval defining one of a priority and/or a value of the UAV visiting the viewing cone. 6. The system according to claim 4, wherein the controller is further configured to determine the desired locations based on hypothesized surfaces for portions of the structure to be modeled that have not been captured yet. 7. The system according to claim 6, wherein the hypothesized surfaces are computed employing a Random Sample Consensus Surface Extraction (RANSAC) algorithm. 8. The system according to claim 1, wherein the desired flight parameters include one or more of a total flight time, available UAV power, a noise limitation, and/or a user defined restriction. 9. The system according to claim 1, wherein the controller is part of a remote computing device and is further configured to communicate with the flight control module of the UAV via wireless means. 10. A method to control a flight path of an unmanned aerial vehicle (UAV) based image capture system for solid modeling, the method comprising: determining an initial movement path based on an estimate of a structure to be modeled;capturing images of the structure to be modeled;forming surface hypotheses for unobserved surfaces based on the captured images;computing a normal vector and a viewing cone for each hypothesized surface;determining a set of desired locations based on the viewing cones for an entirety of the structure to be modeled; anddetermining a least impact path for the UAV based on the desired locations and desired flight parameters. 11. The method according to claim 10, further comprising: computing the viewing cone for each hypothesized surface using the normal vector and a view angle. 12. The method according to claim 11, wherein the view angle is dynamically determined as a goodness gradient based on an onboard camera's optical capabilities, a distance of the UAV to the surface, and lighting conditions such that a goodness parameter for the flight path is optimized. 13. The method according to claim 12, wherein the goodness parameter is derived from a quality of data associated with unobserved surfaces of the structure to be modeled. 14. The method according to claim 12, further comprising: optimizing the goodness parameter employing a multi-dimensional optimization of values algorithm on the goodness gradient and a cost function representing one or more of a total flight time, available UAV power, a noise limitation, and/or a user defined restriction for the UAV. 15. The method according to claim 14, wherein the optimization of values algorithm is one of a lazy optimization algorithm and a simulated annealing optimization algorithm. 16. The method according to claim 12, wherein the goodness gradient is computed once per travel path for each portion of the structure to be modeled. 17. A computer-readable storage medium with instructions stored thereon to control a flight path of an unmanned aerial vehicle (UAV) based image capture system for solid modeling, the instructions comprising: determining an initial movement path based on an estimate of a structure to be modeled;capturing images of the structure to be modeled; andguiding the flight path by: forming surface hypotheses for unobserved surfaces based on the captured images;computing a normal vector and a viewing cone for each hypothesized surface;determining a set of desired locations based on the viewing cones for an entirety of the structure to be modeled; anddetermining a least impact path for the UAV based on the desired locations and one or more of a total flight time, available UAV power, a noise limitation, and/or a user defined restriction for the UAV. 18. The computer-readable storage medium according to claim 17, wherein the instructions further comprise: dynamically computing a view angle for each viewing cone as a goodness gradient based on an onboard camera's optical capabilities, a distance of the UAV to the surface, and lighting conditions such that a goodness parameter for the flight path representing a quality of captured images of the structure to be modeled is optimized. 19. The computer-readable storage medium according to claim 17, wherein the normal vector is determined using an average normal from lowest quality data gathered from the captured images. 20. The computer-readable storage medium according to claim 17, wherein the normal vector is determined for non-planar surfaces by breaking down surfaces that are previously identified as low quality from a single score into a Voronoi tessellation and assigning each region a similar score. 21. The computer-readable storage medium according to claim 20, wherein the instructions further comprise: employing a largest area in a resulting Voronoi diagram with a score below a predefined threshold as the surface for normal vector generation; andextending the determined normal vector to define the viewing cone based on an onboard camera's optical capabilities, a distance of the UAV to the surface, and lighting conditions.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (16)
Garceau, Robert M.; Gutierrez, Guillermo E.; Rahmes, Mark; Ham, Todd; Nemethy, Joseph; Hackett, Jay, Accuracy enhancing system for geospatial collection value of an image sensor aboard an airborne platform and associated methods.
Duggan, David S.; Felio, David A.; Pate, Billy B.; Longhi, Vince R.; Petersen, Jerry L.; Bergee, Mark J., Autonomous control of unmanned aerial vehicles.
Kuwano Ryushi (Tokyo JPX) Nagura Riichi (Tokyo JPX), Image pickup system capable of reproducing a stereo and/or a nonstereo image by the use of a single optical system.
Duggan, David S.; Felio, David A.; Pate, Billy B.; Longhi, Vince R.; Petersen, Jerry L.; Bergee, Mark J., Multi-sensor autonomous control of unmanned aerial vehicles.
Ramier Alain (Tournefeville FRX) Duturc Daniel (Coloniers FRX) Saint-Upery Yves (Toulouse FRX), Process for displaying flying aid symbols on a screen on board an aircraft.
Gruber,Michael A.; Leberl,Franz W.; Ponticelli,Martin, Self-calibrating, digital, large format camera with single or multiple detector arrays and single or multiple optical systems.
Pleitner Peter K. (Ann Arbor MI) Vincent Robert K. (Ann Arbor MI), System for determining and controlling the attitude of a moving airborne or spaceborne platform or the like.
Pleitner Peter K. (Ann Arbor MI) Vincent Robert K. (Ann Arbor MI), System for determining the attitude of a moving imaging sensor platform or the like.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.