Unmanned aircraft structure evaluation system and method
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-001/00
G06K-009/00
G08G-005/04
G08G-005/00
H04N-005/445
B64C-039/02
B64D-047/08
G06F-017/30
G06T-011/60
B60R-001/00
G01S-019/39
G06Q-040/08
출원번호
US-0049056
(2018-07-30)
등록번호
US-10181081
(2019-01-15)
발명자
/ 주소
Schultz, Stephen L.
Monaco, John
출원인 / 주소
Pictometry International Corp.
대리인 / 주소
Dunlap Codding, P.C.
인용정보
피인용 횟수 :
0인용 특허 :
150
초록▼
A computerized system, comprising: a computer system having an input unit, a display unit, one or more processors and one or more non-transitory computer readable medium, the one or more processors executing image display and analysis software to cause the one or more processors to: receive an ident
A computerized system, comprising: a computer system having an input unit, a display unit, one or more processors and one or more non-transitory computer readable medium, the one or more processors executing image display and analysis software to cause the one or more processors to: receive an identification of a structure from the input device, the structure having multiple sides, an outline, and a height; obtain characteristics of a camera mounted onto an unmanned aircraft; generate unmanned aircraft information including: flight path information configured to direct the unmanned aircraft to fly a flight path around the structure that is laterally and vertically offset from the structure, the lateral and vertical offset being dependent upon the height of the structure, an orientation of the camera relative to the unmanned aircraft, and the characteristics of the camera; and, store the unmanned aircraft information on the one or more non-transitory computer readable medium.
대표청구항▼
1. A computerized method performed by an unmanned aerial vehicle (UAV) comprising one or more processors, the method comprising: receiving, by the UAV, a flight plan comprising a plurality of flight capture points for a structure of interest having an outline, wherein the plurality of flight capture
1. A computerized method performed by an unmanned aerial vehicle (UAV) comprising one or more processors, the method comprising: receiving, by the UAV, a flight plan comprising a plurality of flight capture points for a structure of interest having an outline, wherein the plurality of flight capture points each comprise a point having a geospatial reference, a first group of flight capture points adjacent to a first side of the outline, and a second group of flight capture points adjacent to a second side of the outline;conducting an evaluation of the structure of interest according to the flight plan, the evaluation comprising: directing the UAV to fly the flight path having the plurality of flight capture points, and capture images while the UAV is at the flight capture points, the flight capture points being a distance from an exterior surface of the structure of interest such that the images includes at least a particular level of detail, the UAV having a collision detection and avoidance system, anddetecting an obstruction in the flight path with the collision detection and avoidance system;the collision detection and avoidance system steering the aircraft to bypass the obstruction, and aiming the camera at a target capture point on the exterior surface of the structure of interest to capture an image and ensure complete coverage of the structure of interest;navigating the UAV to another inspection location of the plurality of inspection locations; andnavigating the UAV to a landing location. 2. The method of claim 1, wherein steering the UAV to bypass the obstruction includes steering the UAV towards the structure of interest. 3. The method of claim 1, wherein conducting the evaluation further comprises triggering the camera to capture the images based upon a schedule. 4. The method of claim 3, wherein aiming the camera at the target capture point includes directing a yaw of the UAV. 5. The method of claim 4, wherein directing the yaw of the UAV includes measuring a current yaw of the UAV using a position and orientation system that is part of the UAV. 6. The method of claim 1, wherein the flight plan is generated by determining an effective image resolution of the images to be captured by the camera, characteristics of the camera, and a path length that achieves the effective image resolution with the characteristics of the camera. 7. The method of claim 1, wherein the structure of interest includes a perimeter, and wherein the flight path follows the perimeter of the structure of interest. 8. The method of claim 1, wherein conducting an evaluation further comprises allowing an operator to steer the UAV around the obstacle. 9. The method of claim 8, further comprising transmitting a signal to the operator in the form of an audible alarm, prior to allowing the operator to steer the UAV around the obstacle. 10. A non-transitory computer storage medium comprising instructions that when executed by one or more processors included in an Unmanned Aerial Vehicle (UAV) having a camera to cause the UAV to perform operations comprising: receiving, by the UAV, a flight plan comprising a plurality of flight capture points about a roof, wherein the plurality of flight capture points each comprise a waypoint having a geospatial reference, the flight capture points being spaced apart to obtain overlapping images of the roof from the camera, the images having an effective image resolution, the flight plan comprising instructions to aim the camera at a target capture point on the roof as the UAV is at one of the flight capture points;conducting an evaluation of the roof through autonomous flight by: directing the UAV to fly to a first one of the flight capture points of the flight plan during a first portion of the flight of the UAV, the first one of the flight capture points being spaced from the roof a path length to capture a first image having the effective image resolution,directing the UAV to fly towards the roof during a second portion of the flight of the UAV to obtain a second image having a finer resolution than the effective image resolution,the distance from the UAV to a selected target capture point on the roof during the second portion of the flight being less than the path length from the one of the flight capture points to the roof; andcapturing, while the UAV is spaced a distance from the roof less than the path length, the second image describing the surface of the roof, the second image having the finer resolution;directing the UAV to fly to another one of the flight capture points after the second portion of the flight; andnavigating the UAV to a landing location. 11. The non-transitory computer storage medium of claim 10, wherein the UAV includes a collision detection and avoidance system, and wherein the collision detection and avoidance system detects an obstacle lying along the flight path, and causes the UAV to fly closer to the roof during the second portion of the flight. 12. The non-transitory computer storage medium of claim 11, wherein the collision detection and avoidance system is imaging based. 13. The non-transitory computer storage medium of claim 11, wherein the collision detection and avoidance system is active sensor based. 14. The non-transitory computer storage medium of claim 11, wherein the collision detection and avoidance system steers the UAV so as to ensure complete coverage of the roof with images captured by the camera. 15. A computerized system, comprising: a computer system having an input unit, a display unit, one or more processors and one or more non-transitory computer readable medium, the one or more processors executing image display and analysis software to cause the one or more processors to: receive an identification of a structure of interest from the input device, the structure of interest having multiple sides, an outline, and a height;obtain characteristics of a camera mounted to a computer controlled gimbal mount of an unmanned aircraft to capture images of the structure of interest;obtain geographic locations of obstructions in potential flight paths pertaining to the structure of interest; andgenerate unmanned aircraft information including: flight path information, camera control information, and gimbal control information, the flight path information configured to direct the unmanned aircraft to fly a flight path around the structure of interest that is laterally and/or vertically offset from an exterior surface of the structure of interest, and avoid the geographic locations of obstructions, the lateral and vertical offset being dependent upon the height of the structure, an orientation of the camera relative to the unmanned aircraft, the characteristics of the camera, and geographic locations of obstructions, the camera control information configured to control the camera to capture aerial images from the camera on the unmanned aircraft while the unmanned aircraft is flying the flight path, the gimbal control information configured to control the computer controlled gimbal mount to align the camera with the structure of interest during capture of the aerial images;receive aerial images from the unmanned aircraft; andgenerate a structure report for evaluating the structure of interest using one or more aerial images obtained from the camera of the unmanned aircraft. 16. The computerized system of claim 15, wherein the lateral and vertical offsets are determined to provide an effective image resolution due to the characteristics of the camera. 17. The computerized system of claim 15, wherein the one or more processors executing image display and analysis software to cause the one or more processors to obtain geographic locations of obstructions in potential flight paths pertaining to the structure of interest by detecting the obstructions through the use of imagery selected from a group of imagery consisting of nadir images, ortho-rectified images or oblique geo-referenced images. 18. The computerized system of claim 15, wherein the one or more processors executing image display and analysis software cause the one or more processors to permit an operator to validate the flight path prior to receiving aerial images from the unmanned aircraft and generating the structure report. 19. The computerized system of claim 18, wherein the one or more processors executing image display and analysis software cause the one or more processors to permit an operator to alter the flight path prior to receiving aerial images from the unmanned aircraft and generating the structure report. 20. The computerized system of claim 15, wherein the one or more processors executing image display and analysis software cause the one or more processors to permit an operator to manually manipulate the flight path of the unmanned aircraft during flight of the unmanned aircraft. 21. The computerized system of claim 15, wherein the one or more processors executing image display and analysis software cause the one or more processors to obtain information pertaining to a footprint of the structure of interest, the footprint being a two-dimensional boundary of the structure of interest, and use the footprint to generate the unmanned aircraft information. 22. A computerized system, comprising: a computer system having an input unit, a communication port, a display unit, one or more processors and one or more non-transitory computer readable medium, the one or more processors executing image display and analysis software to cause the one or more processors to: receive an identification of a structure of interest from the input device, the structure of interest having multiple sides, an outline, and a height;obtain characteristics of a camera mounted to a computer controlled gimbal mount of an unmanned aircraft to capture images of the structure of interest;obtain geographic locations of obstructions in potential flight paths pertaining to the structure of interest; andgenerate unmanned aircraft information including: flight path information, camera control information, and gimbal control information, the flight path information configured to direct the unmanned aircraft to fly a flight path around the structure of interest that is laterally and/or vertically offset from an exterior surface of the structure of interest, and avoid the geographic locations of obstructions, the flight path being dependent upon the height of the structure, an orientation of the camera relative to the unmanned aircraft, the characteristics of the camera, and geographic locations of obstructions, the camera control information configured to control the camera to capture aerial images from the camera on the unmanned aircraft while the unmanned aircraft is flying the flight path, the gimbal control information configured to control the computer controlled gimbal mount to align the camera with the structure of interest during capture of the aerial images;permit an operator to manually manipulate the flight path of the unmanned aircraft during flight of the unmanned aircraft;receive aerial images from the unmanned aircraft; andgenerate a structure report for evaluating the structure of interest using one or more aerial images obtained from the camera of the unmanned aircraft. 23. The computerized system of claim 22, wherein the flight path is determined to provide an effective image resolution due to the characteristics of the camera. 24. The computerized system of claim 22, wherein the one or more processors executing image display and analysis software to cause the one or more processors to obtain geographic locations of obstructions in potential flight paths pertaining to the structure of interest by detecting the obstructions through the use of imagery selected from a group of imagery consisting of nadir images, ortho-rectified images or oblique geo-referenced images. 25. The computerized system of claim 22, wherein the one or more processors executing image display and analysis software cause the one or more processors to permit an operator to validate the flight path prior to receiving aerial images from the unmanned aircraft and generating the structure report. 26. The computerized system of claim 22, wherein the one or more processors executing image display and analysis software cause the one or more processors to permit an operator to alter and validate the flight path prior to receiving aerial images from the unmanned aircraft and generating the structure report. 27. The computerized system of claim 22, wherein the one or more processors executing image display and analysis software cause the one or more processors to obtain information pertaining to a footprint of the structure of interest, the footprint being a two-dimensional boundary of the structure of interest, and use the footprint to generate the unmanned aircraft information. 28. The computerized system of claim 22, wherein the gimbal control information configured to control the computer controlled gimbal mount controls a yaw and a declination of the camera relative to the structure of interest to align the camera with the structure of interest during capture of the aerial images. 29. The computerized system of claim 22, wherein the gimbal control information configured to control the computer controlled gimbal mount controls a declination of the camera relative to the structure of interest, and the flight path information controls a yaw of the unmanned aircraft to align the camera with the structure of interest during capture of the aerial images. 30. The computerized system of claim 22, wherein the input unit includes a remote control, and wherein the operator is permitted to manually manipulate the flight path of the unmanned aircraft during flight of the unmanned aircraft using the remote control.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (150)
Szeliski Richard ; Shum Heung-Yeung, 3-dimensional image rotation method and apparatus for producing image mosaics.
Harkless Lloyd B. (Londonderry NH) McCracken William L. (Wayland MA) Colosimo Joseph A. (Lexington MA), Apparatus for selectively viewing either of two scenes of interest.
Lareau Andre G. ; Beran Stephen R. ; James Brian ; Quinn James P. ; Lund John, Autonomous electro-optical framing camera system with constant ground resolution, unmanned airborne vehicle therefor, and methods of use.
Hedges Thomas M. (Great Falls VA) Weir David G. (Ormond Beach FL) Speasl Jerry A. (Pleasanton CA), Direct digital airborne panoramic camera system and method.
Lareau Andre G. ; Bennett Russell A. ; Beran Steven R. ; Bown Michael ; Hines George, Electro-optical imaging array and camera system with pitch rate image motion compensation.
Lareau Andre G. ; Bennett Russell A. ; Beran Steven R. ; Bown Michael ; Hines George, Electro-optical imaging array and camera system with pitch rate image motion compensation which can be used in an airpl.
Lareau Andre G. (Bloomingdale IL) Beran Stephen R. (Mount Prospect IL) Lund John A. (McHenry IL) Pfister William R. (Schaumburg IL), Electro-optical imaging array with motion compensation.
Lareau Andre G. ; James Brian ; Pfister William R. ; Jerkatis Kenneth J. ; Beran Stephen R. ; Bennett Russell A., Electro-optical imaging detector array for a moving vehicle which includes two axis image motion compensation and trans.
Myrick E. L. (Merritt Island FL), Geographical surveying using cameras in combination with flight computers to obtain images with overlaid geographical co.
Parulski Kenneth A. (Rochester NY) Hamel Robert H. (Walworth NY) Acello John J. (East Rochester NY), Hand-manipulated electronic camera tethered to a personal computer.
Chang Chi S. (Endicott) Hoffarth Joseph G. (Binghamton) Markovich Voya R. (Endwell) Snyder Keith A. (Vestal) Wiley John P. (Vestal NY), High density circuit board and method of making same.
Szeliski Richard ; Shum Heung-Yeung, Image mosaic construction system and apparatus with patch-based alignment, global block adjustment and pair-wise motion-based local warping.
von Braun Heiko S. (Tankenrain Salzgruben 2 Weilheim D-8120 DEX), Large-scale mapping of parameters of multi-dimensional structures in natural environments.
Abel Robert J. (Newark CA) MacDonald Michael C. (San Jose CA) Wang Peter S. (Cupertino CA), Mapping and analysis system for precision farming applications.
Lachinski Theodore M. (Andover MN) Ptacek Louis S. (Mound MN) Blais Paul M. (St. Paul MN) Boggs Stephen (Fridley MN) Longfellow John W. (St. Paul MN) Setterholm Jeffrey M. (Lakeville MN), Method and apparatus for collecting and processing visual and spatial position information from a moving platform.
Rahmes,Mark; Karp,John; Smith,Anthony; Connetti, Jr.,Stephen, Method and apparatus for enhancing a digital elevation model (DEM) for topographical modeling.
Kumar, Rakesh; Hsu, Stephen Charles; Hanna, Keith; Samarasekera, Supun; Wildes, Richard Patrick; Hirvonen, David James; Klinedinst, Thomas Edward; Lehman, William Brian; Matei, Bodgan; Zhao, Wenyi; L, Method and apparatus for performing geo-spatial registration of imagery.
Lareau Andre G. (Bloomingdale IL) Willey Gilbert W. (Arlington Heights IL) Bennett Russell A. (McHenry IL) Beran Stephen R. (Mount Prospect IL), Method and camera system for step frame reconnaissance with motion compensation.
Kumar Rakesh ; Hanna Keith James ; Bergen James R. ; Anandan Padmanabhan ; Irani Michal, Method and system for image combination using a parallax-based technique.
Cherepenin Vladimir Alexeevich,RUX ; Korjenevsky Alexandr Vladimirovich,RUX ; Kultiasov Yury Sergeevich,RUX, Method for producing a tomographic image of the body and electric impedance tomograph.
Bakewell,Charles Adams, Mobile enforcement platform with aimable violation identification and documentation system for multiple traffic violation types across all lanes in moving traffic, generating composite display images and data to support citation generation, homeland security, and monitoring.
Wight Ralph H. (Northport NY) Wolfe Gregory J. (Port Jefferson Station NY), Nonlinear scanning to optimize sector scan electro-optic reconnaissance system performance.
Heitzman Edward F. (6 Moores Mill Rd. Pennington NJ 08534) Heitzman Edward J. (6 Moores Mill Rd. Pennington NJ 08534), Real time video data acquistion systems.
Kamel Ahmed A. (Sunnyvale CA) Graul Donald W. (San Mateo CA) Savides John (Los Altos Hills CA) Hanson Charles W. (Mountain View CA), Satellite camera image navigation.
Gruber,Michael A.; Leberl,Franz W.; Ponticelli,Martin, Self-calibrating, digital, large format camera with single or multiple detector arrays and single or multiple optical systems.
Selk Kenneth Charles (Hermosa Beach CA) Hirsch Harold J. (Encino CA) Canyon James Carl (Torrance CA) Gower Frederick M. (Manhattan Beach CA), Shielded multilayer printed wiring board, high frequency, high isolation.
Imai Hitoshi (Yokohama JPX) Sugiura Muneharu (Tokyo JPX) Hoashi Katsutoshi (Yokohama JPX), Stereo image forming apparatus having a light deflection member in each optical path.
Olsen Steven L. (Salt Lake City UT) Petrick William R. (Salt Lake City UT) Stodt John A. (Salt Lake City UT), Survey system and method for real time collection and processing of geophysicals data using signals from a global positi.
Olsen Steven L. (Salt Lake City UT) Petrick William R. (Salt Lake City UT) Stodt John A. (Salt Lake City UT), Survey system for collection and real time processing of geophysical data.
Hopkins, III, John Chandler; Bueché, Jr., Michael Patrick; Buentello, Andre Rene; Hillman, James Philip; Billman, Bradly Jay, Systems and methods for using unmanned aerial vehicles.
Cooper Roger D. (Roatan Tower Court Lubenham Market Harborough Leciester LE16 954 GBX), Video signal processing apparatus for producing a composite signal for simultaneous display of data and video informatio.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.