Unmanned aerial vehicle rooftop inspection system
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
B64C-039/02
H04N-007/18
G06T-007/00
G06K-009/46
G06T-007/60
G06K-009/52
G06K-009/00
G08G-005/00
출원번호
US-0068327
(2016-03-11)
등록번호
US-9609288
(2017-03-28)
발명자
/ 주소
Richman, Brian
Bauer, Mark Patrick
Michini, Bernard J.
Poole, Alan Jay
출원인 / 주소
UNMANNED INNOVATION, INC.
대리인 / 주소
Knobbe Martens Olson & Bear LLP
인용정보
피인용 횟수 :
24인용 특허 :
28
초록▼
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes receiving, by the UAV, flight information describing a job to perform an inspection of a rooftop. A p
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes receiving, by the UAV, flight information describing a job to perform an inspection of a rooftop. A particular altitude is ascended to, and an inspection of the rooftop is performed including obtaining sensor information describing the rooftop. Location information identifying a damaged area of the rooftop is received. The damaged area of the rooftop is traveled to. An inspection of the damaged area of the rooftop is performed including obtaining detailed sensor information describing the damaged area. A safe landing location is traveled to.
대표청구항▼
1. A device comprising one or more processors, and a computer storage media storing instructions, that when executed by the one or more processors, cause the one or more processors to perform operations comprising: transmitting, by the device and to an unmanned aerial vehicle (UAV) via a wireless or
1. A device comprising one or more processors, and a computer storage media storing instructions, that when executed by the one or more processors, cause the one or more processors to perform operations comprising: transmitting, by the device and to an unmanned aerial vehicle (UAV) via a wireless or wired connection, a first inspection flight pattern for implementation by the UAV, the first inspection flight pattern indicating that the UAV is to obtain one or more aerial view images, associated with a first level of detail, of a structure;displaying, via an interface of the device, one or more received aerial view images obtained, by the UAV, during implementation of the first inspection flight pattern, the aerial view images depicting a rooftop of the structure;receiving, by the device, input specifying selections of one or more portions of the displayed aerial view images, the portions being associated with inspection locations indicating, at least, positions about the rooftop for which the UAV is to obtain images of the rooftop that are associated with a second level of detail greater than the first level of detail;determining, by the device, a second inspection flight pattern for the UAV, the second inspection flight pattern comprising inspection waypoints for the inspection locations; andtransmitting, by the device and to the UAV via a wireless or wired connection, flight information including the second inspection flight pattern for implementation. 2. The device of claim 1, wherein the operations further comprise: determining whether an obtained aerial view image meets an image quality threshold; andupon a positive determination, transmitting instructions to the UAV to retake the determined aerial view image. 3. The device of claim 1, wherein the first inspection flight pattern includes a takeoff position, and a landing position, the takeoff and landing positions each comprising waypoints having an associated geospatial location, and wherein the takeoff and landing positions are used for the second inspection flight pattern. 4. The device of claim 1, wherein the operations further comprise: determining a geofence envelope boundary for the UAV, wherein the geofence envelope boundary limits allowable locations of the UAV; anddetermining an ascent altitude associated with transitions, by the UAV, between inspection waypoints, wherein the ascent altitude is lower than a maximum altitude indicated by the geofence envelope boundary. 5. The device of claim 1, wherein the operations further comprise: determining a waypoint action for a particular inspection location of the one or more inspection locations, the waypoint action comprising determining a slope of the rooftop about the particular inspection location. 6. The device of claim 1, wherein the operations further comprise: while the UAV implements the second inspection flight pattern, transmitting, by the device, commands to the UAV to control a vertical rate of ascent or descent of the UAV, rotation of the UAV, triggering of a UAV sensor, a direction of a sensor, nudging of the UAV or resuming auto-piloted navigation of the UAV. 7. The device of claim 1, wherein the operations further comprise: obtaining one or more digital images that include an aerial view of the rooftop of the structure; andproviding, to the UAV, the one or more obtained digital images, the digital images being usable during implementation of the second inspection flight pattern to assist navigation of the UAV to a particular inspection location of the one or more inspection locations using visual odometry in reference to the digital view images. 8. The device of claim 1, wherein the interface includes a user affordance representing a size of a portion of the rooftop that is to be captured in aerial view images obtained by the UAV, wherein the user affordance is associated with a level of detail. 9. The device of claim 1, wherein during implementation of the second inspection flight pattern, the UAV is to navigate to the positions indicated by the inspection locations, and at an inspection altitude obtain aerial view images of the rooftop of the structure. 10. The device of claim 9, wherein the inspection altitude is based on the second level of detail, and wherein the second level of detail identifies an image pixel resolution of the obtained aerial view images. 11. A non-transitory computer storage medium comprising instructions that when executed by a device of one or more processors, cause the device to perform operations comprising: transmitting, by the device and to an unmanned aerial vehicle (UAV) via a wireless or wired connection, a first inspection flight pattern for implementation by the UAV, the first inspection flight pattern indicating that the UAV is to obtain one or more aerial view images of a structure that are associated with a first level of detail;displaying, via an interface of the device, one or more received aerial view images obtained, by the UAV, during implementation of the first inspection flight pattern, the aerial view images depicting a rooftop of the structure;receiving, by the device, input specifying selections of one or more portions of the displayed aerial view images, the portions being associated with inspection locations indicating, at least, positions about the rooftop for which the UAV is to obtain images of the rooftop that are associated with a second level of detail greater than the first level of detail;determining, by the device, a second inspection flight pattern for the UAV, the second inspection flight pattern comprising inspection waypoints for the inspection locations; andtransmitting, by the device and to the UAV via a wireless or wired connection, flight information including the second inspection flight pattern for implementation. 12. The computer storage medium of claim 11, wherein the operations further comprise: determining whether an obtained aerial view image meets an image quality threshold; andupon a positive determination, transmitting instructions to the UAV to retake the determined aerial view image digital image. 13. The computer storage medium of claim 11, wherein the first inspection flight pattern includes a takeoff position, and a landing position, the takeoff and landing positions each comprising waypoints having an associated geospatial location, and wherein the takeoff and landing positions are used for the second inspection flight pattern. 14. The computer storage medium of claim 11, wherein the operations further comprise: determining a geofence envelope boundary for the UAV, wherein the geofence envelope boundary limits allowable locations of the UAV; anddetermining an ascent altitude associated with transitions, by the UAV, between inspection waypoints, wherein the ascent altitude is lower than a maximum altitude indicated by the geofence envelope boundary. 15. The computer storage medium of claim 11, wherein the operations further comprise: determining a waypoint action for a particular inspection location of the one or more inspection locations, the waypoint action comprising determining a slope of the rooftop about the particular inspection location. 16. The computer storage medium of claim 11, wherein the operations further comprise: while the UAV implements the second inspection flight pattern, transmitting, by the device, commands to the UAV to control a vertical rate of ascent or descent of the UAV, rotation of the UAV, triggering of a UAV sensor, a direction of a sensor, nudging of the UAV or resuming auto-piloted navigation of the UAV. 17. The computer storage medium of claim 11, wherein the operations further comprise: obtaining one or more digital images that include an aerial view of the rooftop of the structure; andproviding, to the UAV, the one or more obtained digital images, the digital images being usable during implementation of the second inspection flight pattern to assist navigation of the UAV to a particular inspection location of the one or more inspection locations using visual odometry in reference to the digital view images. 18. The computer storage medium of claim 11, wherein the interface includes a user affordance representing a size of a portion of the rooftop that is to be captured in aerial view images obtained by the UAV, wherein the user affordance is associated with a level of detail. 19. The computer storage medium of claim 11, wherein during implementation of the second inspection flight pattern, the UAV is to navigate to the positions indicated by the inspection locations, and at an inspection altitude obtain aerial view images of the rooftop of the structure. 20. The computer storage medium of claim 19, wherein the inspection altitude is based on the second level of detail, and wherein the second level of detail identifies an image pixel resolution of the obtained aerial view images. 21. A computerized method performed by a device comprising one or more processors, the method comprising: transmitting, by the device and to an unmanned aerial vehicle (UAV) via a wireless or wired connection, a first inspection flight pattern for implementation by the UAV, the first inspection flight pattern indicating that the UAV is to obtain one or more aerial view images of a structure that are associated with a first level of detail;displaying, via an interface of the device, one or more received aerial view images obtained, by the UAV, during implementation of the first inspection flight pattern, the aerial view images depicting a rooftop of the structure;receiving, by the device, input specifying selections of one or more portions of the displayed aerial view images, the portions being associated with inspection locations indicating, at least, positions about the rooftop for which the UAV is to obtain images of the rooftop that are associated with a second level of detail greater than the first level of detail;determining, by the device, a second inspection flight pattern for the UAV, the second inspection flight pattern comprising inspection waypoints for the inspection locations; andtransmitting, by the device and to the UAV via a wireless or wired connection, flight information including the second inspection flight pattern for implementation. 22. The computerized method of claim 21 further comprising: determining whether an obtained aerial view image meets an image quality threshold; andupon a positive determination, transmitting instructions to the UAV to retake the determined aerial view image. 23. The computerized method of claim 21, wherein the first inspection flight pattern includes a takeoff position, and a landing position, the takeoff and landing positions each comprising waypoints having an associated geospatial location, and wherein the takeoff and landing positions are used for the second inspection flight pattern. 24. The computerized method of claim 21 further comprising: determining a geofence envelope boundary for the UAV, wherein the geofence envelope boundary limits allowable locations of the UAV; anddetermining an ascent altitude associated with transitions, by the UAV, between inspection waypoints, wherein the ascent altitude is lower than a maximum altitude indicated by the geofence envelope boundary. 25. The computerized method of claim 21 further comprising: determining a waypoint action for a particular inspection location of the one or more inspection locations, the waypoint action comprising determining a slope of the rooftop about the particular inspection location. 26. The computerized method of claim 21 further comprising: while the UAV implements the second inspection flight pattern, transmitting, by the device, commands to the UAV to control a vertical rate of ascent or descent of the UAV, rotation of the UAV, triggering of a UAV sensor, a direction of a sensor, nudging of the UAV or resuming auto-piloted navigation of the UAV. 27. The computerized method of claim 21 further comprising: obtaining one or more digital images that include an aerial view of the rooftop of the structure; andproviding, to the UAV, the one or more obtained digital images, the digital images being usable during implementation of the second inspection flight pattern to assist navigation of the UAV to a particular inspection location of the one or more inspection locations using visual odometry in reference to the digital view images. 28. The computerized method of claim 21, wherein the interface includes a user affordance representing a size of a portion of the rooftop that is to be captured in aerial view images obtained by the UAV, wherein the user affordance is associated with a level of detail. 29. The computerized method of claim 21, wherein during implementation of the second inspection flight pattern, the UAV is to navigate to the positions indicated by the inspection locations, and at an inspection altitude obtain aerial view images of the rooftop of the structure. 30. The computerized method of claim 29, wherein the inspection altitude is based on the second level of detail, and wherein the second level of detail identifies an image pixel resolution of the obtained aerial view images.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (28)
Sun, Kuan-Chun; Han, Meng-Ju; Hu, Jwu-Sheng; Wu, Cheng-Hua, Automatic guided vehicle and method for controlling the same.
Koehler, Frederick B.; Werries, William D.; Markason, David J.; Anthony, David G.; Rinker, Robert; Roberts, Thomas E., Gimbaled system with optical coudé path and method transferring data.
Koehler, Elka E.; Andressen, Clarence C.; Jenkins, David G.; Taylor, Byron B., Laser imaging system with uniform line illumination and method for generating images.
Harvey, Brian N.; Tofte, Nathan L.; Schmidgall, Roger D.; Aviles, Michael Jeffrey; Pott, Kyle; Grant, Rosemarie Geier; Haefli, Eric; Jacob, Michael Shawn, Method and system for assessing damage to infrastructure.
Freeman, James M.; Schmidgall, Roger D.; Boyer, Patrick Harold; Christopulos, Nicholas U.; Maurer, Jonathan D.; Tofte, Nathan Lee; Jordan, II, Jackie O., Methods and systems for capturing the condition of a physical structure.
Vian, John Lyle; Mansouri, Ali Reza; Saad, Emad William, System and method for inspection of structures and objects by swarm of remote unmanned vehicles.
Hopkins, III, John Chandler; Bueché, Jr., Michael Patrick; Buentello, Andre Rene; Hillman, James Philip; Billman, Bradly Jay, Systems and methods for using unmanned aerial vehicles.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for adaptive property analysis via autonomous vehicles.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for adaptive property analysis via autonomous vehicles.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for adaptive property analysis via autonomous vehicles.
Larson, Leif; Loveland, Jim; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for adaptive scanning based on calculated shadows.
Larson, Leif; Loveland, Jim; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for autonomous imaging and structural analysis.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for autonomous perpendicular imaging of test squares.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for autonomous perpendicular imaging of test squares.
Larson, Leif; Loveland, Jim; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for autonomous perpendicular imaging with a target field of view.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for surface and subsurface damage assessments, patch scans, and visualization.
Loveland, Jim; Larson, Leif; Christiansen, Dan; Christiansen, Tad; Christiansen, Cam, Systems and methods for surface and subsurface damage assessments, patch scans, and visualization.
Bauer, Mark Patrick; Richman, Brian; Poole, Alan Jay; Michini, Bernard J.; Lovegren, Jonathan Anders; Bethke, Brett Michael; Li, Hui, Unmanned aerial vehicle rooftop inspection system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.