The invention is related to methods and apparatus that use a visual sensor and dead reckoning sensors to process Simultaneous Localization and Mapping (SLAM). These techniques can be used in robot navigation. Advantageously, such visual techniques can be used to autonomously generate and update a ma
The invention is related to methods and apparatus that use a visual sensor and dead reckoning sensors to process Simultaneous Localization and Mapping (SLAM). These techniques can be used in robot navigation. Advantageously, such visual techniques can be used to autonomously generate and update a map. Unlike with laser rangefinders, the visual techniques are economically practical in a wide range of applications and can be used in relatively dynamic environments, such as environments in which people move. Certain embodiments contemplate improvements to the front-end processing in a SLAM-based system. Particularly, certain of these embodiments contemplate a novel landmark matching process. Certain of these embodiments also contemplate a novel landmark creation process. Certain embodiments contemplate improvements to the back-end processing in a SLAM-based system. Particularly, certain of these embodiments contemplate algorithms for modifying the SLAM graph in real-time to achieve a more efficient structure.
대표청구항▼
1. A method for navigating a mobile system, the method implemented on one or more computer systems, comprising: matching landmarks for a first query image associated with a mobile device by:retrieving features from a global database for the first query image, wherein the global database comprises a
1. A method for navigating a mobile system, the method implemented on one or more computer systems, comprising: matching landmarks for a first query image associated with a mobile device by:retrieving features from a global database for the first query image, wherein the global database comprises a plurality of landmarks and each landmark corresponds to a collection of 3-D features and corresponding 2-D features from which the 3-D features are computed;ranking landmarks of the plurality of landmarks by visual similarity to features of the first query image;selecting, from the global database, candidate landmarks that potentially match the features of the first query image;for each of the candidate landmarks selected from the global database: retrieving features in a local database for each of the candidate landmarks selected from the global database for the first query image, wherein the local database comprises a collection of 3-D features and corresponding 2-D features from which the 3-D features are computed for a specific landmark from the plurality of landmarks in the global database;performing robust pose estimation;performing bundle adjustment;determining an observation pose and covariance; andselecting one of the candidate landmarks as a matching landmark for the first query image; andresponsive to selecting the matching landmark for the first query image, retrieving features from the global database for a next query image, selecting next candidate landmarks therefrom, and retrieving features in a local database for the next query image. 2. The method of claim 1, wherein the mobile system comprises a camera system that provides a stereoscopic view from which 3-D features of a landmark can be identified. 3. The method of claim 1, the method further comprising the steps of: estimating course and distance traveled from a prior pose; andusing change in pose information to update one or more poses and maps maintained by a SLAM module within the mobile device. 4. The method of claim 3, wherein estimating course and distance traveled from a prior pose further comprises computing a relative pose of the mobile device with respect to one or more identified landmarks. 5. The method of claim 4, wherein computing a relative pose of the mobile device with respect to the one or more identified landmarks further comprises finding a relative pose of the mobile device that minimizes projection error from 3-D features onto 2-D coordinates of a visible feature of the one or more identified landmarks. 6. The method of claim 1, wherein the method further comprises the steps of: observing a new physical landmark; anddetermining displacements from the mobile device to features of the new physical landmark. 7. The method of claim 6, wherein determining displacements from the mobile device to the features of the new physical landmark further comprises using a current position of a mobile device reference frame as an initial estimate of a landmark reference frame. 8. The method of claim 6, wherein the method further comprises the step of storing a set of 3-D features and corresponding 2-D features that visually identify the new physical landmark in the global database. 9. The method of claim 8, wherein the 2-D features are selected from the group consisting of SIFT features, SURF features, and BRIEF features. 10. The method of claim 8, wherein storing the set of 3-D features and corresponding 2-D features that visually identify the new physical landmark in the global database further comprises: retrieving a group of at least two images for analysis, where the at least two images are selected based upon a baseline between the at least two images;analyzing the group of at least two images to identify 2-D features that are common to the at least two images in the group;determining that there are enough features detected to reliably identify the new physical landmark; andcomputing 3-D local reference frame positions to the common 2-D features based upon observed disparity and the baseline between the at least two images. 11. The method of claim 10, wherein retrieving the group of at least two images for analysis, where the at least two images are selected based upon the baseline between the at least two images comprises determining the baseline between the at least two images using dead reckoning. 12. The method of claim 10, wherein determining that there are enough features detected to reliably identify the new physical landmark comprises detecting 10 or more features. 13. The method of claim 10, wherein computing the 3-D local reference frame positions to the common 2-D features based upon observed disparity and the baseline between the at least two images further comprises solving a structure and motion problem using a trifocal tensor method. 14. The method of claim 10, wherein storing the set of 3-D features and corresponding 2-D features that visually identify the new physical landmark in the global database further comprises identifying each feature of the new physical landmark within the global database using a Landmark ID and a Feature ID.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (70)
Fong, Philip; Eade, Ethan; Munich, Mario E., Adaptive mapping with spatial summaries of sensor data.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Eric Richard Bartsch ; Charles William Fisher ; Paul Amaat France ; James Frederick Kirkpatrick ; Gary Gordon Heaton ; Thomas Charles Hortel ; Arseni Velerevich Radomyselski ; James Randy Stig, Home cleaning robot.
Shin, Kyung Chul; Park, Seong Ju; Lee, Hee Kong; Lee, Jae Young; Kim, Hyung O; Daniel, James Stonier, Map generating and updating method for mobile robot position recognition.
Gorr Russell E. ; Hancock Thomas R. ; Judd J. Stephen ; Lin Long-Ji ; Novak Carol L. ; Rickard ; Jr. Scott T., Method and apparatus for automatically tracking the location of vehicles.
Tuck Alan,GBX ; Brayson Gary,GBX ; Ignagni Mario B. ; Touchberry Alan B. ; Anderson Donald William,GBX ; Glen Stephen James,GBX ; Gilman James Michael Alexander,GBX, Method and apparatus for determining location of characteristics of a pipeline.
Shimano,Mihoko; Nagao,Kenji; Akimoto,Toshiaki; Naruoka,Tomonobu, Method and apparatus for object recognition using a plurality of cameras and databases.
Caminiti, Lorenzo; Goncalves, Luis; Di Bernardo, Enrico; Moursund, Carter, Method and system for automatically determining lines of sight between nodes.
McGee H. Dean (Rochester Hills MI) Krause Kenneth W. (Rochester MI) Coldren Bruce E. (Troy MI), Method and system for automatically determining the position and orientation of an object in 3-D space.
Asaka Shunichi (Sagamihara JPX) Echigo Tomio (Yokohama JPX) Hazeki Shinichiro (Kawasaki JPX) Ishikawa Shigeki (Tokyo JPX), Method and system for maneuvering a mobile robot.
Hanna Keith J. (Princeton NJ) Kumar Rakesh (Dayton NJ), Method for estimating the location of an image target region from tracked multiple image landmark regions.
Bauer Rudolf (Neubiberg DEX), Method for producing a cellularly structured environment map of a self-propelled, mobile unit that orients itself in the.
McTamaney Louis S. (Cupertino CA) Wong Yue M. (Saratoga CA) Chandra Rangasami S. (Pleasanton CA) Walker Robert A. (Sunnyvale CA) Lastra Jorge E. (San Jose CA) Wagner Paul A. (Cambridge MA) Sharma Uma, Multi-purpose autonomous vehicle with path plotting.
Everett ; Jr. Hobart R. (San Diego CA) Gilbreath Gary A. (San Diego CA) Laird Robin T. (San Diego CA), Navigational control system for an autonomous vehicle.
Cherveny, Kevin; Crane, Aaron; Kaplan, Lawrence M.; Jasper, John; Shields, Russell, System and method for updating, enhancing or refining a geographic database using feedback.
Kim, Kyungnam; Daily, Michael, System for automatic object localization based on visual simultaneous localization and mapping (SLAM) and cognitive swarm recognition.
Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo; Karlsson,L. Niklas, Systems and methods for computing a relative pose for global localization in a visual simultaneous localization and mapping system.
Goncalves, Luis Filipe Domingues; Karlsson, L. Niklas; Pirjanian, Paolo; Di Bernardo, Enrico, Systems and methods for controlling a density of visual landmarks in a visual simultaneous localization and mapping system.
Goncalves,Luis Filipe Domingues; Karlsson,L. Niklas; Pirjanian,Paolo; Di Bernardo,Enrico, Systems and methods for controlling a density of visual landmarks in a visual simultaneous localization and mapping system.
Karlsson,L. Niklas; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo, Systems and methods for correction of drift via global localization with a visual landmark.
Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico; Pirjanian, Paolo; Karlsson, L. Niklas, Systems and methods for determining whether to add a landmark for visual simultaneous localization and mapping.
Goncalves,Luis Filipe Domingues; Karlsson,L. Niklas; Pirjanian,Paolo; Di Bernardo,Enrico, Systems and methods for filtering potentially unreliable visual data for visual simultaneous localization and mapping.
Karlsson,L. Niklas; Pirjanian,Paolo; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico, Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques.
Domingues Goncalves, Luis Filipe; Di Bernardo, Enrico; Pirjanian, Paolo; Karlsson, L. Niklas, Systems and methods for landmark generation for visual simultaneous localization and mapping.
Karlsson, L. Nicklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Bernardo, Enrico Di, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Karlsson,L. Niklas; Pirjanian,Paolo; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Evans ; Jr. John M. (Brookfield CT) Weiman Carl F. R. (Westport CT) King Steven J. (Woodbury CT), Visual navigation and obstacle avoidance structured light system.
Evans ; Jr. John M. (Brookfield CT) Weiman Carl F. R. (Westport CT) King Steven J. (Woodbury CT), Visual navigation and obstacle avoidance structured light system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.