Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G08G-001/123
G05D-001/02
G01C-021/12
G06T-007/00
출원번호
US-0271260
(2014-05-06)
등록번호
US-9110470
(2015-08-18)
발명자
/ 주소
Karlsson, L. Niklas
Pirjanian, Paolo
Goncalves, Luis Filipe Domingues
Di Bernardo, Enrico
출원인 / 주소
iRobot Corporation
대리인 / 주소
KPPB LLP
인용정보
피인용 횟수 :
2인용 특허 :
64
초록▼
The invention is related to methods and apparatus that use a visual sensor and dead reckoning sensors to process Simultaneous Localization and Mapping (SLAM). These techniques can be used in robot navigation. Advantageously, such visual techniques can be used to autonomously generate and update a ma
The invention is related to methods and apparatus that use a visual sensor and dead reckoning sensors to process Simultaneous Localization and Mapping (SLAM). These techniques can be used in robot navigation. Advantageously, such visual techniques can be used to autonomously generate and update a map. Unlike with laser rangefinders, the visual techniques are economically practical in a wide range of applications and can be used in relatively dynamic environments, such as environments in which people move. One embodiment further advantageously uses multiple particles to maintain multiple hypotheses with respect to localization and mapping. Further advantageously, one embodiment maintains the particles in a relatively computationally-efficient manner, thereby permitting the SLAM processes to be performed in software using relatively inexpensive microprocessor-based computer systems.
대표청구항▼
1. A method of localizing a mobile device in a multiple-particle autonomous localization and mapping system using an electronic device, the method comprising: performing, using an electronic device, autonomous localization and mapping with a plurality of particles, wherein a particle includes a devi
1. A method of localizing a mobile device in a multiple-particle autonomous localization and mapping system using an electronic device, the method comprising: performing, using an electronic device, autonomous localization and mapping with a plurality of particles, wherein a particle includes a device pose and a map, wherein the map includes at least one landmark;calculating, using the electronic device, an updated device pose estimate for a particle, wherein the technique used to calculate the updated device pose estimate is selected according to the type associated with the particle; andusing dead reckoning data to estimate a change in pose from a prior update to the particles using the electronic device;wherein calculating the updated device pose estimate for the particle further comprises using the change in pose estimated from dead reckoning data and using a relative pose to calculate the updated device pose estimate. 2. The method as defined in claim 1, wherein calculating the updated device pose estimate further comprises calculating the updated device pose estimate for a primary particle based at least in part on data from a first sensor, and calculating the updated device pose estimate for a dual particle based at least in part on data from a second sensor, where the second sensor is different from the first sensor. 3. The method as defined in claim 1, wherein calculating the updated device pose estimate further comprises calculating the updated device pose for a primary type of particle based at least in part on data from a dead reckoning sensor, and calculating the updated device pose estimate for a dual type of particle based at least in part on data from a visual sensor. 4. The method as defined in claim 1, wherein calculating the updated device pose estimate further comprises: using a prior pose estimate and dead reckoning sensor data to compute a new pose for particles of primary type based on the change in pose estimated from the dead reckoning sensor data;receiving a visually-measured relative pose to the landmark, wherein the landmark has been matched using visual features from a visual sensor coupled to the mobile device, wherein the relative pose corresponds to a visually-measured difference in pose between a landmark pose and a pose corresponding to the visual observation; andusing the landmark pose estimate and the visually-measured relative pose to compute the new pose estimate for particles of dual type. 5. The method as defined in claim 1, wherein the technique used to calculate the updated device pose estimate for a first type of particle further comprises: using a prior pose estimate, the dead reckoning sensor data, and simulated random noise to compute a new device pose estimate termed perturbed predicted device pose;using the perturbed predicted device pose and a visually-measured pose of the device relative to the landmark to compute a hypothetical landmark pose;computing an importance factor for the particle, wherein the importance factor is based at least in part on an uncertainty measure and a comparison between the calculated hypothetical landmark pose and a prior landmark pose estimate; andusing the perturbed predicted pose with the importance factor as the updated device pose. 6. The method as defined in claim 5, wherein the simulated random noise exhibits an uncertainty measure for the dead reckoning sensor data. 7. The method as defined in claim 1, wherein the technique used to calculate the updated device pose for a second type of particle termed dual particle further comprises: using a landmark pose estimate corresponding to the landmark and a visually-measured relative pose to compute a hypothetical device pose;perturbing the hypothetical device pose with simulated random noise;computing an importance factor for the particle, wherein the importance factor is based at least in part on an uncertainty measure and a comparison between the hypothetical device pose and a predicted device pose from a prior pose estimate and the dead reckoning sensor data; andusing the hypothetical device pose with the importance factor as the updated device pose. 8. The method as defined in claim 7, wherein the simulated random noise exhibits an uncertainty measure estimated for a visual sensor. 9. The method as defined in claim 1, further comprising resampling selected particles from the plurality of particles. 10. A circuit for localizing a mobile device in a multiple-particle autonomous localization and mapping system, the circuit comprising: a circuit configured to perform autonomous localization and mapping with a plurality of particles, wherein a particle includes a device pose and a map, wherein the map includes at least one landmark; anda circuit configured to calculate an updated device pose estimate for a particle, wherein the technique used to calculate the updated device pose estimate is selected according to the type associated with the particle, wherein the circuit configured to calculate the updated device pose estimate is further configured to calculate the updated device pose for a primary particle based at least in part on data from a dead reckoning sensor and is further configured to calculate the update device pose estimate for a dual particle based at least in part on data from a visual sensor. 11. The circuit as defined in claim 10, wherein the circuit configured to calculate the updated device pose estimate is further configured to calculate the updated device pose estimate for a particle of primary type based at least in part on data from a first sensor and is further configured to calculate the updated device pose estimate for a particle of dual type based at least in part on data from a second sensor, wherein the second sensor is different from the first sensor. 12. The circuit as defined in claim 10, further comprising a circuit configured to resample selected particles from the plurality of particles. 13. The circuit as defined in claim 10, wherein the circuit is embodied in a robot for navigation of the robot. 14. A method of localizing a mobile device in a multiple-particle autonomous localization and mapping system, using an electronic device, the method comprising: performing, using the electronic device, autonomous localization and mapping with a plurality of particles, wherein a particle includes a device pose and a map, wherein the map includes at least one landmark;calculating, using the electronic device, an updated device pose estimate for a particle, wherein the technique used to calculate the updated device pose estimate is selected according to the type associated with the particle;wherein calculating the updated device pose estimate comprises: using a prior pose estimate and dead reckoning sensor data to compute a new pose for particles of primary type based on the change in pose estimated from the dead reckoning sensor data, using the electronic device;receiving a visually-measured relative pose to the landmark, wherein the landmark has been matched using visual features from a visual sensor coupled to the mobile device, wherein the relative pose corresponds to a visually-measured difference in pose between a landmark pose and a pose corresponding to the visual observation; andusing the landmark pose estimate and the visually-measured relative pose to compute the new pose estimate for particles of dual type. 15. The method as defined in claim 14, wherein the technique used to calculate the updated device pose estimate for particles of primary type further comprises: using the prior pose estimate, the dead reckoning sensor data, and simulated random noise to compute the new device pose estimate termed perturbed predicted device pose;using the perturbed predicted device pose and a visually-measured pose of the device relative to the landmark to compute a hypothetical landmark pose;computing an importance factor for the particle, wherein the importance factor is based at least in part on an uncertainty measure and a comparison between the calculated hypothetical landmark pose and a prior landmark pose estimate; andusing the perturbed predicted pose with the importance factor as the updated device pose. 16. The method as defined in claim 15, wherein the simulated random noise exhibits an uncertainty measure for the dead reckoning sensor data. 17. The method as defined in claim 14, wherein the technique used to calculate the updated device pose for the dual particle type further comprises: using the landmark pose estimate corresponding to the landmark and the visually-measured relative pose to compute a hypothetical device pose;perturbing the hypothetical device pose with simulated random noise;computing an importance factor for the particle, wherein the importance factor is based at least in part on an uncertainty measure and a comparison between the hypothetical device pose and a predicted device pose from a prior pose estimate and the dead reckoning sensor data; andusing the hypothetical device pose with the importance factor as the updated device pose. 18. The method as defined in claim 17, wherein the simulated random noise exhibits an uncertainty measure estimated for a visual sensor.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (64)
Lanckton Arnold H. (Roma NY) More Randall K. (Manlius NY), Advanced terrain mapping system.
Steffens Johannes Bernhard ; Elagin Egor Valerievich ; Nocera Luciano Pasquale Agostino ; Maurer Thomas ; Neven Hartmut, Face recognition from video images.
Eric Richard Bartsch ; Charles William Fisher ; Paul Amaat France ; James Frederick Kirkpatrick ; Gary Gordon Heaton ; Thomas Charles Hortel ; Arseni Velerevich Radomyselski ; James Randy Stig, Home cleaning robot.
Gorr Russell E. ; Hancock Thomas R. ; Judd J. Stephen ; Lin Long-Ji ; Novak Carol L. ; Rickard ; Jr. Scott T., Method and apparatus for automatically tracking the location of vehicles.
Tuck Alan,GBX ; Brayson Gary,GBX ; Ignagni Mario B. ; Touchberry Alan B. ; Anderson Donald William,GBX ; Glen Stephen James,GBX ; Gilman James Michael Alexander,GBX, Method and apparatus for determining location of characteristics of a pipeline.
Shimano,Mihoko; Nagao,Kenji; Akimoto,Toshiaki; Naruoka,Tomonobu, Method and apparatus for object recognition using a plurality of cameras and databases.
Caminiti, Lorenzo; Goncalves, Luis; Di Bernardo, Enrico; Moursund, Carter, Method and system for automatically determining lines of sight between nodes.
McGee H. Dean (Rochester Hills MI) Krause Kenneth W. (Rochester MI) Coldren Bruce E. (Troy MI), Method and system for automatically determining the position and orientation of an object in 3-D space.
Asaka Shunichi (Sagamihara JPX) Echigo Tomio (Yokohama JPX) Hazeki Shinichiro (Kawasaki JPX) Ishikawa Shigeki (Tokyo JPX), Method and system for maneuvering a mobile robot.
Hanna Keith J. (Princeton NJ) Kumar Rakesh (Dayton NJ), Method for estimating the location of an image target region from tracked multiple image landmark regions.
Bauer Rudolf (Neubiberg DEX), Method for producing a cellularly structured environment map of a self-propelled, mobile unit that orients itself in the.
McTamaney Louis S. (Cupertino CA) Wong Yue M. (Saratoga CA) Chandra Rangasami S. (Pleasanton CA) Walker Robert A. (Sunnyvale CA) Lastra Jorge E. (San Jose CA) Wagner Paul A. (Cambridge MA) Sharma Uma, Multi-purpose autonomous vehicle with path plotting.
Everett ; Jr. Hobart R. (San Diego CA) Gilbreath Gary A. (San Diego CA) Laird Robin T. (San Diego CA), Navigational control system for an autonomous vehicle.
Cherveny, Kevin; Crane, Aaron; Kaplan, Lawrence M.; Jasper, John; Shields, Russell, System and method for updating, enhancing or refining a geographic database using feedback.
Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo; Karlsson,L. Niklas, Systems and methods for computing a relative pose for global localization in a visual simultaneous localization and mapping system.
Goncalves, Luis Filipe Domingues; Karlsson, L. Niklas; Pirjanian, Paolo; Di Bernardo, Enrico, Systems and methods for controlling a density of visual landmarks in a visual simultaneous localization and mapping system.
Goncalves,Luis Filipe Domingues; Karlsson,L. Niklas; Pirjanian,Paolo; Di Bernardo,Enrico, Systems and methods for controlling a density of visual landmarks in a visual simultaneous localization and mapping system.
Karlsson,L. Niklas; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo, Systems and methods for correction of drift via global localization with a visual landmark.
Goncalves,Luis Filipe Domingues; Karlsson,L. Niklas; Pirjanian,Paolo; Di Bernardo,Enrico, Systems and methods for filtering potentially unreliable visual data for visual simultaneous localization and mapping.
Karlsson,L. Niklas; Pirjanian,Paolo; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico, Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques.
Domingues Goncalves, Luis Filipe; Di Bernardo, Enrico; Pirjanian, Paolo; Karlsson, L. Niklas, Systems and methods for landmark generation for visual simultaneous localization and mapping.
Karlsson, L. Nicklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Bernardo, Enrico Di, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Karlsson, L. Niklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Karlsson, L. Niklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Karlsson,L. Niklas; Pirjanian,Paolo; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Evans ; Jr. John M. (Brookfield CT) Weiman Carl F. R. (Westport CT) King Steven J. (Woodbury CT), Visual navigation and obstacle avoidance structured light system.
Evans ; Jr. John M. (Brookfield CT) Weiman Carl F. R. (Westport CT) King Steven J. (Woodbury CT), Visual navigation and obstacle avoidance structured light system.
Karlsson, L. Niklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Karlsson, L. Niklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.