Continuous updating of plan for robotic object manipulation based on received sensor data
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
B25J-013/08
B25J-009/16
G06T-017/00
B25J-019/02
B65G-047/46
B65G-047/50
G06K-009/00
G06T-007/00
G01B-011/25
G06K-009/46
G06K-009/52
G06T-007/60
H04N-005/33
H04N-013/02
B25J-009/00
B25J-005/00
B65G-041/00
B65G-061/00
B65H-067/06
H04N-013/00
출원번호
US-0964724
(2015-12-10)
등록번호
US-9630321
(2017-04-25)
발명자
/ 주소
Bradski, Gary
Konolige, Kurt
Rublee, Ethan
Straszheim, Troy
Strasdat, Hauke
Hinterstoisser, Stefan
출원인 / 주소
Industrial Perception, Inc.
대리인 / 주소
McDonnell Boehnen Hulbert & Berghoff LLP
인용정보
피인용 횟수 :
0인용 특허 :
26
초록▼
Example systems and methods allow for dynamic updating of a plan to move objects using a robotic device. One example method includes determining a virtual environment by one or more processors based on sensor data received from one or more sensors, the virtual environment representing a physical env
Example systems and methods allow for dynamic updating of a plan to move objects using a robotic device. One example method includes determining a virtual environment by one or more processors based on sensor data received from one or more sensors, the virtual environment representing a physical environment containing a plurality of physical objects, developing a plan, based on the virtual environment, to cause a robotic manipulator to move one or more of the physical objects in the physical environment, causing the robotic manipulator to perform a first action according to the plan, receiving updated sensor data from the one or more sensors after the robotic manipulator performs the first action, modifying the virtual environment based on the updated sensor data, determining one or more modifications to the plan based on the modified virtual environment, and causing the robotic manipulator to perform a second action according to the modified plan.
대표청구항▼
1. A method comprising: identifying, by a control system, an object from a plurality of objects within an environment of a robotic manipulator;causing, by the control system, the robotic manipulator to move the identified object to a different location within the environment;after the robotic manipu
1. A method comprising: identifying, by a control system, an object from a plurality of objects within an environment of a robotic manipulator;causing, by the control system, the robotic manipulator to move the identified object to a different location within the environment;after the robotic manipulator moves the identified object to the different location, causing, by the control system, the robotic manipulator to perform a scan of an area of the environment vacated by the identified object by causing the robotic manipulator to change position while receiving sensor data from one or more sensors on the robotic manipulator, wherein the sensor data is indicative of at least one other object previously obscured by the identified object;identifying, by the control system, based on the sensor data, a second object from the plurality of objects within the environment; andcausing, by the control system, the robotic manipulator to move the second object. 2. The method of claim 1, wherein the second object is one of the at least one other object previously obscured by the identified object. 3. The method of claim 1, wherein causing the robotic manipulator to perform a scan of the area of the environment vacated by the identified object comprises causing the robotic manipulator to move into the area vacated by the identified object to receive sensor data from a point of view of the area vacated by the identified object. 4. The method of claim 1, further comprising causing a movable cart on which the robotic manipulator is mounted to move into the area of the environment vacated by the identified object in order to position the robotic manipulator to move the second object. 5. The method of claim 1, further comprising causing a movable cart on which the robotic manipulator is mounted to move into the area of the environment vacated by the identified object in order to perform an additional scan of another area of the environment. 6. The method of claim 1, further comprising: determining a coarse representation of a specific area of the environment;determining, based on the coarse representation of the specific area of the environment, a hypothesis indicating a possible shape of a particular object within the specific area of the environment; andcausing the robotic manipulator to perform one or more additional scans of the particular object in order to verify the determined hypothesis. 7. The method of claim 1, wherein the sensor data indicative of the at least one other object previously obscured by the identified object comprises information indicative of a shape of the at least one other object previously obscured by the identified object. 8. The method of claim 1, wherein the robotic manipulator comprises a multi-object gripper capable of simultaneously picking up at least two objects from the plurality of objects, the method further comprising causing the robotic manipulator to move one or more additional objects along with the identified object to the different location within the environment. 9. The method of claim 1, wherein causing the robotic manipulator to move the identified object to the different location within the environment comprises causing the robotic manipulator to move the identified object onto a conveyor belt. 10. The method of claim 1, further comprising determining a segmentation of at least one of the plurality of objects within the environment based on the sensor data received from the one or more sensors, and wherein identifying the second object is further based on the determined segmentation of the at least one of the plurality of objects within the environment. 11. The method of claim 10, further comprising causing the robotic manipulator to perturb at least one of the plurality of objects within the environment to determine the segmentation of the at least one of the plurality of objects within the environment. 12. The method of claim 1, further comprising: receiving sensor data from one or more additional sensors indicative of whether the identified object has been successfully picked up and moved by the robotic manipulator; andwhen the sensor data from the one or more additional sensors indicates that the identified object has not been successfully picked up and moved by the robotic manipulator, causing the robotic manipulator to perform an additional scan of the environment to determine a location of the identified object. 13. The method of claim 1, further comprising: after moving the identified object to the different location, determining, based on sensor data from one or more additional sensors, that another object is present in the area of the environment vacated by the identified object; andcausing the robotic manipulator to perform the scan of the area of the environment vacated by the identified object in response to determining that another object is present in the area of the environment vacated by the identified object. 14. A system comprising: a robotic manipulator;at least one sensor on the robotic manipulator; anda control system configured to: identify an object from a plurality of objects within an environment of the robotic manipulator;cause the robotic manipulator to move the identified object to a different location within the environment;after the robotic manipulator moves the identified object to the different location, cause the robotic manipulator to perform a scan of an area of the environment vacated by the identified object by causing the robotic manipulator to change position while receiving sensor data from the at least one sensor on the robotic manipulator, wherein the sensor data is indicative of at least one other object previously obscured by the identified object;identify, based on the sensor data, a second object from the plurality of objects within the environment; andcause the robotic manipulator to move the second object. 15. The system of claim 14, wherein the control system is configured to cause the robotic manipulator to perform a scan of the area of the environment vacated by the identified object by causing the robotic manipulator to move into the area vacated by the identified object to receive sensor data from a point of view of the area vacated by the identified object. 16. The system of claim 14, wherein the control system is further configured to cause a movable cart on which the robotic manipulator is mounted to move into the area of the environment vacated by the identified object in order to perform an additional scan of another area of the environment. 17. The system of claim 14, wherein the control system is further configured to: determine a coarse representation of a specific area of the environment;determine, based on the coarse representation of the specific area of the environment, a hypothesis indicating a possible shape of a particular object within the specific area of the environment; andcause the robotic manipulator to perform one or more additional scans of the particular object in order to verify the determined hypothesis. 18. The system of claim 14, wherein the sensor data indicative of the at least one other object previously obscured by the identified object comprises information indicative of a shape of the at least one other object previously obscured by the identified object. 19. A non-transitory computer readable medium having stored therein instructions that, when executed by a computing system, cause the computing system to perform functions comprising: identifying an object from a plurality of objects within an environment of a robotic manipulator;causing the robotic manipulator to move the identified object to a different location within the environment;after the robotic manipulator moves the identified object to the different location, causing the robotic manipulator to perform a scan of an area of the environment vacated by the identified object by causing the robotic manipulator to change position while receiving sensor data from one or more sensors on the robotic manipulator, wherein the sensor data is indicative of at least one other object previously obscured by the identified object;identifying, based on the sensor data, a second object from the plurality of objects within the environment; andcausing the robotic manipulator to move the second object. 20. The non-transitory computer readable medium of claim 19, wherein the control system is configured to cause the robotic manipulator to perform a scan of the area of the environment vacated by the identified object by causing the robotic manipulator to move into the area vacated by the identified object to receive sensor data from a point of view of the area vacated by the identified object.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (26)
Criswell, Tim; Fisher, Andrew; Aurora, Deepak, Automatic case loader and method for use of same.
Red Walter E. (Provo UT) Davies Brady R. (Orem UT) Wang Xuguang (Provo UT) Turner Edgar R. (Provo UT), Device and method for correction of robot inaccuracy.
Zhao, Wenyi; Hasser, Christopher J J; Nowlin, William C.; Hoffman, Brian D., Methods and systems for robotic instrument tool tracking with adaptive fusion of kinematics information and image information.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.