Methods and apparatus to facilitate operations in image based systems
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
출원번호
US-0249658
(2008-10-10)
등록번호
US-8559699
(2013-10-15)
발명자
/ 주소
Boca, Remus
출원인 / 주소
RoboticVISIONTech LLC
대리인 / 주소
Seed IP Law Group PLLC
인용정보
피인용 횟수 :
26인용 특허 :
123
초록▼
Vision based systems may select actions based on analysis of images to redistribute objects. Actions may include action type, action axis and/or action direction. Analysis may determine whether an object is accessible by a robot, whether an upper surface of a collection of objects meet a defined cri
Vision based systems may select actions based on analysis of images to redistribute objects. Actions may include action type, action axis and/or action direction. Analysis may determine whether an object is accessible by a robot, whether an upper surface of a collection of objects meet a defined criteria and/or whether clusters of objects preclude access.
대표청구항▼
1. A method of operating an image based autonomous object repositioning system, the method comprising: acquiring data indicative of an image of an area in which a plurality of objects may reside using at least one image sensor;analyzing the acquired image data for data indicative of a respective rep
1. A method of operating an image based autonomous object repositioning system, the method comprising: acquiring data indicative of an image of an area in which a plurality of objects may reside using at least one image sensor;analyzing the acquired image data for data indicative of a respective representation of any of the objects using at least one processor communicably coupled to the at least one image sensor;based on the analysis of the acquired image data, determining by the at least one processor a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions to cause the physical movement of the objects in the area, without physically picking any of the objects, the determining the preferred non-object picking physical output action based at least in part on a uniformity of height of the plurality of objects over the area;based on the analysis of the acquired image data, determining by the at least one processor a preferred axis or direction of the preferred non-object picking physical output action in which to tilt, shake, sweep or blow the objects in the area to expose at least one pickable object in the plurality of objects; andcommunicatively transmitting by the at least one processor at least one signal to one or more outputs capable of physically displacing at least a portion of the objects in the area to cause the determined preferred non-object picking physical output action to occur along the preferred axis or direction. 2. The method of claim 1, further comprising: based on the analysis of the acquired image data, determining by the at least one processor whether to cause movement of the objects in the area. 3. The method of claim 2 wherein determining by the at least one processor whether to cause movement of the objects in the area includes determining by the at least one processor whether any of the objects are currently positioned for engagement by a robot member without causing the movement. 4. The method of claim 2 wherein determining by the at least one processor whether to cause movement of the objects in the area includes determining whether an upper surface level of the objects is within a defined threshold across at least a portion of the area. 5. The method of claim 2 wherein determining by the at least one processor whether to cause movement of the objects in the area includes determining by the at least one processor whether data indicative of at least one object appears in the acquired image data and data indicative of at least one object in the acquired image data indicates that a robot member is capable of physically engaging the at least one object. 6. The method of claim 1 wherein determining by the at least one processor a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions to cause the physical movement of the objects in the area without physically picking any of the objects includes determining by the at least one processor which of the different possible non-object picking physical output actions has a highest likelihood of exposing at least one of the objects. 7. The method of claim 1 wherein determining a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions to cause the physical movement of the objects in the area without physically picking any of the objects includes generating by the at least one processor data indicative of a representation of a current upper surface level of the objects from the acquired image data, and determining at least one movement calculated to move the current upper surface level toward a desired upper surface level. 8. The method of claim 1 wherein determining a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions to cause the physical movement the objects in the area without physically picking any of the objects includes determining which of the different possible non-object picking physical output actions has a highest likelihood of distributing the objects to achieve a more uniform upper surface level. 9. The method of claim 1 wherein determining a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions to cause the physical movement of the objects in the area without physically picking any of the objects includes determining a preferred action based at least in part on at least one of a geometry of a container that carries the objects, a size of the objects or a geometry of the objects. 10. The method of claim 1 wherein analyzing the acquired image data for data indicative of a respective representation of any of the objects includes identifying a cluster of the objects and determining using the at least one processor a preferred non-object picking physical output action from a plurality of different possible non-object picking physical output actions that cause movement of the objects in the area without physically picking any of the objects includes determining an action to disperse the cluster of the objects. 11. The method of claim 1 wherein communicatively transmitting at least one signal to one or more outputs capable of physically moving the objects to cause the determined preferred non-object picking physical output action to occur along the preferred axis or direction includes transmitting the at least one signal to at least one of a robotic controller that controls a robotic arm or at least one actuator coupled to a move a table or container on which the objects are carried. 12. The method of claim 1 wherein analyzing the acquired image data for data indicative of a respective representation of any of the objects includes performing at least one of a feature recognition, a registration or a pose estimation for at least one of the objects based on the respective representation of the object in the acquired image. 13. An image based system, comprising: at least one image acquisition device that acquires data indicative of an image of an area in which a plurality of objects may reside;at least one processor; andat least one processor-readable storage medium that stores processor executable instructions that cause the processor to: analyze the acquired image data for data indicative of a respective representation of any of the objects;based on the analysis of the acquired image data, determine a preferred action from a plurality of different possible non-object picking actions that cause movement of the objects in the area, if any, without physically picking any of the objects, the determining the preferred action based at least in part on a uniformity of height of the plurality of objects over the area;based on the analysis of the acquired image data, determine a preferred axis or direction in which to tilt, shake, sweep or blow the objects to expose at least one pickable object in the plurality of objects; andtransmit at least one signal to cause the determined preferred action to occur. 14. The image based system of claim 13, further comprising: at least one robot selectively positionable to physically pick at least one of the objects. 15. The image based system of claim 14 wherein the at least one robot is positionable to cause movement of the objects in accordance with the at least one signal. 16. The image based system of claim 14, further comprising: a support structure on which the objects are carried; andat least one actuator coupled to physically move the support structure in accordance with the at least one signal. 17. A method of operating an image based autonomous object repositioning system, the method comprising: repeatedly acquiring data indicative of a number of images of an area in which a number of objects may reside using at least one image sensor;identifying one or more clusters of the objects in the acquired image data using at least one processor communicably coupled to the at least one image sensor;selecting by the at least one processor a preferred non-object picking physical output action to disperse the one or more clusters of the objects from a plurality of different possible non-object picking physical output actions without physically removing any of the objects or any of the one or more objects from the area or displacing any of the objects in the area, based at least in part on a characteristic of the identified one or more clusters and based at least in part on a uniformity of height of the number of objects over the area;selecting by the at least one processor a preferred axis or direction in which to tilt, shake, sweep or blow the one or more clusters of objects to adjust the upper surface level of the one or more objects toward a defined upper surface level; andproviding a signal that causes the selected action. 18. The method of claim 17 wherein selecting by the at least one processor a preferred non-object picking physical output action to disperse the one or more clusters based at least in part on a characteristic of the identified one or more clusters includes generating data indicative of a representation of an upper surface level of the one or more clusters of objects from the acquired image data by the at least one processor, and determining by the at least one processor at least one direction or axis of movement to adjust the upper surface level of the one or more clusters toward a defined upper surface level. 19. The method of claim 17, further comprising: engaging at least one of the objects with a robotic member; andperforming the desired action while the robotic member engages at least one of the objects. 20. The method of claim 17 wherein selecting by the at least one processor a preferred non-object picking physical output action to disperse the one or more clusters based at least in part on a characteristic of the identified one or more clusters includes determining by the at least one processor at least one direction or axis of movement based at least in part on at least one representation of at least one surface of a container or a support structure that carries the objects. 21. An image based system, comprising: at least one image acquisition device that repeatedly acquires data indicative of an image of an area in which a plurality of objects may reside;at least one processor; andat least one processor-readable storage medium that stores processor executable instructions that cause the processor to: identify one or more clusters of the objects in the acquired image data;select a preferred non-object picking physical output action to disperse the one or more clusters of the objects from a plurality of different possible non-object picking physical output actions that do not physically remove any of the objects from the area, based at least in part on a characteristic of the identified one or more clusters and based at least in part on a uniformity of height of the plurality of objects over the area;select a preferred axis or direction in which to tilt, shake, sweep or blow the one or more clusters of objects to disperse the one or more clusters of the objects based at least in part on a characteristic of the identified one or more clusters; andprovide a signal that causes the selected action. 22. The image based system of claim 21 wherein the instructions cause the processor to select a preferred non-object picking physical output action to disperse the one or more clusters based at least in part on a characteristic of the identified one or more clusters by generating a representation of an upper surface level of the one or more clusters of objects from the acquired image data, and determining at least one direction or axis of movement to adjust the upper surface level of the one or more clusters toward a defined upper surface level. 23. The image based system of claim 21, further comprising: at least one robot selectively positionable to physically remove at least one of the objects from the area. 24. The image based system of claim 21 wherein the at least one robot is selectively positionable to cause movement of a support structure on which the one or more objects are carried, in accordance with the at least one signal. 25. The image based system of claim 21, further comprising: a support structure on which the objects are carried; andat least one actuator coupled to physically move the support structure in accordance with the at least one signal.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (123)
Gu, Haisong; Nakahara, Tomoharu; Araki, Hidekazu; Fujii, Hiroyuki, 3-dimensional object recognition method and bin-picking system using the method.
Dalziel Marie R. (London GB2) Wiseman Neil E. (Cambridge GB2) Oliver Martin A. (Beckington GB2) Forrest Andrew K. (London GB2) Clocksin William F. (Girton GB2) King Tony R. (Cambridge GB2) Wipfel Rob, Adaptive vision-based controller.
Kelley Robert B. (Kingston RI) Birk John R. (Peace Dale RI) Duncan Dana L. (Wakefield RI) Tella Richard P. (Ashaway RI) Wilson Laurie J. (Ashaway RI), Apparatus and method to enable a robot with vision to acquire, orient and transport workpieces.
Cullen W. Paul (Scotia NY) Petronis Thomas J. (Clifton Park NY) Annis Clifford C. (Schenectady NY) Ross E. M. (King of Prussia PA), Automated exchangeable parts feeding system.
Gunter D. Niemeyer ; Gary S. Guthart ; William C. Nowlin ; Nitish Swarup ; Gregory K. Toth ; Robert G. Younge, Camera referenced control in a minimally invasive surgical apparatus.
Shimura,Akihiro, Communication control method, communication system, print control apparatus, printing apparatus, host apparatus, peripheral apparatus, and storage medium.
Callari, Francesco; Zwern, Arthur; Fejes, Sandor, Generating 3D models by combining models from a video-based technique and data from a structured light technique.
Eibert Max (Friedrichshafen DEX) Hopfmuller Harald (Markdorf DEX) Katzenbeisser Rolf (Ravensburg DEX) Schaefer Christoph (Friedrichshafen DEX), Intelligent range image camera for object measurement.
Wallack Aaron S. ; Michael David J., Machine vision methods using feedback to determine calibration locations of multiple cameras that image a common object.
Tomasi,Carlo; Gokturk,Salih Burak, Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices.
Hohn Richard Edward (Cincinnati OH), Method and apparatus for compensating for unprogrammed changes in relative position between a machine and workpiece.
Pryor Timothy R.,CAX ; Hockley Bernard,CAX ; Liptay-Wagner Nick,CAX ; Hageniers Omer L.,CAX ; Pastorius W. J.,CAX, Method and apparatus for electro-optically determining the dimension, location and attitude of objects.
Abitbol Marc,ILX ; Maillart Jean-Luc,FRX, Method and apparatus for identifying the position in three dimensions of a movable object such as a sensor or a tool car.
Sakakibara Shinsuke (Komae JPX) Hiraizumi Mitsuo (Hachioji JPX), Method and apparatus for measuring three-dimensional position and orientation of an object using light projection.
Pinkney Harold F. L. (Ottawa CAX) Perratt Charles I. (Ottawa CAX), Method and apparatus of determining the center of area or centroid of a geometrical area of unspecified shape lying in a.
Carpenter Kurtis R. (Greenwood City SC) Schnelle Joseph W. (Greenwood City SC), Method and means for path offsets memorization and recall in a manipulator.
McGee H. Dean (Rochester Hills MI) Krause Kenneth W. (Rochester MI) Coldren Bruce E. (Troy MI), Method and system for automatically determining the position and orientation of an object in 3-D space.
Arnoul, Patrick; Guerin, Jean-Pierre; Letellier, Laurent; Viala, marc, Method for calibrating the initial position and the orientation of one or several mobile cameras.
Sawhney,Harpreet Singh; Kumar,Rakesh; Hsu,Steve; Samarasekera,Supun, Method of pose estimation and model refinement for video representation of a three dimensional scene.
Skaar Steven B. (Granger IN) Brockman William H. (Ames IA) Miller Richard K. (Ames IA) Yalda-Mooshabod Issac (Ames IA), Nonholonomic camera space manipulation.
Peurach Thomas M. ; Whalen Peggy ; Haanpaa Douglas ; Whalen Mike ; Jacobus Charles J., Pose determination and tracking by matching 3D objects to a 2D sensor.
Nowlin,William C.; Guthart,Gary S.; Salisbury, Jr.,J. Kenneth; Niemeyer,Gunter D., Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery.
Lemelson, Dorothy; Pedersen, Robert D.; Blake, Tracy D., Robotic manufacturing and assembly with relative radio positioning using radio based location determination.
Krause, Kenneth W.; DeMotte, Donald D.; Dinsmoor, Claude A.; Evans, Judy A.; Nowak, Glenn F.; Ross, Gerald A.; Rutledge, Gary J.; Slabe, Charles F., Robotic system with teach pendant.
Chini Stefano (San Lazzaro di Savena ITX) Di Stefano Giuseppe (Ferrara ITX) Neri Armando (Bologna ITX), System and method for enabling a robotic arm to grip an object.
Birk John R. (Peacedale RI) Kelley Robert B. (Kingston RI) Seres David A. (Newark DE), System for visually determining position in space and/or orientation in space and apparatus employing same.
Larsen, Paul A.; Rawlings, James B.; Ferrier, Nicola J., Systems and methods for automatically determining 3-dimensional object information and for controlling a process based on automatically-determined 3-dimensional object information.
Altschuler Bruce R. (123 Thornell San Antonio TX 78235) Taboada John (12530 Elm Country La. San Antonio TX 78230) Altschuler Martin D. (228 Ranch Trail Amherst NY 14221), Topographic comparator.
Bradski, Gary; Konolige, Kurt; Rublee, Ethan; Straszheim, Troy; Strasdat, Hauke; Hinterstoisser, Stefan, Continuous updating of plan for robotic object manipulation based on received sensor data.
Bradski, Gary; Konolige, Kurt; Rublee, Ethan; Straszheim, Troy; Strasdat, Hauke; Hinterstoisser, Stefan, Continuous updating of plan for robotic object manipulation based on received sensor data.
Konolige, Kurt; Rublee, Ethan; Hinterstoisser, Stefan; Straszheim, Troy; Bradski, Gary; Strasdat, Hauke, Detection and reconstruction of an environment to facilitate robotic interaction with the environment.
Konolige, Kurt; Rublee, Ethan; Hinterstoisser, Stefan; Straszheim, Troy; Bradski, Gary; Strasdat, Hauke Malte, Detection and reconstruction of an environment to facilitate robotic interaction with the environment.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.