Telepresence based inventory pick and place operations through robotic arms affixed to each row of a shelf
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-019/00
B25J-003/00
B65G-001/137
B25J-013/00
출원번호
US-0726458
(2015-05-30)
등록번호
US-9327397
(2016-05-03)
발명자
/ 주소
Williams, Jeff
Bhaskaran, Ravi
Martin, Charlie
출원인 / 주소
CODESHELF
대리인 / 주소
Raj Abhyanker, P.C.
인용정보
피인용 횟수 :
9인용 특허 :
197
초록▼
Disclosed are a system and/or a method of telepresence based inventory pick and place operations through actuator controlled robotic arms affixed to each row of a shelf. A method includes mounting a robotic arm at an end of a row of a shelf of inventory on a set of rails affixed to the row of a shel
Disclosed are a system and/or a method of telepresence based inventory pick and place operations through actuator controlled robotic arms affixed to each row of a shelf. A method includes mounting a robotic arm at an end of a row of a shelf of inventory on a set of rails affixed to the row of a shelf. The robotic arm is permitted to move horizontally along the row of the shelf. The robotic arm is repositioned along the three axes using a set of actuators. A haptic motion of a human user is mirrored that is remotely using a positioning device (e.g., human may feel the feedback of the remote arm as it touches the objects). An item is placed on a counting platform in front of the robotic arm. The items are placed automatically in the designated location down through a transport means when a pick operation is completed.
대표청구항▼
1. A method comprising: mounting a robotic arm at an end of a row of a shelf of inventory on a set of rails affixed to the row of a shelf;permitting the robotic arm to move horizontally along the three axes along the row of the shelf;repositioning the robotic arm along any one of the three axes usin
1. A method comprising: mounting a robotic arm at an end of a row of a shelf of inventory on a set of rails affixed to the row of a shelf;permitting the robotic arm to move horizontally along the three axes along the row of the shelf;repositioning the robotic arm along any one of the three axes using a set of actuators, wherein each of the set of actuators are any of a backdrivable, an electrosensing, an electric, a magnetic, a hydraulic, and pneumatic actuators;contemporaneously mirroring a haptic motion of a human user that is remotely using a positioning device that is communicatively coupled with the robotic arm through an Internet network;automatic repositioning of the robotic arm along any one of the three axes using the set of actuators responsive to the haptic motion of the human user remotely using the positioning device;placing an item of inventory on a counting platform in front of the robotic arm using an end effector of the robotic arm based on an action of a human that views the item of inventory on the shelf through a camera affixed to the robotic arm which is communicatively coupled with a computing device associated with the human user operating the positioning device;moving the item of inventory to a designated location adjacent to the robotic arm using the end effector; andautomatically placing the items in the designated location down through a transport means adjacent to one end of the shelf when a pick operation is completed, wherein the designated location is at least one of a tote and a storage bin, andwherein the transport means is at least one of a tube and a lift platform to bring the tote from the designated location to a desired location of the shelf. 2. The method of claim 1, wherein the item of inventory is placed on a platform having an angled surface such that the storage bin in which the item of inventory is placed is angled upward and does not fall off the shelf when placed on the counting platform, andwherein the item of inventory is validated based on a weight of an item on the counting platform. 3. The method of claim 1, wherein a telepresence application is used to provide the positioning device control over the robotic arm remotely through the Internet network. 4. The method of claim 3, wherein the shelf includes a plurality of rows of the shelf and a plurality of robotic arms, wherein each of the rows of the shelf includes one or more robotic arms that horizontally traverses a particular row in which it is affixed. 5. The method of claim 4, wherein each of the robotic arms coordinates with a warehouse management server to automatically direct the human user of the telepresence application to each location on the shelf associated with the items needed to be fulfilled in an e-commerce order. 6. The method of claim 4, wherein each item of an e-commerce order is automatically deposited through respective ones of the plurality of robotic arms into a packing box on a conveyer belt of a distribution center when the items are deposited down through the tube adjacent to the one end of the shelf. 7. The method of claim 6, wherein the telepresence application detects that the human has completed a movement of the items onto the counting platform and directs the human user to a next one of a plurality of the robotic arms positioned in front of the storage bin where a selection is needed. 8. The method of claim 7, wherein a neural network automatically monitors a behavior of the human user and continuously learns how to improve the pick and place of a particular type of item from the shelf such that, over time, a control program learns how to control the robotic arm to automatically select the items onto the counting platform without a human intervention or a human haptic control. 9. The method of claim 1, wherein the end effector of the robotic arm is at least one of a supple rubber end point, a gripping arm, a sticky polymer end, an impactive end effector, an ingressive end effector, an astrictive end effector, and a contigutive end effector. 10. The method of claim 1, wherein a robot has two robotic arms with actuator control to permit the human user to grab and lift the items. 11. The method of claim 1, wherein the robotic arm can safely operate around the human operators in a distribution center by slowly coming to a stop and not having to stop abruptly when an adjacent object is detected which is likely to obstruct a motion of the robotic arm through compliance to prevent users and operators being injured. 12. A method of a telepresence application comprising: determining that a remote positioning device associated with a human user is communicatively coupled with the telepresence application;validating the human user as an authorized user of the telepresence application using a processor and a memory of a warehouse management server on which the telepresence application operates;automatically allocating a robotic arm in a distribution center that is assigned to the human user based on an e-commerce order;contemporaneously repositioning the robotic arm along any one of the three axes using a set of actuators based on a mirrored haptic motion of the human user that is remotely using a positioning device that is communicatively coupled with the robotic arm through an Internet network. 13. The method of the telepresence application of claim 12 further comprising: providing a view of an item of inventory directly in front of the robotic arm to the human user who is remotely controlling the robotic arm through the positioning device,wherein the robotic arm to place the item of inventory on a counting platform in front of the robotic arm using an end effector of the robotic arm based on an action of a human that views the item of inventory on a shelf through a camera affixed to the robotic arm which is communicatively coupled with a computing device associated with the human user operating the positioning device based on a place command from the telepresence application;wherein the robotic arm to validate the item of inventory based on a weight of the item on the counting platform based on a validate command from the telepresence application;wherein the robotic arm to move the item of inventory in a location adjacent to the robotic arm using the end effector based on a move command from the telepresence application; andmoving the items at the location down through a tube adjacent to one end of the shelf when a pick operation is completed based on a complete command from the telepresence application. 14. The method of claim 12, wherein an item of inventory is placed on a platform having an angled surface such that a storage bin in which the item of inventory is placed is angled upward and does not fall off a shelf when placed on a counting platform. 15. The method of claim 12, wherein the telepresence application is used to provide the positioning device control over the robotic arm remotely through the Internet network. 16. The method of claim 14: wherein the shelf includes a plurality of rows of the shelf and a plurality of robotic arms, wherein each of the rows of the shelf includes a different robotic arm, andwherein each of the rows of the shelf includes one or more different robotic arms that horizontally traverses a particular row in which it is affixed. 17. The method of claim 15, wherein each of the robotic arms to coordinate with the warehouse management server to automatically direct the human user of the telepresence application to each location on a shelf associated with the items needed to be fulfilled in the e-commerce order. 18. The method of claim 16, wherein each item of the e-commerce order is automatically deposited through respective ones the plurality of robotic arms into a packing box on a conveyer belt of the distribution center when the items are deposited down through a tube adjacent to one end of the shelf. 19. The method of claim 17, wherein the telepresence application detects that a human has completed a movement of the items onto a counting platform and directs the human user to a next one of a plurality of the robotic arms positioned in front of a storage bin where a selection is needed. 20. The method of claim 18, wherein a neural network to automatically monitor a behavior of the human user and to continuously learn how to better pick and place a particular type of item from the shelf such that, over time, the robotic arm is able to automatically pick the item and place the item at a location without requiring mirroring of a haptic motion of the human user that is remotely using a positioning arm. 21. The method of claim 12: wherein an end effector of the robotic arm is at least one of a supple rubber end point, a gripping arm, a sticky polymer end, an impactive end effector, an ingressive end effector, an astrictive end effector, and a contigutive end effector, andwherein the robotic arm to safely operate around the human operators in the distribution center by slowly coming to a stop and not having to stop abruptly when an adjacent object is detected which is likely to obstruct a motion of the robotic arm. 22. A warehouse system, comprising: a set of robotic arms that are each affixed to the individual rows of shelving in a distribution center to reposition horizontally along the individual rows of shelving along any one of the three axes using a set of actuators;an Internet network;a warehouse management server having a telepresence application coupled with the set of robotic arms through the Internet network to provide a human user remote control over each of a set of the robotic arms through the Internet network;a positioning device coupled with each of the set of robotic arms and the warehouse management server having the telepresence application through the Internet network that is haptically controlled by a human user in a manner such that a haptic motion of the human user of the positioning device is imitated through a mirrored repositioning of the set of robotic arms. 23. The warehouse system of claim 22, wherein an item of inventory is placed on a platform having an angled surface such that a storage bin in which the item of inventory is placed is angled upward and does not fall off a shelf when placed on a counting platform. 24. The warehouse system of claim 22, wherein the telepresence application is used to provide the positioning device control over a robotic arm remotely through the Internet network. 25. The warehouse system of claim 24: wherein a shelf includes a plurality of rows of the shelf and a plurality of robotic arms, wherein each of the rows of the shelf includes a different robotic arm, andwherein each of the rows of the shelf includes one or more different robotic arm that horizontally traverses a particular row in which it is affixed. 26. The warehouse system of claim 25, wherein each of the robotic arms to coordinate with the warehouse management server to automatically direct the human user of the telepresence application to each location on the shelf associated with the items needed to be fulfilled in an e-commerce order. 27. The warehouse system of claim 26, wherein each item of the e-commerce order is automatically deposited through respective ones of the plurality of robotic arms into a packing box on a conveyer belt of the distribution center when the items are deposited down through a tube adjacent to one end of the shelf. 28. The warehouse system of claim 27, wherein the telepresence application detects that a human has completed a movement of the items onto a counting platform and directs the human user to a next one of a plurality of the robotic arms positioned in front of a storage bin where a selection is needed. 29. The warehouse system of claim 28, wherein a neural network to automatically monitor a behavior of the human user and to continuously learn how to better pick and place a particular type of item from the shelf such that, over time, the robotic arm is able to automatically pick the item and place the item at the location without requiring mirroring of the haptic motion of the human user that is remotely using a positioning arm. 30. The warehouse system of claim 22, wherein an end effector of a robotic arm is at least one of a supple rubber end point, a gripping arm, a sticky polymer end, an impactive end effector, an ingressive end effector, an astrictive end effector, and a contigutive end effector, andwherein the robotic arm to safely operate around the human operators in the distribution center by slowly coming to a stop and not having to stop abruptly when an adjacent object is detected which is likely to obstruct a motion of the robotic arm.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (197)
Trowbridge, Robert Scott; Stark, James Alexander; Wong, Clifford, Aerial display system with marionettes articulated and supported by airborne devices.
Turner, Tara Handy; Goldberg, Evan M.; Schnittker, Matthew F.; Longson, Joseph W.; Neuman, Robert M., Apparatus and method for removing ink lines and segmentation of color regions of a 2-D image for converting 2-D images into stereoscopic 3-D images.
Stansfield Thomas J. (Mt. Airy MD) Barbera Anthony J. (Columbia MD) Koogle Dwight R. (Middletown MD) Fitzgerald M. L. (Columbia MD), Article handling system with distributed storage.
Cheung, Carol Carlin; Yamauchi, Brian Masao; Jones, Christopher Vernon; Moseley, Mark Bourne; Singh, Sanjiv; Geyer, Christopher Michael; Grocholsky, Benjamin Peter; Cox, Earl Clyde, Collaborative engagement for target identification and tracking.
Bickel, Bernd; Matusik, Wojciech; Otaduy, Miguel A.; Gross, Markus; Pfister, Hanspeter, Fabrication of materials with desired characteristics from base materials having determined characteristics.
Mountz, Michael C.; Wurman, Peter R.; Wilson, Steven A.; Mallary, Caroline F.; Peng, Zhouzhou; Durham, Joseph W., Filling an order at an inventory pier.
Wurman, Peter R.; D'Andrea, Raffaello; Barbehenn, Michael T.; Hoffman, Andrew Edward; Mountz, Michael Cordell, Generating a path for a mobile drive unit.
Turner, Tara Handy; Goldberg, Evan M.; Schnittker, Matthew F.; Longson, Joseph W.; Neuman, Robert M., Gradient modeling toolkit for sculpting stereoscopic depth models for converting 2-D images into stereoscopic 3-D images.
Kaufman, Donald L.; Inglis, Adrian; Weiland, Thomas J.; Darrow, John E.; Nicholson, A. Lorraine; Jay, Jon R.; Pratt, Jeffrey C., Independent customer service agents.
Maney George A. (Sunnyvale CA) Bonora Anthony C. (Menlo Park CA) Parikh Mihir (San Jose CA) Brain Michael D. (Oakland CA), Intelligent system for processing and storing articles.
Gerpheide George E. (Salt Lake City UT) Anderson B. Craig (Whitefish MT) Hill Linda (Whitefish MT), Inventory and business management system which accounts for the contents of full and partially filled product containers.
Joseph James Salvo ; Patricia Denise Mackenzie ; Janet Sue Bennett ; Heather Ann Relyea ; Thomas Anthony Morelli, II, Inventory management system and method.
Bravman Richard (Smithtown NY) Wang Ynjiun P. (Meyers FL) Toedt ; III D. C. (Houston TX), Inventory management system using coded re-order information.
Mountz,Michael C.; D'Andrea,Raffaello; LaPlante,John A.; Lyons, II,David P.; Mansfield,Peter K.; Amsbury,Burl W., Inventory system with mobile drive unit and inventory holder.
Vogler, Hartmut K.; Swan, Richard J.; Lin, Tao; Vrieling, James; Beckett, R. Scott; Van der Veen, Wouter; Chen, Ye, Item tracking systems and real-time inventory management.
Sims Nathaniel M. (Wellesley Hills MA) Turner John M. (Lake Forest IL) Zeisloft Jane M. (Barrington IL) Kusswurm Daniel C. (Geneva IL) LaBedz Ralph H. (McHenry IL), Managing an inventory of devices.
Turner, Tara Handy; Goldberg, Evan M.; Schnittker, Matthew F.; Longson, Joseph W.; Neuman, Robert M.; Siegel, Lewis N., Method and system for creating depth and volume in a 2-D planar image.
Tobey,Christopher Lee, Method and system for tracking computer hardware and software assets by allocating and tagging the asset with an asset tag barcode having a software distribution system (SDS) number and verifying the.
Turner, Tara Handy; Goldberg, Evan M.; Schnittker, Matthew F.; Longson, Joseph W.; Neuman, Robert M., Method and system for utilizing pre-existing image layers of a two-dimensional image to create a stereoscopic image.
Klots, Boris; Waddington, William Henry; Grewell, Patricia C.; Ham, Peter; Griese, Susan L.; Perham, Gerry, Order allocation to select from inventory locations stocking few units of inventory.
Maney George A. (Sunnyvale CA) Bonora Anthony C. (Menlo Park CA) Parikh Mihir (San Jose CA) Brain Michael D. (Oakland CA), Processing systems with intelligent article tracking.
Jay, Jon R.; Dashe, Jeremy A.; Lin, Yung-Chun; Macfarlane, Kenneth C.; Stone, Eric S.; Sharpe, Jr., Raymond P.; Glissmeyer, Nathan Brent, System and method for automated call distribution.
Jay, Jon R.; Dashe, Jeremy A.; Lin, Yung-Chun; Macfarlane, Kenneth C.; Stone, Eric S.; Sharpe, Paul; Glissmeyer, Nate, System and method for automated call distribution.
Hoffman, Andrew E.; Breheny, Sean H.; Verminski, Matthew D.; Mountz, Michael C., System and method for communicating status information of inventory-related tasks using a status indicator.
D'Andrea, Raffaello; Wurman, Peter R.; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for coordinating movement of mobile drive units.
D'Andrea, Raffaello; Wurman, Peter R.; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for coordinating movement of mobile drive units.
Wurman, Peter R.; D'Andrea, Raffaello; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for generating a path for a mobile drive unit.
Irmler, Holger; Ayala, Alfredo M.; Mezzatesta, Frank; Schnuckle, Gary W.; Smoot, Lanny S.; Jackson, Philip J.; Slyper, Ronit, System and method for generating realistic eyes.
Hoffman, Andrew E.; Mountz, Michael C.; Barbehenn, Michael T.; Allard, James R.; Kimmel, Matthew E.; Santini, Fabrizio; Decker, Michael H.; D'Andrea, Raffaello; Wurman, Peter R., System and method for inventory management using mobile drive units.
D'Andrea, Raffaello; Wurman, Peter R.; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for managing mobile drive units.
D'Andrea, Raffaello; Wurman, Peter R.; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for managing mobile drive units.
D'Andrea, Raffaello; Wurman, Peter R.; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for managing mobile drive units.
Wurman, Peter R.; D'Andrea, Raffaello; Barbehenn, Michael T.; Hoffman, Andrew E.; Koehler, David C.; Mountz, Michael C., System and method for maneuvering a mobile drive unit.
Smith, Thomas Franklin; Martinka, William; Polubinski, Jr., Jim, System and method for optimizing utilization of inventory space for dispensable articles.
Brunner, Daniel T.; Mountz, Michael C.; Barbehenn, Michael T.; Wurman, Peter R.; Watt, William J.; Nice, Eryk B., System and method for order fulfillment.
Heatherly, Christopher W.; Shin, Christopher K.; Berling, Natasha; Saygan, Robert; Mazzocco, Leonard J.; Hefter, Tara Cortner, System and method for playsets using tracked objects and corresponding virtual worlds.
Hoffman, Andrew E.; Barbehenn, Michael T.; Mountz, Michael C.; Wurman, Peter R.; D'Andrea, Raffaello, System and method for positioning a mobile drive unit.
Hoffman, Andrew E.; Barbehenn, Michael T.; Mountz, Michael C.; Wurman, Peter R.; D'Andrea, Raffaello, System and method for positioning a mobile drive unit.
Wurman, Peter R.; D'Andrea, Raffaello; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for transporting inventory items.
Wurman, Peter R.; D'Andrea, Raffaello; Barbehenn, Michael T.; Hoffman, Andrew E.; Mountz, Michael C., System and method for transporting inventory items.
Ogawa Hiroshi (Aichi JPX) Miyazaki Yasuyuki (Aichi JPX) Yoshida Susumu (Kakamigahara JPX) Sasaki Shinichi (Nagoya JPX), System for automatically controlling movement of unmanned vehicle and method therefor.
Jay, Jon R.; Dashe, Jeremy A.; Judkins, Brock A.; Kaufman, Donald L.; Lin, Yung-Chun; Sharpe, Jr., Raymond P.; Sullivan, Joseph D.; Weiland, Thomas J.; Kidwai, Tauseef, Systems and methods for customer contact.
Jay, Jon R.; Dashe, Jeremy A.; Judkins, Brock A.; Kaufman, Donald L.; Lin, Yung-Chun; Sharpe, Jr., Raymond P.; Sullivan, Joseph D.; Weiland, Thomas J.; Kidwai, Tauseef, Systems and methods for customer contact.
Worger William Robert (Gilbert AZ) Lopatynski Roman Casimir (Scottsdale AZ) Allen Steven Peter (Mesa AZ) Piosenka Gerald Vincent (Scottsdale AZ), Working asset management system and method.
Nusser, Stefan; Rublee, Ethan; Straszheim, Troy Donald; Watts, Kevin William; Zevenbergen, John William, Methods and systems for distributing remote assistance to facilitate robotic object manipulation.
Straszheim, Troy Donald; Nusser, Stefan; Watts, Kevin William; Rublee, Ethan; Zevenbergen, John William, Methods and systems for distributing remote assistance to facilitate robotic object manipulation.
Apkarian, Agop Jean Georges; Haddadi, Amir; Lai, Gilbert Ming Yeung; Lacheray, Hervé Jean-Pierre; Karam, Paul; Erickson, David Ryan, Robotic systems and methods of operating robotic systems.
High, Donald; Winkle, David; McHale, Brian Gerard; Mattingly, Todd Davenport, Systems and methods for distributed autonomous robot interfacing using live image feeds.
Pandya, Sagar; Parks, II, Daniel Frank; Voorhies, Randolph Charles; Elazary, Lior, Workflow management system and methods for coordinating simultaneous operation of multiple robots.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.