Method and apparatus for using unique landmarks to locate industrial vehicles at start-up
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
B66F-009/06
G01S-017/02
G01S-005/08
G07C-005/08
G06F-017/00
G01C-021/20
G01S-005/16
G01S-017/08
G01S-017/87
출원번호
US-0079842
(2013-11-14)
등록번호
US-9206023
(2015-12-08)
발명자
/ 주소
Wong, Lisa
Graham, Andrew Evan
Goode, Christopher W.
Waltz, Lucas B.
출원인 / 주소
Crown Equipment Limited
대리인 / 주소
Dinsmore & Shohl LLP
인용정보
피인용 횟수 :
1인용 특허 :
85
초록▼
A method and apparatus for using unique landmarks to position industrial vehicles during start-up. In one embodiment, a method of using pre-positioned objects as landmarks to operate an industrial vehicle is provided. The method comprises identifying a start-up scenario from sensor data, wherein the
A method and apparatus for using unique landmarks to position industrial vehicles during start-up. In one embodiment, a method of using pre-positioned objects as landmarks to operate an industrial vehicle is provided. The method comprises identifying a start-up scenario from sensor data, wherein the start-up scenario comprises a unique marker start-up or a pre-positioned object start-up. in response to the identified start-up scenario, either a unique marker or pre-positioned object is identified within a physical environment, wherein the pre-positioned object or unique marker corresponds with a sub-area of the physical environment. The industrial vehicle pose is determined in response to the identity of the pre-positioned object or unique marker and the industrial vehicle is operated based on the determined industrial vehicle pose.
대표청구항▼
1. A method of operating an industrial vehicle in a navigation system, wherein the method comprises: providing the industrial vehicle, one or more sensors coupled to the industrial vehicle, a mobile computer operably coupled to the industrial vehicle, and an environment based navigation module compr
1. A method of operating an industrial vehicle in a navigation system, wherein the method comprises: providing the industrial vehicle, one or more sensors coupled to the industrial vehicle, a mobile computer operably coupled to the industrial vehicle, and an environment based navigation module comprised in the mobile computer;utilizing the mobile computer coupled to the industrial vehicle to process measurement data from the sensors, wherein the measurement data is indicative of the presence of pre-positioned objects or landmarks within a range of the sensors;utilizing the mobile computer coupled to the industrial vehicle to determine initial pose prediction data for the industrial vehicle from the measurement data, wherein the initial pose prediction data is sufficient to determine a sub-area of a physical environment in which the industrial vehicle is positioned, butthe initial pose prediction data is insufficient to determine a location of the industrial vehicle within the determined sub-area;utilizing the mobile computer coupled to the industrial vehicle to select a sub-area of the physical environment based on the initial pose prediction data and obtain a sub-area map from an overview map of the physical environment based on the initial pose prediction data;utilizing the mobile computer coupled to the industrial vehicle to refine the initial pose prediction data for the industrial vehicle using the sub-area map and features observable by the sensors from the selected sub-area to generate a new pose; andutilizing the new pose, the sensors, and the environment based navigation module of the mobile computer to navigate the industrial vehicle through the physical environment. 2. A method as claimed in claim 1 wherein the selected sub-area comprises a block stacked area of the physical environment and method further comprises utilizing the mobile computer coupled to the industrial vehicle to develop a new start-up pose estimate by triggering a start-up task wherein: the industrial vehicle is driven by the environment based navigation module of the mobile computer to scan a pre-positioned object in the block stacked area of the physical environment;the pre-positioned object is uniquely identifiable through a feature that can be sensed by the sensors coupled to the industrial vehicle;the mobile computer operably coupled to the industrial vehicle accesses the position of the pre-positioned object and uses the position to develop the new start-up pose estimate. 3. A method as claimed in claim 2 wherein the mobile computer coupled to the industrial vehicle accesses the position of the pre-positioned object from placed object data or by requesting a location of the pre-positioned object from an system external to the mobile computer. 4. A method as claimed in claim 1 wherein the overview map comprises a plurality of sub-area maps, the initial pose prediction data comprises relative positions of features sensed using the sensors, and the method comprises: utilizing the mobile computer coupled to the industrial vehicle to determine if the industrial vehicle is in a particular sub-area of the physical environment by evaluating relative positions of sensed features against the sub-area maps; andutilizing the sub-area map and the environment based navigation module of the mobile computer to navigate the industrial vehicle to a location where the initial pose prediction data is refined by the mobile computer coupled to the industrial vehicle. 5. A method as claimed in claim 4 wherein the location to which the industrial vehicle is navigated to refine the initial pose prediction data comprises a pre-positioned object. 6. A method as claimed in claim 4 wherein the location to which the industrial vehicle is navigated to refine the initial pose prediction data comprises an end of a row of block stacked products. 7. A method as claimed in claim 1 wherein: the overview map comprises a model of block-stacked object rows data;the initial pose prediction data comprises relative positions of features sensed using the sensors; andthe method comprises utilizing the mobile computer coupled to the industrial vehicle to determine if the industrial vehicle is in a sub-area corresponding to blocked-stacked object rows by evaluating the relative positions of the sensed features against the model of block-stacked object rows data. 8. A method as claimed in claim 7 wherein: the initial pose prediction data is insufficient to determine in which of a plurality of rows of products the industrial vehicle is positioned; andthe method comprises utilizing the mobile computer coupled to the industrial vehicle to select a candidate row of blocked stacked product in the sub-area using pre-positioned product information that matches feature information received from the sensors. 9. A method as claimed in claim 8 wherein the candidate row may be inaccurate and the method further comprises utilizing the environment based navigation module of the mobile computer to navigate the industrial vehicle to a location where the initial pose prediction data is refined by the mobile computer coupled to the industrial vehicle. 10. A method as claimed in claim 9 wherein the location to which the industrial vehicle is navigated to refine the initial pose prediction data comprises a pre-positioned object or an end of a row of block stacked products. 11. A method as claimed in claim 1 wherein: the overview map comprises a racking aisle model provided in data of the overview map;the initial pose prediction data comprises relative positions of features sensed using the sensors; andthe method comprises utilizing the mobile computer coupled to the industrial vehicle to determine if the industrial vehicle is in a sub-area corresponding to a racking aisle by matching relative positions of the sensed features against the racking aisle model. 12. A method as claimed in claim 1 wherein the observable features are selected from landmarks comprising walls, rack protectors, racking legs, placed unique navigational markers, or combinations thereof. 13. A method as claimed in claim 1 wherein: the observable features comprise pre-positioned objects; andthe mobile computer coupled to the industrial vehicle accesses a position of the pre-positioned object from placed object data or by requesting a location of the pre-positioned object from an system external to the mobile computer. 14. A method as claimed in claim 13 wherein the placed object data comprises object identity and object pose. 15. A method as claimed in claim 13 wherein: the pre-positioned object comprises a pallet or product load;the mobile computer coupled to the industrial vehicle accesses a position of the pallet or product load by scanning, picking up, or otherwise engaging the pallet or product load and retrieving a known location of the pallet or product load from a warehouse management system database. 16. A method as claimed in claim 13 wherein: the sensors of the industrial vehicle comprise a laser scanner;the pre-positioned object comprises a barcode; andthe method comprises scanning the barcode with the laser scanner to identify the pre-positioned object. 17. A method as claimed in claim 13 wherein: the sensors of the industrial vehicle comprise a camera configured to capture images of the pre-positioned objects;the pre-positioned object comprises a label; andthe method comprises identifying the pre-positioned object from the label captured in an image of the pre-position object. 18. A method as claimed in claim 17 wherein the label is a barcode. 19. A method as claimed in claim 13 wherein: the sensors of the industrial vehicle comprise an RFID tag reader;the pre-positioned object comprises an RFID tag; andthe method comprises interrogating the RFID tag with the RFID tag reader to identify the pre-positioned object. 20. A method as claimed in claim 13 wherein: the sensors comprise an camera configured to capture images of the pre-positioned objects; andthe method comprises utilizing the mobile computer of the industrial vehicle to identify the pre-positioned object from an image of a pre-positioned object captured by the camera. 21. A method as claimed in claim 13 wherein the pre-positioned object is identified by a specific shape or unique feature sensed by the sensors of the industrial vehicle. 22. A method as claimed in claim 1 wherein the sensors coupled to the industrial vehicle comprise a laser scanner and a camera. 23. A method as claimed in claim 1 wherein the method comprises starting-up the industrial vehicle such that the industrial vehicle has no information about its pose or its location relative to particular sub-areas of the environment prior to utilizing the mobile computer to process measurement data from the sensors. 24. A method as claimed in claim 1 wherein the sub-area map comprises one or more features and prior to refining the initial pose prediction data of the industrial vehicle, the method comprises eliminating features from the sub-area map which are not observable to the sensors. 25. A method as claimed in claim 1 wherein the features observable by the sensors comprise a plurality of beacons arranged in a known and unique constellation. 26. A method as claimed in claim 1 wherein the features observable by the sensors comprise unique navigational markers coupled to racking protectors at an end of the row of blocked stacked products. 27. A method as claimed in claim 1 wherein: the overview map comprises positions of racking legs;the initial pose prediction data comprises relative positions of features sensed using the sensors; andthe method comprises utilizing the mobile computer coupled to the industrial vehicle to determine if the industrial vehicle is in a sub-area corresponding to a racking aisle by matching the relative positions of the pre-positioned objects and racking legs sensed using the sensors against the positions of racking legs from the overview map. 28. A method of operating an industrial vehicle in a navigation system, wherein the method comprises: providing the industrial vehicle, one or more sensors coupled to the industrial vehicle, a mobile computer operably coupled to the industrial vehicle, wherein the mobile computer comprises an environment based navigation module and an environment based navigation module comprised in the mobile computer;utilizing the mobile computer coupled to the industrial vehicle to process measurement data from the sensors, wherein the measurement data is indicative of the presence of at least one pre-positioned object within a range of the sensors;utilizing the mobile computer coupled to the industrial vehicle to develop an initial pose estimate, wherein the initial pose estimate is sufficient to determine a sub-area of a physical environment in which the industrial vehicle is positioned, butthe initial pose estimate insufficient to determine a location of the industrial vehicle within the determined sub-area;utilizing the mobile computer coupled to the industrial vehicle to select a sub-area based on the initial pose estimate and obtain a sub-area map from an overview map of the environment based on the initial pose estimate;utilizing the sub-area map and data from the sensors coupled to the industrial vehicle to navigate the industrial vehicle to the pre-positioned object;accessing a position of the pre-positioned object from placed object data associated with the pre-positioned object or from a warehouse management system in communication with the mobile computer;developing a new pose estimate for the industrial vehicle using the accessed position of the pre-positioned object; andutilizing the new pose estimate, data from the sensors, and the environment based navigation module of the mobile computer to navigate the industrial vehicle through the physical environment. 29. A method as claimed in claim 28 wherein: the measurement data processed after starting-up the industrial vehicle comprises a plurality of pre-positioned objects; andthe environment based navigation module obtains position data for the pre-positioned objects from a map manager in communication with the mobile computer. 30. A method of generating a pose of an industrial vehicle prior to navigation, wherein the method comprises: providing the industrial vehicle, one or more sensors coupled to the industrial vehicle, a mobile computer operably coupled to the industrial vehicle, and an environment based navigation module comprised in the mobile computer,utilizing the mobile computer coupled to the industrial vehicle to process measurement data of the surrounding physical environment within a range of the sensors;utilizing the mobile computer coupled to the industrial vehicle to determine initial pose prediction data for the industrial vehicle from the measurement data, wherein the initial pose prediction data is sufficient to determine a sub-area of a physical environment in which the industrial vehicle is positioned, butthe initial pose prediction data is insufficient to determine a location of the industrial vehicle within the determined sub-area,utilizing the mobile computer coupled to the industrial vehicle to select a sub-area based on the initial pose prediction data and obtain a sub-area map from an overview map of the physical environment based on the initial pose prediction data; andutilizing the sub-area map, data from the sensors coupled to the industrial vehicle, and the environment based navigation module of the mobile computer to drive the industrial vehicle to a pre-positioned object;scanning the pre-positioned object with the sensors;accessing a position of the pre-positioned object from placed object data associated with the pre-positioned object or from a warehouse management system in communication with the mobile computer;generating a new pose of the industrial vehicle by utilizing the mobile computer coupled to the industrial vehicle to refine the initial pose prediction data for the industrial vehicle using the sub-area map and the accessed position of the pre-positioned object; andwherein the industrial vehicle does not navigate the physical environment until the new pose is generated.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor; Dewenter, Michael Thomas; Traft, Neil Michael; Drakunov, Sergey; Kinney, Powell; Lee, Aaron, Control and systems for autonomously driven vehicles.
Andersen Eric T. (Rte. 1 ; Box 138A Barboursville VA 22923) Andersen Edward A. (Rte. 1 ; Box 138A Barboursville VA 22923), Height indicator for a fork lift truck.
Gaibler Dennis W. (Gresham OR) Skinner Jeffrey R. (Camas WA) Edwards Alan T. (Portland OR), Load-lifting mast especially adapted for use with automatically-guided vehicles.
Gorr Russell E. ; Hancock Thomas R. ; Judd J. Stephen ; Lin Long-Ji ; Novak Carol L. ; Rickard ; Jr. Scott T., Method and apparatus for automatically tracking the location of vehicles.
Bell, Jamie; Chandrasekar, Kashyap; Graham, Andres Evan; Howse, David Charles, Method and apparatus for sensing object load engagement, transportation and disengagement by automated vehicles.
Jascob, Bradley A.; Shaver, Scott; Martens, Todd; Yared, Nadim; Boes, Kirsten; Dukesherer, John H.; Hunter, Mark W., Method and apparatus for surgical navigation.
Alofs Cornell W. ; Drenth Ronald R. ; Drenth Justin R., Method and system for describing, generating and checking non-wire guidepaths for automatic guided vehicles.
Matthias Benzinger DE; Friedrich Boettiger DE; Rachad Mahmoud DE; Avshalom Suissa DE, Method and system for detecting and localizing sensor defects in motor vehicles.
.ANG.strom Karl-Erik,SEX, Method for determining the positions of a plurality of anonymous fixed reference objects for mobile surface transportation and a device for determining said positions.
Evans ; Jr. John M. (Brookfield CT) King Steven J. (Woodbury CT) Weiman Carl F. R. (Westport CT), Mobile robot navigation employing retroreflective ceiling features.
Wilson,Edward, Model-based fault detection and isolation for intermittently active faults with application to motion-based thruster fault detection and isolation for spacecraft.
McTamaney Louis S. (Cupertino CA) Wong Yue M. (Saratoga CA) Chandra Rangasami S. (Pleasanton CA) Walker Robert A. (Sunnyvale CA) Lastra Jorge E. (San Jose CA) Wagner Paul A. (Cambridge MA) Sharma Uma, Multi-purpose autonomous vehicle with path plotting.
Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Kinney, Powell McVay; Dooner, Matthew Taylor; Wilson, Bruce Mackie; Schneider, Jr., Carl Reimers; Goeller, Keith Brian, Navigation and control system for autonomous vehicles.
Summerville David F. (Garland TX) Williston John P. (Plano TX) Wand Martin A. (Plano TX) Doty Thomas J. (Dallas TX) Rice Haradon J. (Plano TX), Static collision avoidance method for multiple automatically guided vehicles.
Enright,Jeffery M.; Martin,Kevin F.; Stephenson,Brad L.; Hathaway,Roy; Kehner,Tom; Knouff,Christopher J.; Varn,Kenneth C.; Thomas,Jeffrey R.; Drummond,Jay Paul; Kortis,John; Crane,David A.; Goldring,, System and method for capturing and searching image data associated with transactions.
Gudat Adam J. (Edelstein IL) Whittaker William L. (Pittsburgh PA) Kleimenhagen Karl W. (Peoria IL) Christensen Dana A. (Peoria IL) Kemner Carl A. (Peoria Heights IL) Bradbury Walter J. (Peoria IL) Ko, System and method for controlling an autonomously navigated vehicle.
Shaffer Gary K. (Butler PA) Whittaker William L. (Pittsburgh PA) West Jay H. (Pittsburgh PA) Clow Richard G. (Phoenix AZ) Singh Sanjiv J. (Pittsburgh PA) Lay Norman K. (Peoria IL) Devier Lonnie J. (P, System and method for detecting obstacles in the path of a vehicle.
Eglington,Michael; O'Connor,Michael L.; Leckie,Lars G.; Sapilewski,Glen A., System and method for interactive selection and determination of agricultural vehicle guide paths offset from each other with varying curvature along their length.
Haynie, Michael B.; Laurune, William R., System and method for vitally determining position and position uncertainty of a railroad vehicle employing diverse sensors including a global positioning system sensor.
Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo; Karlsson,L. Niklas, Systems and methods for computing a relative pose for global localization in a visual simultaneous localization and mapping system.
Karlsson,L. Niklas; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico; Pirjanian,Paolo, Systems and methods for correction of drift via global localization with a visual landmark.
Goncalves, Luis Filipe Domingues; Di Bernardo, Enrico; Pirjanian, Paolo; Karlsson, L. Niklas, Systems and methods for filtering potentially unreliable visual data for visual simultaneous localization and mapping.
Goncalves,Luis Filipe Domingues; Karlsson,L. Niklas; Pirjanian,Paolo; Di Bernardo,Enrico, Systems and methods for filtering potentially unreliable visual data for visual simultaneous localization and mapping.
Karlsson,L. Niklas; Pirjanian,Paolo; Goncalves,Luis Filipe Domingues; Di Bernardo,Enrico, Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques.
Karlsson, L. Nicklas; Pirjanian, Paolo; Goncalves, Luis Filipe Domingues; Bernardo, Enrico Di, Systems and methods for using multiple hypotheses in a visual simultaneous localization and mapping system.
Duggan,David S.; Felio,David A.; Pate,Billy B.; Longhi,Vince R.; Petersen,Jerry L.; Bergee,Mark J., Vehicle control system including related methods and components.
Keeler James D. (Austin TX) Havener John P. (Austin TX) Godbole Devendra (Austin TX) Ferguson ; II Ralph B. (Austin TX), Virtual emissions monitor for automobile.
Keeler James David (Austin TX) Havener John Paul (Austin TX) Godbole Devendra (Austin TX) Ferguson ; II Ralph Bruce (Austin TX), Virtual emissions monitor for automobile and associated control system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.