Devices for tracking retail interactions with goods and association to user accounts for cashier-less transactions
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G07G-001/00
G06Q-020/12
G06Q-030/06
출원번호
US-0859627
(2017-12-31)
등록번호
US-10140820
(2018-11-27)
발명자
/ 주소
Zalewski, Gary M.
Penilla, Albert S.
출원인 / 주소
Zalewski, Gary M.
인용정보
피인용 횟수 :
0인용 특허 :
92
초록▼
Devices, systems, and method are provided for tracking items in a store for processing a cashier-less purchase transaction. In one example, a method for tracking items in a physical store for processing cashier-less purchase transactions is provided. The method includes detecting a portable wireless
Devices, systems, and method are provided for tracking items in a store for processing a cashier-less purchase transaction. In one example, a method for tracking items in a physical store for processing cashier-less purchase transactions is provided. The method includes detecting a portable wireless coded communication (WCC) device in the physical store. The WCC device is associated with an on-line account of a shopper. Then, receiving, by a server, sensor data regarding the WCC device, its location in the physical store and proximity to items in the physical store. The method includes receiving, by the server, interaction data of an item on a shelf of the physical store by the shopper using one or more sensors of the physical store and the WCC device to determine that the item is one targeted for purchase. The interaction data is configured to identify a type of said item and add it to an electronic shopping cart of the shopper having the on-line account for processing said cashier-less purchase transactions. The method further includes processing, by the server, an electronic charge to a payment service of the shopper for the item. The WCC device may be a portable device of the user, and an application for said cashier-less purchase transactions can be run by the WCC device or portable device of the user.
대표청구항▼
1. A method for tracking items in a physical store for processing cashier-less purchase transactions, comprising: detecting a portable wireless coded communication (WCC) device in the physical store, the WCC device is associated with an on-line account of a shopper;receiving, by a server, sensor dat
1. A method for tracking items in a physical store for processing cashier-less purchase transactions, comprising: detecting a portable wireless coded communication (WCC) device in the physical store, the WCC device is associated with an on-line account of a shopper;receiving, by a server, sensor data regarding the WCC device, its location in the physical store and proximity to items in the physical store;receiving, by the server, interaction data of an item on a shelf of the physical store by the shopper using one or more sensors of the physical store and the WCC device to determine that the item is one targeted for purchase, the interaction data is configured to identify a type of said item and add it to an electronic shopping cart of the shopper having the on-line account for processing said cashier-less purchase transactions; andprocessing, by the server, an electronic charge to a payment service of the shopper for the item;wherein one or more additional wireless-coded communications (WCC) devices are used at the physical store to facilitate one or more shoppers making purchases of products on a single shopping account as a group of shoppers, wherein a status of a shopping list tied to the on-line account is updated in substantial real-time for each shopper in the group of shoppers upon any item being taken by any member of the group of shoppers. 2. The method of claim 1, wherein the WCC device runs an application that enables reading of a universal product code (UPC) of the item under review and provides said interaction data to the server to assist in determining if a take event has occurred with respect to the item and the item is then added to the electronic shopping cart. 3. The method of claim 1, wherein the WCC device runs an application that enables reading of a universal product code (UPC) of the item under review and provides said interaction data to the server to assist in determining if a return event has occurred with respect to the item and the item is then removed from the electronic shopping cart. 4. The method of claim 1, further comprising, sending shopper guidance to a device or said WCC device of one or more shoppers to guide shoppers to walk down a path or route within the physical store to collect items on the shopping list and where said guidance is updated as other shoppers in said group of shoppers collect items from the shopping list. 5. The method of claim 1, further comprising, sending shopper guidance to a device or said WCC device of one or more shoppers in the physical store to point said shopper or another shopper in a location of one or more said items on the shopping list of said shopper or said another shopper;wherein the guidance provided includes voice or visual indications that respond in real-time to a current location of said shopper or said another shopper as movement about the physical store is detected. 6. The method of claim 5, wherein said guidance indicates a direction in which the shopper or said another shopper should move to get closer to the item on the shopping list, which needs to be located. 7. The method of claim 1, further comprising, processing natural language processing (NLP) by said server to provide guidance to said shopper when in the physical store, the NLP processing occurs in response to voice commands received by the shopper. 8. The method of claim 7, wherein said NLP provided by the server pertains to an item of interest and either a direction of gaze of the shopper or a position of the WCC device in the physical store. 9. The method of claim 1, further comprising, sending instructions to the physical store to collect at least some items from a shopping list of the shopper upon detecting said shopper entering the physical store or detecting that said shopper is in route to the physical store, or receiving a signal that said shopper is likely to enter the physical store. 10. The method of claim 9, wherein said instructions to collect items for the shopper prior to the shopper entering the physical store is triggered based on advance information made available to the physical store, the advance information includes tracking a location of the shopper who is either in route to the physical store or predicted to be in route to the physical store. 11. The method of claim 1, further comprising, receiving, from a computer of the physical store a measurement of the shopper's weight upon entering the physical store and prior to exiting the store, the shopper and the shopper's items are weighted together, a weight of items in possession of the shopper is calculated and compared to determine if a value is within a threshold of said weight of items that have been taken and purchased by the shopper via said cashier-less purchase transaction. 12. The method of claim 1, wherein items added to the electronic shopping cart of the on-line account of the shopper, are not charged until the shopper has performed an action that is predefined to be indicative of desiring to purchase said item, or are charged upon a take event being detected, or charged upon reaching a checkpoint in or around the physical store. 13. The method of claim 1, wherein a session to activate the electronic shopping cart of the shopper occurs upon receiving data of an activation or signing into a shopping application via the WCC device or a device of the shopper, wherein the WCC device is one of a smartphone or a wearable device. 14. The method of claim 1, wherein the WCC device is provided to the shopper on a temporary basis for use at the physical store, the WCC device enabling reading of a universal product code (UPC), barcode, or tag of the item in the physical store, the reading occurring to indicated a take event of the item for adding it to the electronic shopping cart. 15. A method for tracking items in a physical store for processing cashier-less purchase transactions, comprising: detecting a portable wireless coded communication (WCC) device in the physical store, the WCC device is associated with an on-line account of a shopper;receiving, by a server, sensor data regarding the WCC device, its location in the physical store and proximity to items in the physical store;receiving, by the server, interaction data of an item on a shelf of the physical store by the shopper using one or more sensors of the physical store and the WCC device to determine that the item is one targeted for purchase, the interaction data is configured to identify a type of said item and add it to an electronic shopping cart of the shopper having the on-line account for processing said cashier-less purchase transactions;processing, by the server, an electronic charge to a payment service of the shopper for the item; andreceiving, by the server, eye or head gaze information of the shopper while in the physical store, the eye or head gaze information being indicative of actions taken by the shopper with the item for which the shopper is interacting, the eye or head gaze information being collected to determine product information of items that are of interest to the shopper, the server is configured to collect the product information that is of interest to the shopper and use said information to provide guidance or provide recommendation to the shopper in connection with said product or an area of interest in the physical store. 16. A method for tracking items in a physical store for processing cashier-less purchase transactions, comprising: detecting a portable device in the physical store, the portable device is associated with an on-line account of a shopper;receiving, by the server, identification data for an item taken from a shelf of the physical store by the shopper using one or more sensors of the physical store to target the item for purchase, the identification data is configured to identify a type of said item and add it to an electronic shopping cart of the shopper having the on-line account for processing said cashier-less purchase transactions; andprocessing an electronic charge via a payment service of the shopper for the item;wherein one or more additional portable devices are usable at the physical store to facilitate one or more shoppers to make purchases of products on said on-line account as a group of shoppers, wherein a status of a shopping list tied to the on-line account is updated in substantial real-time for each shopper in the group of shoppers upon any item being taken for purchase by any member of the group of shoppers;wherein the portable device runs an application that enables viewing of items added to the on-line account from the shopping list. 17. The method of claim 16, wherein detecting the portable device in the physical store includes one of scanning a code displayed on a screen of the portable device, the code being produced via the application. 18. The method of claim 16, wherein detecting the portable device in the physical store includes detecting a wireless transmission from the portable device, or detecting a WiFi transmission from the portable device, or receiving an image captured by the portable device from a perspective of the portable device, or receiving an image captured by the portable device from a perspective of the portable device that indicates a position or orientation of the portable device within the physical store, or detecting an image from a display of the portable device, or detecting a MAC address from the portable device, or detecting a frequency signature of the portable device, or detecting a service running on the portable device, or detecting an authentication message from the portable device, or detecting global positioning system (GPS) data from the portable device, or detecting an SMS message from the portable device, or detecting a telephone call from the portable device, detecting a QR code on a display of the portable device, or detecting a code on a screen of the portable device, or detecting a NFC transmission from the portable device, or detecting a strobed illumination pattern from the portable device, or detecting the portable device based on a processed WiFi aware communication, or a detecting a Bluetooth signal processed by the portable device, or detecting an radio frequency (RF) signal emitted by the portable device, or detecting signal strength of the portable device, or detecting a signal output by the portable device responsive to input received by the portable device, the input being one of a touch, a voice, or text, or biometric, or combination of two or more thereof. 19. The method of claim 16, wherein each of the portable devices run a version of the application that enables viewing of the on-line account and items in the shopping list and viewing of items added responsive to take events by members of the group of shoppers. 20. The method of claim 16, wherein the application enables reading of a universal product code (UPC) of the item under review and provides said interaction data to the server to assist in determining if a take event or a return event has occurred with respect to the item and the item is added to the electronic shopping cart for said take event. 21. The method of claim 16, wherein the one or more sensors of the physical store include one or more cameras, the one or more cameras are configured to generate image data that is processed to identify location of the shopper in the physical store and track movement of the shopper within the physical store, the image data tracking movement of the shopper and is used as an input to classify the item as one taken for purchase by the shopper or as one returned to the shelf by the shopper. 22. The method of claim 21, wherein the tracking of movement of the shopper within the store is usable to distinguish the shopper from other shoppers in the physical store. 23. The method of claim 21, wherein the image data is used to identify at least part of an outline of the shopper or at least part of a skeletal shape of the shopper for said tracking of movement of the shopper within the store. 24. The method of claim 23, wherein said one or more cameras are mounted in the physical store to capture said image data from overhead of the shopper and from sides of the shopper, and select ones of the one or more cameras being a depth sensing camera for producing depth image data. 25. The method of claim 21, wherein the image data is input along with inputs from other sensors of the physical store or from the portable device to one or more processing entities to generate features used as an input to a machine learning classifier, or generate labels used as an input to a machine learning classifier, or generate labels output from a machine learning classifier, or generate relationships between two or more machine learning classifier outputs, or generate relationships between two or more machine learning classifier inputs, or generate a characterization of the shopper, or generate a characterization of an interaction, or generate an identification of an item, or generate an identification of a shopper, or generate an identification of an interaction, or generate a guidance message, or generate a promotional state of an item, or generate a message indicating a request for assistance, or generate a profile of the shopper, or generate a sentiment of the shopper, or generate an amount of time the shopper has studied an item, or generate an amount of time the shopper has performed an interaction of a specific type, or generate a level of affinity the shopper has to an item, or generate a trigger to a lightning sale, or generate a message indicating an item misplaced on shelf. 26. The method of claim 21, wherein the image data is processed to identify a body of the shopper and one or more limbs of the shopper to identify extension of one of said limbs toward the shelf in proximity of said item. 27. The method of claim 21, wherein said one or more sensors include said camera or cameras, or floor sensors, or heat sensors, or weight sensors, or motion sensors, or ultrasonic sensors, or radio frequency sensors, or light sensors, or infrared sensors, or speakers, or microphones, or temperature sensors, or audio sensors, or combinations of two or more thereof, wherein combinations of two or more thereof are processed with a sensor fusion algorithm to verify actions taken by the shopper with respect to items of the store, said actions including a take event or a return event. 28. The method of claim 21, wherein the image data is processed to identify trackable proximity zones, wherein one trackable proximity zone is associated with the shopper and other respective trackable proximity zones are associated with other shoppers in the physical store, the trackable proximity zones being followed for movement of the shopper while in the physical store. 29. The method of claim 21, wherein each camera of a plurality of cameras is configured to view a proximity zone to capture imaged data of at least a portion of the shopper's interactions in the proximity zone and where the shopper is continuously tracked as the shopper passes from one proximity zone to another proximity zone. 30. The method of claim 16, further comprising, automatically collecting at least some items from the shopping list of the shopper upon detecting said shopper entering the physical store or detecting that said shopper is in route to the physical store, or receiving a signal that said shopper is likely to enter the physical store. 31. The method of claim 29, wherein the automatic collection of items that is gathered for the shopper is triggered just-in-time based on tracking location of the shopper in route to the physical store and by calculating at least an expected time the shopper will arrive at or exit the store. 32. The method of claim 16, wherein the item taken by the shopper is detected based on an action of the shopper removing the item from the self, or is detected based on an action of the shopper using the application to scan a product UPC, or is done with an action of the shopper making a gesture, or is done with an action of the shopper making a voice command, or is done with an action of the shopper using the application. 33. The method of claim 21, wherein one or more of said cameras is configured to monitor a first zone within the physical store to capture image data of at least a portion of the shopper's interactions in relation to items, wherein one or more other cameras in the physical store are configured to monitor one or more other zones, such tracking of the shopper is discontinued when the shopper moves out of the first zone and then continued when the shipper enters another one of said zones;wherein the shopper is identified in each of the zones. 34. The method of claim 33, wherein the shopper is identified in said first zone and one or more other zones using facial recognition from images data captured by one or more of said cameras. 35. The method of claim 33, wherein the shopper is identified using inputs from other sensors of the physical store or from sensors of the portable device, or from a machine learning algorithm that takes sensor fusion input to classify the identification of the shopper.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (92)
Ivanov, Vadim V., Active rectifier and method for energy harvesting power management circuit.
Lee, Sang Kyun; Moon, Seung Eon; Yang, Yil Suk; Park, Kang Ho; Kim, Jong Dae, Apparatus employing piezoelectric energy harvester capable of generating voltage to drive power conditioning circuit and method of manufacturing the same.
Loverich, Jacob J.; Kraige, David R.; Frank, Jeremy E.; Geiger, Richard T., Apparatuses and methods for using energy harvesting for variable shock absorption in a prosthetic device.
Ramadass, Yogesh; Chandrakasan, Anantha, Circuit and method to startup from very low voltages and improve energy harvesting efficiency in thermoelectric harvesters.
Mukter-Uz-Zaman, A. S. M.; Masuri, Othman; Mohammad, Shaharia Bhuyan; Khairul, Hakimin Zainuddin; Suraya, Sulaiman; Agus, Santoso Tamsir, Device for maximum detection of vibrating energy for harvesting energy.
Arms, Steven W.; Townsend, Chris Pruyn; Churchill, David Lawrence; Hamel, Michael John, Energy harvesting, wireless structural health monitoring system with time keeper and energy storage devices.
Winger, Lyall Kenneth; Dikun, Raymond Michael; Guthrie, Martin George Albert; Marchand, Rene Pierre; Rich, David Gerard, Holster-integrated piezoelectric energy source for handheld electronic device.
Arms, Steven W.; Townsend, Christopher P; Churchill, David L.; Hamel, Michael J., Shaft mounted energy harvesting for wireless sensor operation and data transmission.
Arms,Steven W.; Townsend,Christopher P; Churchill,David L.; Hamel,Michael J., Shaft mounted energy harvesting for wireless sensor operation and data transmission.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.