RF-based micro-motion tracking for gesture tracking and recognition
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-003/01
G01S-007/41
G01S-013/88
G01S-013/66
G01S-013/89
G01S-013/58
출원번호
US-0142689
(2016-04-29)
등록번호
US-10241581
(2019-03-26)
발명자
/ 주소
Lien, Jaime
Olson, Erik M.
Amihood, Patrick M.
Poupyrev, Ivan
출원인 / 주소
Google LLC
대리인 / 주소
Colby Nipper
인용정보
피인용 횟수 :
0인용 특허 :
118
초록▼
This document describes techniques for radio frequency (RF) based micro-motion tracking. These techniques enable even millimeter-scale hand motions to be tracked. To do so, radar signals are used from radar systems that, with conventional techniques, would only permit resolutions of a centimeter or
This document describes techniques for radio frequency (RF) based micro-motion tracking. These techniques enable even millimeter-scale hand motions to be tracked. To do so, radar signals are used from radar systems that, with conventional techniques, would only permit resolutions of a centimeter or more.
대표청구항▼
1. A computer-implemented method comprising: receiving a radar signal representing a superposition of reflections of two or more points of a hand within a radar field provided by a radar system, a first of the two or more points having a first movement and a second of the two or more points having a
1. A computer-implemented method comprising: receiving a radar signal representing a superposition of reflections of two or more points of a hand within a radar field provided by a radar system, a first of the two or more points having a first movement and a second of the two or more points having a second movement;determining a velocity profile from the radar signal, the velocity profile indicating energies at multiple velocities, a first of the energies representing a reflection of the first point of the hand having the first movement and a second of the energies representing a reflection of the second point of the hand having the second movement;extracting, from the velocity profile determined from the radar signal and one or more prior-determined or later-determined velocity profiles determined from radar signals over time, relative velocities between the first and second points of the hand; anddetermining a displacement trajectory by integrating the relative velocities between the first and second points of the hand, the displacement trajectory representing a relative displacement between the first and second points of the hand. 2. The method of claim 1, wherein determining the velocity profile of the radar signal representing the superposition determines a first and a second micro-Doppler centroid for the first and the second points, respectively. 3. The method of claim 2, further comprising determining the first and second points from the one or more points based on the energies associated with the first and second micro-Doppler centroids being higher than other energies associated with other points of the one or more points. 4. The method of claim 1, further comprising increasing a resolution of the displacement trajectory by extracting millimeter or sub-millimeter displacements using a phase change of the radar signal. 5. The method of claim 1, further comprising filtering the radar signal prior to determining the velocity profile. 6. The method of claim 5, wherein filtering the radar signal includes isolating the first point from the second point using a moving target indicator (MTI) filter to determine points of the two or more points having greater movement than other points of the two or more points. 7. The method of claim 1, wherein the first point is a first finger and the second point is a second finger, and the relative displacement between the first and second points during the first movement and the second movement indicate a millimeter-scale movement of the first finger relative to the second finger. 8. The method of claim 7, wherein the relative displacement for the millimeter-scale movement is at a resolution of one millimeter or finer. 9. The method of claim 1, further comprising determining, based on the relative displacement between the first and second points during the first movement and the second movement, a gesture. 10. The method of claim 9, further comprising passing the gesture to an application or device effective to control or alter a display, function, or capability associated with the application or the device. 11. One or more non-transitory computer-readable storage media having instructions stored thereon that, responsive to execution by one or more computer processors, implement a micro-motion tracking module and a recognition module: the micro-motion tracking module configured to: receive a radar signal representing a superposition of reflections of two or more points of a hand within a radar field provided by a radar system, a first of the two or more points having a first movement and a second of the two or more points having a second movement;determine a velocity profile from the radar signal, the velocity profile indicating energies at multiple velocities, a first of the energies representing a reflection of the first point of the hand having the first movement and a second of the energies representing a reflection of the second point of the hand having the second movement;extract, from the velocity profile determined from the radar signal and one or more prior-determined or later-determined velocity profiles determined from radar signals over time, relative velocities between the first and second points of the hand; anddetermine a displacement trajectory by integrating the relative velocities between the first and second points of the hand, the displacement trajectory representing a relative displacement between the first and second points of the hand, andthe recognition module configured to: determine, based on the displacement trajectory, a gesture of the first and second points of the hand; andpass the gesture effective to control or alter a display, function, or capability of a device. 12. The non-transitory computer-readable storage media of claim 11, wherein the micro-motion tracking module is further configured to determine a weighted average of the relative velocities and integrating the relative velocities integrates the weighted average of the relative velocities. 13. The non-transitory computer-readable storage media of claim 12, wherein the determination of the weighted average is based on velocity readings determined to have higher probabilities of accurate readings or lower noise than other velocity readings. 14. The non-transitory computer-readable storage media of claim 11, wherein determining the velocity profile of the radar signal uses a range-Doppler-time data cube for the radar signal. 15. The non-transitory computer-readable storage media of claim 14, wherein integrating the relative velocities comprises quantitatively combining the relative velocities from the range-Doppler-time data cube for the radar signal and an unwrapped signal phase of the radar signal. 16. The non-transitory computer-readable storage media of claim 11, wherein the displacement trajectory represents a sub-gesture step of a complete gesture and wherein the micro-motion tracking module is further configured to determine multiple subsequent displacement trajectories and the recognition module is further configured to determine sub-gestures of the complete gesture and to pass the sub-gestures effective to control or alter the display, function, or capability of the device in real time. 17. An apparatus comprising: one or more computer processors;a radar system comprising: one or more radar-emitting elements configured to provide a radar field; andone or more antenna elements configured to receive a radar signal representing a superposition of reflections of two or more points of a hand within the radar field; andone or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, implement a micro-motion tracking module and a recognition module:the micro-motion tracking module configured to: receive the radar signal representing the superposition of reflections of the two or more points of the hand within the radar field provided by the radar system, a first of the two or more points having a first movement and a second of the two or more points having a second movement;determine a velocity profile from the radar signal, the velocity profile indicating energies at multiple velocities, a first of the energies representing a reflection of the first point of the hand having the first movement and a second of the energies representing a reflection of the second point of the hand having the second movement;extract, from the velocity profile determined from the radar signal and one or more prior-determined or later-determined velocity profiles determined from radar signals over time, relative velocities between the first and second points of the hand; anddetermine a displacement trajectory by integrating the relative velocities between the first and second points of the hand, the displacement trajectory representing a relative displacement between the first and second points of the hand, andthe recognition module configured to: determine, based on the displacement trajectory, a gesture of the first and second points of the hand; andpass the gesture to an application of the apparatus or a remote or peripheral device effective to control or alter a display, function, or capability of the apparatus or the remote or peripheral device. 18. The apparatus of claim 17, wherein the radar system has a hardware-parameter-based displacement-sensing resolution limit and a resolution of the relative displacement is finer than the hardware-parameter-based displacement-sensing resolution limit. 19. The apparatus of claim 18, wherein the hardware-parameter-based displacement-sensing resolution limit is based on a wavelength of the radar field provided by the radar system, and wherein the resolution of the relative displacement is finer than the wavelength. 20. The apparatus of claim 17, wherein the one or more radar-emitting elements is one radar-emitting element and the one or more antenna elements is one radar antenna element, and the radar field provided by the radar system is a broad beam, full contiguous radar field.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (118)
Oswald, Gordon Kenneth Andrew; Carter, Edwin Christopher; Utsi, Per Arne Vincent; Pumphrey, Samuel Julius; Phillips, Desmond Keith; Burchett, Michael Hugh; Smithson, Allan Geoffrey; Edgecombe, Jonathan Peter, Adaptive radar.
Sugimoto,Mitsuhiro; Kawaguchi,Hisao; Sekiguchi,Shingo, Anisotropic conductive material body, display apparatus, method for producing the display apparatus, and conductive member.
Weiss, Roger E.; Amber, Glenn M., Apparatus for applying a mechanically-releasable balanced compressive load to an assembly such as a compliant anisotropic conductive elastomer electrical connector.
Brodsky William L. (Binghamton NY) Herard James D. (Vestal NY) Macek Thomas G. (Endicott NY) Sharp Timothy L. (Berkshire NY) Shovlowsky George J. (Owego NY), Circuitized structure including flexible circuit with elastomeric member bonded thereto.
Ito, Eiichi; Tsuda, Koji; Minakuchi, Tadashi; Matsumoto, Mitsuhiro, Conductive layer, manufacturing method of the same, and signal transmission substrate.
Nhan, Davis-Dang H.; Ales, Thomas Michael; Ehlert, Thomas David; Gakhar, Sudhanshu, Conductive webs containing electrical pathways and method for making same.
Karagozler, Mustafa Emre; Raja, Hakim; Poupyrev, Ivan; Colin, Youenn; Chion, Jimmy; Yurchenco, James R., Connectors for connecting electronics embedded in garments to external devices.
Brian Finlay Beaton CA; Colin Donald Smith CA; Francois Blouin CA; Guillaume Comeau CA; Arthur Julian Patterson Craddock CA, Contextual gesture interface.
Selby, Tapio; Lehtinen, Ossi; Lindman, Erik, Device and method for assembling an electronic device and a flexible element for facilitating assembly of electronic components.
Gollakota, Shyamnath; Patel, Shwetak N.; Pu, Qifan; Gupta, Sidhant, Devices, systems, and methods for detecting gestures using wireless communication signals.
Eldridge, Benjamin N.; Grube, Gary W.; Khandros, Igor Y.; Mathieu, Gaetan L., ELECTRICAL CONTACT STRUCTURES FORMED BY CONFIGURING A FLEXIBLE WIRE TO HAVE A SPRINGABLE SHAPE AND OVERCOATING THE WIRE WITH AT LEAST ONE LAYER OF A RESILIENT CONDUCTIVE MATERIAL, METHODS OF MOUNTING.
Hosaka, Taiji; Miyazawa, Masaaki, Electric contact and an electric connector both using resin solder and a method of connecting them to a printed circuit board.
Kang, Tae Jin; Kim, Byung Duck; Chi, Young Seung; Roh, Jung Sim, Electrically conductive metal composite embroidery yarn and embroidered circuit using thereof.
Zhou, Guofu; Rademakers, Johannes Adrianus Maria; Snoeijen, Petrus Antonius Henricus; Bax, Josephus Henricus Gerardus; Van Abeelen, Frank Anton; Van Pieterson, Liesbeth, Electronic textile and method of manufacturing an electronic textile.
Dhawan,Anuj; Ghosh,Tushar K.; Seyam,Abdelfattah M.; Muth,John, Fabric and yarn structures for improving signal integrity in fabric-based electrical circuits.
Hokanson John M. (Hutchinson MN) Bentz Kenneth S. (Hutchinson MN) Field Terrence G. (Hutchinson MN) Ziegler David A. (Darwin MN), Laser soldering apparatus and method.
Chalco Pedro A. (Yorktown Heights NY) Hillman Wesley L. (Morgan Hill CA) Kurth Richard H. (Palo Alto CA) Panousis Nicholas T. (San Jose CA), Lasersonic soldering of fine insulated wires to heat-sensitive substrates.
Westbrook, Philip R.; Levendowski, Daniel J.; Zavora, Timothy; Popovic, Djordje; Cvetinovic, Milenko; Berka, Chris, Method for measuring central venous pressure or respiratory effort.
Chou, Cheng Hsien; Chen, Yu-Jen; Chiang, Kai Hsiang; Ting, Chia Hurg, Structure for connecting a USB communication interface in a flash memory card by the height difference of a rigid flexible board.
Jackson, Dean Kenneth; Klein, Daniel Victor, Systems and methods for updating vehicle behavior and settings based on the locations of vehicle passengers.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.