A method includes arranging, by a computer, multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects, and presenting, on a display coupled to the computer, a first subset of the mu
A method includes arranging, by a computer, multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects, and presenting, on a display coupled to the computer, a first subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects. A sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to the display is received, and the hand performing a transverse gesture followed by a grab gesture followed by a longitudinal gesture followed by an execute gesture is identified in the sequence of three-dimensional (3D) maps, and an operation associated with the selected object is accordingly performed.
대표청구항▼
1. A method, comprising: arranging, by a computer, multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects;presenting, on a display coupled to the computer, a first subset of the
1. A method, comprising: arranging, by a computer, multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects;presenting, on a display coupled to the computer, a first subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects;receiving a sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to the display;identifying, in the sequence of three-dimensional (3D) maps, the hand performing a transverse gesture followed by a grab gesture followed by a longitudinal gesture followed by an execute gesture;selecting, in response to the transverse gesture, an object from the first subset of the multiple interactive objects; andin response to the grab gesture, the longitudinal gesture and the execute gesture, presenting, on the display, a second subset of the multiple interactive objects that are associated with one or more child nodes of the selected object,wherein the execute gesture is selected from a list comprising a timeclick gesture, a release gesture and a subsequent transverse gesture. 2. The method according to claim 1, wherein the longitudinal gesture comprises a pull gesture. 3. The method according to claim 2, and comprising presenting a preview of the second subset of the multiple interactive objects upon detecting the pull gesture. 4. The method according to claim 1, and comprising assigning less significance to a transverse motion of the hand than to a longitudinal motion of the hand upon detecting a start of the longitudinal gesture. 5. The method according to claim 1, and comprising assigning less significance to a longitudinal motion of the hand than to a transverse motion of the hand upon detecting a start of the transverse gesture. 6. The method according to claim 1, and comprising changing a layout of the subset of the multiple interactive objects in response to the longitudinal gesture. 7. A method, comprising: arranging, by a computer, multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects;presenting, on a display coupled to the computer, a subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects;receiving a sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to the display;identifying, in the sequence of three-dimensional (3D) maps, the hand performing a transverse gesture followed by a grab gesture followed by a pull gesture followed by an execute gesture;selecting, in response to the transverse gesture, a media file from the subset of the multiple interactive objects;in response to the grab gesture, the longitudinal gesture and the execute gesture, playing the selected media file; andreceiving, while playing the media file, an additional set of 3D maps, detecting, in the additional set of 3D maps, an additional grab gesture followed by an additional transverse gesture followed by a further grab gesture followed by an additional release gesture, presenting one or more media controls in response to the additional grab gesture, positioning a cursor in response to the transverse gesture in the additional set of 3D maps, identifying, upon detecting the further grab gesture, one of the one or more media controls presented in proximity to the cursor, and performing an operation associated with the one of the one or more media controls upon detecting the additional release gesture. 8. The method according to claim 7, wherein each of the one or more media controls is selected from a list comprising a play and pause control, a seek control, a volume and mute control, a fast forward control, a rewind control, a next track control and a previous track control. 9. An apparatus, comprising: a sensing device;a display; anda computer coupled to the sensing device and the display, and configured to arrange multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects, to present, on the display, a first subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects, to receive a sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to a display coupled to the computer, to identify, in the sequence of three-dimensional (3D) maps, the hand performing a transverse gesture followed by a grab gesture followed by a longitudinal gesture followed by an execute gesture, to select, in response to the transverse gesture, one of the first subset of the multiple interactive objects, and, in response to the grab gesture, the longitudinal gesture and the execute gesture, to present, on the display, a second subset of the multiple interactive objects that are associated with one or more child nodes of the selected one of the first subset of the multiple interactive objects,wherein the execute gesture is selected from a list comprising a timeclick gesture, a release gesture and a subsequent transverse gesture. 10. The apparatus according to claim 9, wherein the longitudinal gesture comprises a pull gesture. 11. The apparatus according to claim 10, wherein the computer is configured to present a preview of the second subset of the multiple interactive objects upon detecting the pull gesture. 12. The apparatus according to claim 9, wherein the computer is configured to assign less significance to a transverse motion of the hand than to a longitudinal motion of the hand upon detecting a start of the longitudinal gesture. 13. The apparatus according to claim 9, wherein the computer is configured to assign less significance to a longitudinal motion of the hand than to a transverse motion of the hand upon detecting a start of the transverse gesture. 14. The apparatus according to claim 9, wherein the computer is configured to change a layout of the subset of the multiple interactive objects in response to the longitudinal gesture. 15. An apparatus, comprising: a sensing device;a display; anda computer coupled to the sensing device and the display, and configured: to arrange multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects,to present, on the display, a first subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects,to receive a sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to a display coupled to the computer,to identify, in the sequence of three-dimensional (3D) maps, the hand performing a transverse gesture followed by a grab gesture followed by a pull gesture followed by an execute gesture,to select, in response to the transverse gesture, a media file from the subset of the multiple interactive objects,to perform, in response to the grab gesture, the pull gesture and the execute gesture, an operation associated with the selected one of the first subset of the multiple interactive objects,to receive, while playing the media file, an additional set of 3D maps, to detect, in the additional set of 3D maps, an additional grab gesture followed by an additional transverse gesture followed by a further grab gesture followed by an additional release gesture, to present one or more media controls in response to the additional grab gesture, to position a cursor in response to the additional transverse gesture, to identify, upon detecting the further grab gesture, one of the one or more media controls presented in proximity to the cursor, and to perform an operation associated with the one of the one or more media controls upon detecting the additional release gesture. 16. The apparatus according to claim 15, wherein each of the one or more media controls is selected from a list comprising a play and pause control, a seek control, a volume and mute control, a fast forward control, a rewind control, a next track control and a previous track control. 17. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a user interface, cause the computer to arrange multiple interactive objects as a hierarchical data structure, each node of the hierarchical data structure associated with a respective one of the multiple interactive objects, to present, on a display, a first subset of the multiple interactive objects that are associated with one or more child nodes of one of the multiple interactive objects, to receive a sequence of three-dimensional (3D) maps including at least part of a hand of a user positioned in proximity to a display coupled to the computer, to identify, in the sequence of three-dimensional (3D) maps, the hand performing a transverse gesture followed by a grab gesture followed by a longitudinal gesture followed by an execute gesture, to select, in response to the transverse gesture, one of the first subset of the multiple interactive objects, and, in response to the execute gesture, the longitudinal gesture and the execute gesture, to present, on the display, a second subset of the multiple interactive objects that are associated with one or more child nodes of the selected one of the first subset of the multiple interactive objects, wherein the execute gesture is selected from a list comprising a timeclick gesture, a release gesture and a subsequent transverse gesture.
Kazama Hisashi,JPX ; Onoguchi Kazunori,JPX ; Yuasa Mayumi,JPX ; Fukui Kazuhiro,JPX, Apparatus and method for controlling an electronic device with user action.
Zaman, Nazia; Garside, Adrian J.; Bush, Christopher T.; Barcheck, Lindsey R.; Leonard, Chantal M.; Satterfield, Jesse Clay, Application reporting in an application-selectable user interface.
Wee, Susie J.; Baker, Henry Harlyn; Bhatti, Nina T.; Covell, Michele; Harville, Michael, Communication and collaboration system using rich media environments.
Albertson, Jacob C.; Arnold, Kenneth C.; Goldman, Steven D.; Paolini, Michael A.; Sessa, Anthony J., Controlling resource access based on user gesturing in a 3D captured image stream of the user.
Cohen, Charles J.; Beach, Glenn; Cavell, Brook; Foulk, Gene; Jacobus, Charles J.; Obermark, Jay; Paul, George, Gesture-controlled interfaces for self-service machines and other applications.
Honda,Tadashi, Handwriting information processing apparatus, handwriting information processing method, and storage medium having program stored therein for handwriting information processing.
Wong, Tsz Yan; Satterfield, Jesse Clay; Sundelin, Nils A.; Anderson, Bret P.; Miner, Patrice L.; Sareen, Chaitanya Dev; Jarrett, Robert J.; Nan, Jennifer; Worley, Matthew I., Managing an immersive interface in a multi-application immersive environment.
Rushmeier, Holly E.; Bernardini, Fausto, Method and apparatus for acquiring a set of consistent image maps to represent the color of the surface of an object.
Lanier Jaron Z. (Palo Alto CA) Grimaud Jean-Jacques G. (Portola Valley CA) Harvill Young L. (San Mateo CA) Lasko-Harvill Ann (San Mateo CA) Blanchard Chuck L. (Palo Alto CA) Oberman Mark L. (Mountain, Method and system for generating objects for a multi-person virtual world using data flow networks.
Latypov Nurakhmed Nurislamovich,SUX ; Latypov Nurulla Nurislamovich,SUX, Method for tracking and displaying user's spatial position and orientation, a method for representing virtual reality for a user, and systems of embodiment of such methods.
Rafii, Abbas; Bamji, Cyrus; Sze, Cheng-Feng; Torunoglu, Iihami, Methods for enhancing performance and data acquired from three-dimensional image systems.
Zaman, Nazia; Flynn, Sean L.; Deutsch, Rebecca; Leonard, Chantal M.; Satterfield, Jesse Clay; Machaj, David A., Presenting an application change through a tile.
Bang, Won chul; Kim, Dong yoon; Chang, Wook; Kang, Kyoung ho; Choi, Eun seok, Spatial motion recognition system and method using a virtual handwriting plane.
Murray, Paul; Troy, James J.; Erignac, Charles A.; Wojcik, Richard H.; Finton, David J.; Margineantu, Dragos D., System and method for controlling swarm of remote unmanned vehicles through human gestures.
Bensoussan, Pierre; De Jaegere, Antoine, System and method for instant consolidation, enrichment, delegation and reporting in a multidimensional database.
MacIntyre, James W.; Scherer, David; Rosenthal, David Alan, System, method, and computer program product for processing and visualization of information.
Segawa,Hiroyuki; Hiraki,Norikazu; Shioya,Hiroyuki; Abe,Yuichi, Three-dimensional model processing device, three-dimensional model processing method, program providing medium.
Albertson, Jacob C.; Arnold, Kenneth C.; Goldman, Steven D.; Paolini, Michael A.; Sessa, Anthony J., Tracking a range of body movement based on 3D captured image streams of a user.
Backlund, Erik Johan Vendel; Bengtsson, Henrik; Heringslack, Henrik; Sassi, Jari; Thörn, Ola Karl; Åberg, Peter, User interface with three dimensional user input.
Ellenby, John; Ellenby, Thomas; Ellenby, Peter, Vision system computer modeling apparatus including interaction with real scenes with respect to perspective and spatial relationship as measured in real-time.
Chirakan, Jason; Hanthorn, Douglas; Herring, Dean F.; Singh, Ankit, Systems and methods for implementing retail processes based on machine-readable images and user gestures.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.