초록 ▼

A computer implemented method and system for gesture category recognition and training. Generally, a gesture is a hand or body initiated movement of a cursor directing device to outline a particular pattern in particular directions done in particular periods of time. The present invention allows a c

A computer implemented method and system for gesture category recognition and training. Generally, a gesture is a hand or body initiated movement of a cursor directing device to outline a particular pattern in particular directions done in particular periods of time. The present invention allows a computer system to accept input data, originating from a user, in the form gesture data that are made using the cursor directing device. In one embodiment, a mouse device is used, but the present invention is equally well suited for use with other cursor directing devices (e.g., a track ball, a finger pad, an electronic stylus, etc.). In one embodiment, gesture data is accepted by pressing a key on the keyboard and then moving the mouse (with mouse button pressed) to trace out the gesture. Mouse position information and time stamps are recorded. The present invention then determines a multi-dimensional feature vector based on the gesture data. The feature vector is then passed through a gesture category recognition engine that, in one implementation, uses a radial basis function neural network to associate the feature vector to a pre-existing gesture category. Once identified, a set of user commands that are associated with the gesture category are applied to the computer system. The user commands can originate from an automatic process that extracts commands that are associated with the menu items of a particular application program. The present invention also allows user training so that user-defined gestures, and the computer commands associated therewith, can be programmed into the computer system.

대표청구항 ▼

[ What is claimed is:] [1.]1. In an electronic system having a processor, a memory, unit, an alphanumeric input device and a cursor directing device, a method of providing a user interface comprising the computer implemented steps of:a) accessing gesture data representing a gesture formed by trackin

[ What is claimed is:] [1.]1. In an electronic system having a processor, a memory, unit, an alphanumeric input device and a cursor directing device, a method of providing a user interface comprising the computer implemented steps of:a) accessing gesture data representing a gesture formed by tracking movement of a cursor moved by a user with said cursor directing device, said gesture data comprising coordinate positions and timing information and having one or more individual strokes;b) generating a multi-dimensional feature vector based on said gesture data;c) providing said multi-dimensional feature vector to a radial basis function neural network for recognition, said radial basis function neural network associating said multi-dimensional feature vector with a gesture category from a predefined plurality of gesture categories and supplying said gesture category as an output value; andd) applying a set of predetermined commands to said electronic system, said set of predetermined commands being associated with said gesture category output from said radial basis function neural network.