초록 ▼

A method of accepting multimedia operation commands wherein, while pointing to either of a display object or a display position on a display screen of a graphics display system through a pointing input device, a user commands the graphics display system to cause an event on a graphics display, throu

A method of accepting multimedia operation commands wherein, while pointing to either of a display object or a display position on a display screen of a graphics display system through a pointing input device, a user commands the graphics display system to cause an event on a graphics display, through a voice input device; comprising a first step of allowing the user to perform the pointing gesture so as to enter a string of coordinate points which surround one area for either of the display object and any desired display position; a second step of allowing the user to give the voice command together with the pointing gesture; a third step of recognizing a command content of the voice command by a speech recognition process in response to the voice command; a fourth step of recognizing a command content of the pointing gesture in accordance with the recognized result of the third step; and a fifth step of executing the event on the graphics display in accordance with the command contents of the voice command and the pointing gesture. Thus, the method provides a man-machine interface which utilizes the plurality of media of the voice and the pointing gesture, which offers a high operability to the user, and with which an illustration etc. can be easily edited.

대표청구항 ▼

A method of accepting multimedia operation commands wherein, while pointing to either of a display object and a display position on a display screen of a graphics display system through a pointing input device, a user commands the graphics display system to cause an event on a graphics display, thro

A method of accepting multimedia operation commands wherein, while pointing to either of a display object and a display position on a display screen of a graphics display system through a pointing input device, a user commands the graphics display system to cause an event on a graphics display, through a voice input device; comprising: a first step of allowing the user to enter a string of coordinate points which surround one area for either of the display object or any desired display position by performing a pointing gesture along the string of coordinate points; a second step of allowing said user to give a voice command together with said pointing gesture; a third step of recognizing a command content of said voice command by a speech recognition process in response to said voice command; a fourth step of recognizing a command content of said pointing gesture in accordance with a recognized result of said third step; and a fifth step of executing the event on the graphics display in accordance with the command contents of said voice command and said pointing gesture.