초록 ▼

An input interface system provides gesture-based user control of an application running on a computer by classification of user gestures in image signals. A given one of the image signals is processed to determine if it contains one of a number of designated user gestures, e.g., a point gesture, a r

An input interface system provides gesture-based user control of an application running on a computer by classification of user gestures in image signals. A given one of the image signals is processed to determine if it contains one of a number of designated user gestures, e.g., a point gesture, a reach gesture and a click gesture, each of the gestures being translatable to a particular control signal for controlling the application. If the image signal is determined to contain a point gesture, further processing is performed to determine position and orientation information for a pointing finger of a hand of the user and its corresponding shadow. The position and orientation information for the pointing finger and its shadow are then utilized to generate a three-dimensional pose estimate for the pointing figure in the point gesture. For example, the three-dimensional pose estimate may be in the form of a set of five parameters (X, Y, Z, α, ε), where (X, Y, Z) denotes the position of a tip of the pointing finger in three-dimensional space, and (α, ε) denotes the respective azimuth and elevation angles of an axis of the pointing finger. The point gesture can thus be used to provide user control in virtual flight simulators, graphical editors, video games and other applications.

대표청구항 ▼

An input interface system provides gesture-based user control of an application running on a computer by classification of user gestures in image signals. A given one of the image signals is processed to determine if it contains one of a number of designated user gestures, e.g., a point gesture, a r

An input interface system provides gesture-based user control of an application running on a computer by classification of user gestures in image signals. A given one of the image signals is processed to determine if it contains one of a number of designated user gestures, e.g., a point gesture, a reach gesture and a click gesture, each of the gestures being translatable to a particular control signal for controlling the application. If the image signal is determined to contain a point gesture, further processing is performed to determine position and orientation information for a pointing finger of a hand of the user and its corresponding shadow. The position and orientation information for the pointing finger and its shadow are then utilized to generate a three-dimensional pose estimate for the pointing figure in the point gesture. For example, the three-dimensional pose estimate may be in the form of a set of five parameters (X, Y, Z, α, ε), where (X, Y, Z) denotes the position of a tip of the pointing finger in three-dimensional space, and (α, ε) denotes the respective azimuth and elevation angles of an axis of the pointing finger. The point gesture can thus be used to provide user control in virtual flight simulators, graphical editors, video games and other applications. . Feigenblatt, R.I., "Full-color Imaging on amplitude-quantized color mosaic displays" Digital Image Processing Applications SPIE vol. 1075 (1989) pp. 199-205. Gille, J. et al. "Grayscale/Resolution Tradeoff for Text: Model Predictions" Final Report, Oct. 1992-Mar. 1995. Gould, J.D. et al. "Reading From CRT Displays Can Be as Fast as Reading From Paper" Human Factors, vol. 29 No. 5, pp. 497-517, Oct. 1987. Gupta, S. et al. "Anti-Aliasing Characters Displayed by Text Terminals" IBM Technical Disclosure Bulletin, May 1983 pp. 6434-6436. Hara, Z. et al. "Picture Quality of Different Pixel Arrangements for Large-Sized Matrix Displays" Electronics and Communications in Japan, Part 2, vol. 77, No. 7, 1974, pp. 105-120. Kajiya, J. et al. "Filtering High Quality Text For Display on Raster Scan Devices" Computer Graphics, vol. 15, No. 3, Aug. 1981, pp. 7-15. Kato, Y. et al. "13:2 A Fourier Analysis of CRT Displays Considering the Mask Structure, Beam Spot Size, and Scan Pattern" (c) 1998 SID. Krantz, J. et al. "Color Matrix Display Image Quality: The Effects of Luminance and Spatial Sampling" SID 90 Digest, pp. 29-32. Kubala, K. et al. "27:4: Investigation Into Variable Addressability Image Sensors and Display Systems" 1998 SID. Mitchell, D.P. "Generating Antialiased Images at Low Sampling Densities" Computer Graphics, vol. 21, No. 4, Jul. 1987, pp. 65-69. Mitchell, D.P. et al., "Reconstruction Filters in Computer Graphics", Computer Graphics, vol. 22, No. 4, Aug. 1988, pp. 221-228. Morris R.A., et al. "Legibility of Condensed Perceptually-tuned Grayscale Fonts" Electronic Publishing, Artistic Imaging, and Digital Typography, Seventh International Conference on Electronic Publishing, Mar. 30-Apr. 3, 1998, pp. 281-293. Murch, G. et al. "7.1: Resolution and Addressability: How Much is Enough?" SID 85 Digest, pp. 101-103. Naiman, A., "Some New Ingredients for the Cookbook Approach to Anti-Aliased Text" Proceedings Graphics Interface 81, Ottawa, Ontario, May 28-Jun. 1, 1984, pp. 99-108. Naiman, A, et al. "Rectangular Convolution for Fast Filtering of Characters" Computer Graphics, vol. 21, No. 4, Jul. 1987, pp. 233-242. Naiman, A.C. "10:1 The Visibility of Higher-Level Jags" SID 95 Digest pp. 113-116. Peli, E. "35.4: Luminance and Spatial-Frequency Interaction in the Perception of Contrast", SID 96 Digest. Pringle, A., "Aspects of Quality in the Design and Production of Text", Association of Computer Machinery 1979, pp. 63-70. Rohellec, J. Le et al. "35.2: LCD Legibility Under Different Lighting Conditions as a Function of Character Size and Contrast" SID 96 Digest. Schmandt, C. "Soft Typography" Information Processing 80, Proceedings of the IFIP Congress 1980, pp. 1027-1031. Sheedy, J.E. et al. "Reading Performance and Visual Comfort with Scale to Grey Compared with Black-and-White Scanned Print" Displays, vol. 15, No. 1, 1994, pp. 27-30. Sluyterman, A.A.S. "13:3 A Theoretical Analysis and Empirical Evaluation of the Effects of CRT Mask Structure on Character Readability" (c) 1998 SID. Tung. C., "Resolution Enhancement Technology in Hewlett-Packard LaserJet Printers" Proceedings of the SPIE--The International Society for Optical Engineering, vol. 1912, pp. 440-448. Warnock, J.E. "The Display of Characters Using Gray Level Sample Arrays", Association of Computer Machinery, 1980, pp. 302-307. Whitted, T. "Anti-Aliased Line Drawing Using Brush Extrusion" Computer Graphics, vol. 17, No. 3, Jul. 1983, pp. 151,156. Yu, S., et al. "43:3 How Fill Factor Affects Display Image Quality" (c) 1998 SID. "Cutting Edge Display Technology--The Diamond Vision Difference" www.amasis.com/diamondvision/technical.html, Jan. 12, 1999. "Exploring the Effect of Layout on Reading from Screen" http://fontweb/internal/repository/research/explore.asp?RES=ultra, 10 pages, Jun. 3, 1998. "How Does Hinting Help?" http://www.microsoft.com/typography/hinting/how.htm/fname=%20&fsize, Jun. 30, 1997. "Legibility on screen: A report on research in