Free-space multi-dimensional absolute pointer using a projection marker system
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G09G-005/00
G06F-003/042
출원번호
US-0777073
(2007-07-12)
등록번호
US-8913003
(2014-12-16)
발명자
/ 주소
Grunnet-Jepsen, Anders
Sweetser, John
Salsman, Kenneth
출원인 / 주소
Thinkoptics, Inc.
대리인 / 주소
Blakely, Sokoloff, Taylor & Zafman LLP
인용정보
피인용 횟수 :
5인용 특허 :
188
초록▼
Methods and apparatuses for a free-space multi-dimensional absolute pointer using a projection marker system are described herein. In one embodiment, a presentation system includes, but is not limited to, a projection-based marker apparatus to project one or more optical spots on a display surface f
Methods and apparatuses for a free-space multi-dimensional absolute pointer using a projection marker system are described herein. In one embodiment, a presentation system includes, but is not limited to, a projection-based marker apparatus to project one or more optical spots on a display surface for displaying machine generated content capable of being manipulated via a cursor of a pointing device, a handheld device to wirelessly capture the projected optical spots from the display surface, and a control unit communicatively coupled to the projection-based marker apparatus and the handheld device to determine coordinates of the cursor based on characteristics of the captured light spots. Other methods and apparatuses are also described.
대표청구항▼
1. A machine-implemented method, comprising: capturing an image of two or more spatially fixed optical spots projected onto a display surface, the display surface displaying machine generated content capable of being manipulated via a cursor of a pointing device, wherein the images of the two or mor
1. A machine-implemented method, comprising: capturing an image of two or more spatially fixed optical spots projected onto a display surface, the display surface displaying machine generated content capable of being manipulated via a cursor of a pointing device, wherein the images of the two or more optical spots is captured wirelessly using a handheld device representing the pointing device for which the optical spots serve as reference markers; andgenerating in the handheld device separate image data for each of the two or more spots within the image;processing in the handheld device the separate image data for each of the spots within the image to generate coordinate data for each of the spots within the image;wherein processing the image data further comprises:determining an intensity value for each of a plurality of pixels of the pixelated sensor;identifying a set of pixels in which each pixel has an intensity value above a specified threshold;generating coordinate data based on the intensity value and the location of each of the pixels in the set of pixels;transmitting from the handheld device the coordinate data derived from the processing of the image data;wherein a position of the cursor of the pointing device displayed on the display surface is determined and actively controlled based on the coordinate data transmitted from the handheld device. 2. The method of claim 1, wherein the two or more optical spots are projected from an apparatus from which the machine generated content is projected. 3. The method of claim 2, further comprising in response to the coordinate data of the handheld device in view of the captured images of the optical spots received from the handheld device, calculating the coordinates of the cursor based on the coordinate data of the handheld device in view of the position of the two or more optical spots. 4. The method of claim 3, further comprising displaying a cursor on the display surface at a position based on the calculated coordinates of the cursor. 5. The method of claim 4, wherein the projection apparatus is configured to wirelessly receive the coordinate data from the handheld device and to calculate the coordinates of the cursor. 6. The method of claim 4, wherein the projection apparatus is physically separated from wireless receiving electronics that receive the coordinates of the handheld device and calculate the coordinates of the cursor such that the projection apparatus and receiving electronics may be housed in distinct locations from each other and the display surface. 7. The method of claim 2, wherein the projection apparatus comprises one or more coherent sources of optical radiation. 8. The method of claim 2, wherein the projection apparatus comprises one or more incoherent sources of optical radiation. 9. The method of claim 1, wherein the two or more optical spots are displayed according to a predetermined optical frequency such that the two or more optical spots are invisible to a user looking at the display surface. 10. The method of claim 1, wherein the image of the two or more optical spots is captured using a camera embedded within the handheld device. 11. The method of claim 1, further comprising calibrating initial coordinates of the handheld device by pointing the handheld device to one or more predetermined locations within or near a display area in view of positions of the two or more optical spots. 12. A non-propagating machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform a method, the method comprising: Capturing an image of two or more spatially fixed optical spots projected onto a display surface, the display surface displaying machine generated content capable of being manipulated via a cursor of a pointing device, wherein the images of the two or more optical spots is captured wirelessly using a handheld device representing the pointing device for which the optical spots serve as reference markers; andgenerating in the handheld device separate image data for each of the two or more spots within the image;processing in the handheld device the separate image data for each of the spots within the image to generate coordinate data for each of the spots within the image;wherein processing the image data further comprises:determining an intensity value for each of a plurality of pixels of the pixelated sensor;identifying a set of pixels in which each pixel has an intensity value above a specified threshold;generating coordinate data based on the intensity value and the location of each of the pixels in the set of pixels;transmitting from the handheld device the coordinate data derived from the processing of the image data;wherein a position of the cursor of the pointing device displayed on the display surface is determined and actively controlled based on the coordinate data transmitted from the handheld device. 13. The machine-readable medium of claim 12, wherein the two or more optical spots are projected from an apparatus from which the machine generated content is projected. 14. The machine-readable medium of claim 13, wherein the method further comprises in response to the coordinate data of the handheld device in view of the captured images of the optical spots received from the handheld device, calculating the coordinates of the cursor based on the coordinates data of the handheld device in view of the position of the two or more optical spots. 15. The machine-readable medium of claim 14, wherein the method further comprises displaying a cursor on the display surface at a position based on the calculated coordinates of the cursor. 16. The machine-readable medium of claim 15, wherein the projection apparatus is configured to wirelessly receive the coordinate data from the handheld device and to calculate the coordinates of the cursor. 17. The machine-readable medium of claim 16, wherein the projection apparatus is physically separated from wireless receiving electronics that receive the coordinates of the handheld device and calculate the coordinates of the cursor such that the projection apparatus and receiving electronics may be housed in distinct locations from each other and the display surface. 18. The machine-readable medium of claim 15, wherein the projection apparatus comprises one or more coherent sources of optical radiation. 19. The machine-readable medium of claim 15, wherein the projection apparatus comprises one or more incoherent sources of optical radiation. 20. The machine-readable medium of claim 12, wherein the two or more optical spots are displayed according to a predetermined optical frequency such that the two or more optical spots are invisible to a user looking at the display surface. 21. The machine-readable medium of claim 12, wherein the image of the two or more optical spots is captured using a camera embedded within the handheld device. 22. The machine-readable medium of claim 12, wherein the method further comprises calibrating initial coordinates of the handheld device by pointing the handheld device to one or more predetermined locations within a display area in view of positions of the two or more optical spots. 23. A presentation system comprising: a projection apparatus to project two or more spatially fixed optical spots on a display surface for displaying machine generated content capable of being manipulated via a cursor of a pointing device;a handheld device representing the pointing device to wirelessly capture an images of each of the two or more optical spots projected onto the display surface, the optical spots serving as reference markers for the pointing device;the handheld device further adapted to generate separate image data for each of the two or more spots within the image, process the separate image data for each image to generate coordinate data for each spots within the image, and transmit from the handheld device the coordinate data derived from the processing of the image data; wherein processing the image data for each image further comprises: determining an intensity value for each of a plurality of pixels of the pixelated sensor;identifying a set of pixels in which each pixel has an intensity value above a specified threshold; andgenerating coordinate data based on the intensity value and the location of each of the pixels in the set of pixels; anda control unit communicatively coupled to the projection apparatus and the handheld device to determine and actively control a position of the cursor based on the coordinate data transmitted from the handheld device. 24. The system of claim 23, wherein the two or more optical spots are projected in a predetermined optical frequency such that the two or more optical spots are invisible to a user of the display surface. 25. The system of claim 24, wherein the handheld device comprises a camera to capture an image of each of the two or more optical spots.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (188)
Liberty,Matthew G., 3D pointing devices with orientation compensation and improved usability.
Fenner David F. (2 Bishops Green Barnston Great Dunmow Essex GBX) Menown John S. (Stoke House ; Roxwell Road Writtle Essex GBX), A remotely controllable position indicator system.
Tobey Chris E. (Seattle WA) Shih Yung-Ho (Bellevue WA) Robin Michael B. (Redmond WA) Rupel Wesley O. (Bellevue WA) Edwards Michael D. (Redmond WA) Spies Terence R. (Redmond WA) Bovee ; Jr. James C. (, Apparatus and method for controlling cursor movement.
DeMenthon Daniel F. (Columbia MD), Computer vision system for position monitoring in three dimensions using non-coplanar light sources attached to a monito.
Katsuyuki Omura JP; Kunikazu Tsuda JP; Makoto Tanaka JP, Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system.
Joseph Alexander Dara-Abrams ; Harold Aaron Ludtke ; Thomas Edward Birmingham ; Neil David Matthews GB; Yoshifumi Yanagawa JP; Wim Bronnenberg NL, Data driven interaction for networked control of a DDI target device over a home entertainment network.
McSheery Tracy D. ; Black John R. ; Nollet Scott R. ; Johnson Jack L. ; Jivan Vinay C., Distributed-processing motion tracking system for tracking individually modulated light points.
Nakayama Norio,JPX ; Nanba Kazuhiro,JPX ; Yamaoka Masatoshi,JPX ; Naito Satoko,JPX, Game system for displaying a predicted position to take a given action against an object.
Himeda, Satoshi; Kintou, Yasuhisa, Image processing apparatus and system executing predetermined image processing on image data shot by camera, and image recording medium recorded with image processing program.
Marshall Roger N. (Solana Beach CA) Hauck Lane T. (San Diego CA) Shapiro Leonid (Lakeside CA) Busch Jeffrey W. (San Diego CA) Stevens Eric S. (El Cajon CA), Method and apparatus for calibrating an optical computer input system.
Hinckley, Kenneth P.; Sinclair, Michael J.; Szeliski, Richard S.; Conway, Matthew J.; Hanson, Erik J., Method and apparatus for computer input using six degrees of freedom.
Klapman Matthew H. (9235 N. Menard Morton Grove IL 60053) Frerichs David J. (877 Heatherstone Way #308 Mountain View CA 94040), Method for determining an orientation of an object.
Wataru Ito JP; Hirotada Ueda JP; Hiromasa Yamada JP, Method of distinguishing a moving object and apparatus of tracking and monitoring a moving object.
Marshall Roger N. (Solana Beach CA) Lizon Richard M. (Escondido CA) Hauck Lane T. (San Diego CA), Optical auxiliary input arrangement and method of using same.
Ogawa Yasuji (Saitama JPX) Yoichi Hideo (Saitama JPX), Optical position detecting unit, optical coordinate input unit and optical position detecting method employing a pattern.
Manns William G. (Dallas TX) Weeks Don J. (Southlake TX) Merryman Jerry D. (Dallas TX) Sheng Chyi N. (Richardson TX), Position compensation of laser scan for stage movement.
Mackintosh Gregory B. ; Kim Mike H. ; Price Edwin C. ; Stojakovic Edward C., Presenting supplemental information for material currently and previously broadcast by a radio station.
Hendriks,Ferdinand; Shae,Zon Yin; Tseng,Belle L.; Wang,Xiping, Projector and camera arrangement with shared optics and optical marker for use with whiteboard systems.
Marks, Richard L., Prop input device and method for mapping an object from a two-dimensional camera image to a three-dimensional space for controlling action in a game program.
Honey Stanley K. ; Cavallaro Richard H. ; O'Brien Terence J. ; Heidmann Timothy P. ; Olsen Patrick W. ; Gloudemans James R., System for displaying an object that is not visible to a camera.
Pittel,Arkady; Schiller,Ilya; Liberman,Sergey; Shleppi,Garry; Funk,Ethan A.; Subach,Vladimir V.; Goldman,Andrew M.; Reznik,Leonid; Selitsky,Simon; Stein,Mario A., Tracking motion of a writing instrument.
Jack, William E.; Schildkraut, Ira; Menin, Julie Forney, Use of site-specific nicking endonucleases to create single-stranded regions and applications thereof.
Oishi, Toshimitsu; Okubo, Toru; Domitsu, Hideyuki; Yamano, Tomoya, Video game apparatus, method and recording medium storing program for controlling viewpoint movement of simulated camera in video game.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.