Computer interface for manipulated objects with an absolute pose detection component
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-003/01
G01B-021/04
G06F-003/03
G06F-003/0346
G06F-003/0354
G06F-003/0481
G06K-009/22
G02B-027/01
G06T-019/00
A63F-013/20
A63F-013/428
A63F-013/211
A63F-013/213
A63F-013/812
G06F-003/0484
G06T-007/73
출원번호
US-0914797
(2018-03-07)
등록번호
US-10191559
(2019-01-29)
발명자
/ 주소
Mandella, Michael J.
Gonzalez-Banos, Hector H.
Alboszta, Marek
출원인 / 주소
Electronic Scripting Products, Inc.
대리인 / 주소
Alboszta, Marek
인용정보
피인용 횟수 :
0인용 특허 :
216
초록▼
A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including
A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including full pose, in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector. The manipulated object can be embodied by any suitable device manipulated by a user, including a tablet computer or a phone.
대표청구항▼
1. A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said manipulated object comprising: a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector
1. A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said manipulated object comprising: a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features;b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector; andc) at least one component selected from the group consisting of an auxiliary motion detection component, an active illumination component and a scanning component. 2. The manipulated object of claim 1, wherein said first plurality of high optical contrast features are invariant features within said real three-dimensional environment. 3. The manipulated object of claim 2, wherein said invariant features are disposed in a known pattern within said real three-dimensional environment. 4. The manipulated object of claim 1, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration, detection of features in images and motion analysis. 5. The manipulated object of claim 4, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry. 6. The manipulated object of claim 1, wherein said manipulated object is selected from the group consisting of a pointer, a wand, a remote control, a three-dimensional mouse, a game control, a gaming object, a jotting implement, a surgical implement, a three-dimensional digitizer, a digitizing stylus, a hand-held tool, a utensil, a phone, a tablet computer, a portable device, an ultra-mobile device, a PDA and a smart object. 7. The manipulated object of claim 6 deployed in an application selected from the group consisting of virtual reality and augmented reality. 8. The manipulated object of claim 1, wherein said auxiliary motion detection component is selected from the group consisting of accelerometers, gyroscopes, magnetic sensing elements, acoustic sensors and optical flow measuring units. 9. The manipulated object of claim 1, wherein said photodetector is selected from the group consisting of optical sensors, CCD sensors, CMOS sensors, sensors with an array of pixels and position-sensitive diodes. 10. A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said manipulated object comprising: a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features;b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the orientation of said photodetector; andc) at least one component selected from the group consisting of an auxiliary motion detection component, an active illumination component and a scanning component. 11. The manipulated object of claim 10, wherein said first plurality of high optical contrast features are invariant features within said real three-dimensional environment. 12. The manipulated object of claim 11, wherein said invariant features are disposed in a known pattern within said real three-dimensional environment. 13. The manipulated object of claim 10, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration, detection of features in images and motion analysis. 14. The manipulated object of claim 13, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry. 15. The manipulated object of claim 10, wherein said manipulated object is selected from the group consisting of a pointer, a wand, a remote control, a three-dimensional mouse, a game control, a gaming object, a jotting implement, a surgical implement, a three-dimensional digitizer, a digitizing stylus, a hand-held tool, a utensil, a phone, a tablet computer, a portable device, an ultra-mobile device, a PDA and a smart object. 16. The manipulated object of claim 15, deployed in an application selected from the group consisting of virtual reality and augmented reality. 17. The manipulated object of claim 10, wherein said auxiliary motion detection component is selected from the group consisting of accelerometers, gyroscopes, magnetic sensing elements, acoustic sensors and optical flow measuring units. 18. The manipulated object of claim 10, wherein said photodetector is selected from the group consisting of optical sensors, CCD sensors, CMOS sensors, sensors with an array of pixels and position-sensitive diodes. 19. A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said manipulated object comprising: a) an on-board photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features;b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the pose of said photodetector; andc) at least one component selected from the group consisting of an auxiliary motion detection component, an active illumination component and a scanning component. 20. The manipulated object of claim 19, wherein said first plurality of high optical contrast features are invariant features within said real three-dimensional environment. 21. The manipulated object of claim 20, wherein said invariant features are disposed in a known pattern within said real three-dimensional environment. 22. The manipulated object of claim 19, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration, detection of features in images and motion analysis. 23. The manipulated object of claim 22, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry. 24. The manipulated object of claim 19, wherein said manipulated object is selected from the group consisting of a pointer, a wand, a remote control, a three-dimensional mouse, a game control, a gaming object, a jotting implement, a surgical implement, a three-dimensional digitizer, a digitizing stylus, a hand-held tool, a utensil, a phone, a tablet computer, a portable device, an ultra-mobile device, a PDA and a smart object. 25. The manipulated object of claim 24, deployed in an application selected from the group consisting of virtual reality and augmented reality. 26. The manipulated object of claim 19, wherein said auxiliary motion detection component is selected from the group consisting of accelerometers, gyroscopes, magnetic sensing elements, acoustic sensors and optical flow measuring units. 27. The manipulated object of claim 19, wherein said on-board photodetector is selected from the group consisting of optical sensors, CCD sensors, CMOS sensors, sensors with an array of pixels and position-sensitive diodes.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (216)
Cipolla Roberto (Cambridge GBX) Okamoto Yasukazu (Chiba-ken JPX) Kuno Yoshinori (Osaka-fu JPX), 3D human interface apparatus using motion recognition based on dynamic image processing.
Nakadaira, Atsushi; Suzuki, Naobumi; Ochi, Daisuke, 3D pointing method, 3D display control method, 3D pointing device, 3D display control device, 3D pointing program, and 3D display control program.
Buermann,Dale H.; Gonzalez Banos,Hector H.; Mandella,Michael J.; Carl,Stewart R., Apparatus and method for determining an inclination of an elongate object contacting a plane surface.
Roberts Andrew F. (Charlestown MA) Sachs Emanuel M. (Somerville MA) Stoops David R. (Cambridge MA) Ulrich Karl T. (Belmont MA) Siler Todd L. (Cambridge MA) Gossard David C. (Andover MA) Celniker Geor, Computer aided drawing in three dimensions.
Mandella, Michael J.; Gonzalez-Banos, Hector H.; Alboszta, Marek, Computer interface employing a manipulated object with absolute pose detection component and a display.
Mandella, Michael J.; Gonzalez-Banos, Hector H.; Alboszta, Marek, Computer interface employing a wearable article with an absolute pose detection component.
Yutaka Usuda JP; Ichirou Takeuchi JP; Sueo Amemiya JP; Jun Namiki JP; Naoki Miyauchi JP, Coordinate input pen, and electronic board, coordinate input system and electronic board system using the coordinate input pen.
Katsuyuki Omura JP; Kunikazu Tsuda JP; Makoto Tanaka JP, Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system.
Katsuyuki Omura JP; Takao Inoue JP, Coordinate position inputting/detecting device, a method for inputting/detecting the coordinate position, and a display board system.
Teufel Thomas,DEX ; Keller Gerhard,DEX, Data acquisition device for optical detection and storage of visually marked and projected alphanumerical characters, graphics and photographic picture and/or three dimensional topographies.
Fagin, Ronald; Megiddo, Nimrod; Morris, Robert John Tasman; Rosen, Hal Jervis; Rajagopalan, Sridhar; Zimmerman, Thomas Guthrie, Digital pen using speckle tracking.
McSheery Tracy D. ; Black John R. ; Nollet Scott R. ; Johnson Jack L. ; Jivan Vinay C., Distributed-processing motion tracking system for tracking individually modulated light points.
Kimber, Donald G.; Guo, Feng; Rieffel, Eleanor G.; Murai, Kazumasa; Omohundro, Stephen, Featured wands for camera calibration and as a gesture based 3D interface device.
Chris Dominick Kasabach ; John Michael Stivoric ; Francine Duskey Gemperle ; Christopher Pacione ; Eric Teller, Handheld apparatus for recognition of writing, for remote communication, and for user defined input templates.
Grajski Kamil A. (San Jose CA) Chow Yen-Lu (Saratoga CA) Lee Kai-Fu (Saratoga CA), Handwriting signal processing front-end for handwriting recognizers.
Baron Ehud (Haifa ILX) Prishvin Alexander (Jerusalem ILX) Bar-Itzhak Zeev (Haifa ILX) Korsensky Victor (Haifa ILX), Handwritting input apparatus for handwritting recognition using more than one sensing technique.
Carl,Stewart R.; Alboszta,Marek; Mandella,Michael J.; Gonzalez,Hector H; Hawks,Timothy, Implement for optically inferring information from a jotting surface and environmental landmarks.
Foxlin Eric M. (Cambridge MA), Inertial orientation tracker apparatus having automatic drift compensation for tracking human head and other similarly s.
Akira Morishita JP; Hiroshi Mizoguchi JP, Information input device, position information holding device, and position recognizing system including them.
Aoyagi Tetsuji (Kanagawa JPX) Miura Takeshi (Aomori JPX) Suzuki Hajime (Kanagawa JPX) Sanchez Russell I. (Seattle WA) Svancarek Mark K. (Redmond WA) Suzuki Toru (Kanagawa JPX) Paull Mike M. (Seattle , Input device for providing multi-dimensional position coordinate signals to a computer.
Howell David N. L. (Anel Gate ; Jubillee Drive Colwall ; Malvern ; Worcestershire WR13 6DQ GB2) Hilton Colin S. (20 Harrier House ; Falcon Road Battersea - London SW11 2NW GB2) Bridle John S. (14 Cra, Method and apparatus for capturing information in drawing or writing.
Hinckley, Kenneth P.; Sinclair, Michael J.; Szeliski, Richard S.; Conway, Matthew J.; Hanson, Erik J., Method and apparatus for computer input using six degrees of freedom.
Buermann,Dale H.; Mandella,Michael J.; Carl,Stewart R.; Zhang,Guanghua G.; Gonzalez Banos,Hector H., Method and apparatus for determining absolute position of a tip of an elongate object on a plane surface with invariant features.
Horton Mike A. (Berkeley CA) Newton A. Richard (Woodside CA), Method and apparatus for determining position and orientation of a moveable object using accelerometers.
Dolfing Jannes G. A.,NLX ; Hab-Umbach Reinhold,DEX, Method and apparatus for on-line handwriting recognition based on feature vectors that use aggregated observations derived from time-sequential frames.
Kasabach, Chris Dominick; Stivoric, John Michael; Gemperle, Francine Duskey; Pacione, Christopher; Teller, Eric, Method and apparatus for recognition of writing, for remote communication, and for user defined input templates.
Martin Roy W. (Redmond WA) Hatangadi Ram B. (Seattle WA) Bashein Gerard (Seattle WA), Method and apparatus for three-dimensional translumenal ultrasonic imaging.
Stork David G. ; Angelo Michael ; Wolff Gregory J., Method and apparatus for tracking a hand-held writing instrument with multiple sensors that are calibrated by placing the writing instrument in predetermined positions with respect to the writing sur.
Lanier Jaron Z. (Palo Alto CA) Grimaud Jean-Jacques G. (Portola Valley CA) Harvill Young L. (San Mateo CA) Lasko-Harvill Ann (San Mateo CA) Blanchard Chuck L. (Palo Alto CA) Oberman Mark L. (Mountain, Method and system for generating objects for a multi-person virtual world using data flow networks.
Smithies Christopher P. K. (Wimborne GB2) Newman Jeremy M. (Somerset GB2), Method and system for the capture, storage, transport and authentication of handwritten signatures.
Smithies Christopher Paul Kenneth (Corfe Mullen ; Wimborne GB2) Newman Jeremy Mark (Frome ; Somerset GB2), Method and system for the verification of handwritten signatures.
Bi Depeng ; Cohen Gary Steven ; Cortopassi Michael ; George Jose T. ; Gladwin S. Christopher ; Hsiung Harry ; Lim Peng ; Parham John Allan ; Soucy Alan Joseph ; Voegeli Derick W. ; Wilson James Y., Mouse emulation with a passive pen.
Wright ; Jr. ; Sanford J. ; Anderson ; Peter T. ; Grimes ; Ralph S., Multi-modal data input/output apparatus and method compatible with bio-engineering requirements.
Krouglicof Nicholas (Montreal West CAX) McKinnon Gordon M. (Montreal CAX) Svoboda Jaroslav (Hudson Heights CAX), Optical position and orientation measurement techniques.
Sontag Heinz (Friedrichshafen DEX) Elias Hartmut (Meersburg DEX) Ludwig Wolfgang (Taegerwilen CHX) Fritzsch Walter (Markdorf DEX) Eschner Wolfgang (Daisendorf DEX) Hundhausen Rainer (Immenstaad DEX) , Optical position detection.
Lazzouni Mohamed (Worcester MA) Kazeroonian Ali Seyed (Framingham MA) Gholizadeh Dariush (Framingham MA) Ali Omar (Roslindale MA 4), Pen and paper information recording system.
Lazzouni Mohamed (Worcester MA) Yousaf Mohamed (Shrewsbury MA) Qureshi Rizwan A. (Worcester MA) Nazir Naveed A. (Shrewsbury MA), Pen and paper information recording system using an imaging pen.
Nam, Dong-kyung; Yoo, Ho-joon; Cho, Woo-jong; Jeong, Moon-sik; Kim, Chang-su; Hong, Sun-gi; Park, Yong-gook; Shim, Jung-hyun, Pointing input device, method, and system using image pattern.
Ohta, Keizo, Position calculation apparatus, storage medium storing position calculation program, game apparatus, and storage medium storing game program.
Carl, Stewart R.; Mandella, Michael J.; Zhang, Guanghua G.; Gonzalez-Banos, Hector H., Processing pose data derived from the pose of an elongate object.
Hotelling, Steven Porter; King, Nicholas Vincent; Kerr, Duncan Robert; Low, Wing Kong, Remote control systems that can distinguish stray light sources.
Hotelling, Steven Porter; King, Nicholas Vincent; Kerr, Duncan Robert; Low, Wing Kong, Remote control systems that can distinguish stray light sources.
Tuceryan, Mihran; Navab, Nassir; Genc, Yakup, System and method for calibrating a stereo optical see-through head-mounted display system for augmented reality.
Horvitz Eric J. ; Markley Michael E. ; Sonntag Martin L., System and method for resizing an input position indicator for a user interface of a computer system.
Pittel,Arkady; Schiller,Ilya; Liberman,Sergey; Shleppi,Garry; Funk,Ethan A.; Subach,Vladimir V.; Goldman,Andrew M.; Reznik,Leonid; Selitsky,Simon; Stein,Mario A., Tracking motion of a writing instrument.
Skurnik, David; Sprague, Randall Brian; Jones, Geoffrey Hugh; Abbott, Eric Charles; Law, Waisiu, Very high speed photodetector system using a PIN photodiode array for position sensing.
Paull Mike M. ; Sanchez Russell I. ; Svancarek Mark K. ; Aoyagi Tetsuji,JPX, Wireless input device, for use with a computer, employing a movable light-emitting element and a stationary light-receiv.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.