Wearable computer with superimposed controls and instructions for external device
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G09G-005/00
G06F-001/16
G02B-027/01
G06F-003/01
G06F-003/14
출원번호
US-0238557
(2011-09-21)
등록번호
US-8941560
(2015-01-27)
발명자
/ 주소
Wong, Adrian
Miao, Xiaoyu
출원인 / 주소
Google Inc.
대리인 / 주소
McDonnell Boehnen Hulbert & Berghoff LLP
인용정보
피인용 횟수 :
12인용 특허 :
50
초록▼
A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device d
A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.
대표청구항▼
1. A method comprising: determining that a controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein the HMD provides a field of view in which at least a portion of the environment is viewable, and wherein the HMD is operable
1. A method comprising: determining that a controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein the HMD provides a field of view in which at least a portion of the environment is viewable, and wherein the HMD is operable to display images superimposed over the field of view;obtaining target device information related to the controllable target device, wherein the target device information defines a virtual control interface for controlling the controllable target device and identifies a defined area of the controllable target device on which the virtual control interface is to be provided, wherein the target device information further includes status information related to an operational status of the controllable target device;controlling the HMD to display the virtual control interface as an image superimposed over the defined area of the controllable target device in the field of view and to display an indication of the operational status of the controllable target device;recognizing a gesture corresponding to interaction with the virtual control interface superimposed over the defined area of the controllable target device;recognizing a control instruction for the controllable target device based on the recognized gesture; andtransmitting the recognized control instruction to the controllable target device. 2. The method of claim 1, wherein the wearable computing device further comprises a camera configured to obtain images from a point-of-view. 3. The method of claim 2, wherein the point-of-view of the camera substantially corresponds to the field of view provided by the HMD. 4. The method of claim 2, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: receiving a point-of-view image obtained by the camera; andidentifying the controllable target device in the point-of-view image. 5. The method of claim 4, wherein the point-of-view image is a video image. 6. The method of claim 1, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: receiving a beacon from the controllable target device. 7. The method of claim 1, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: recognizing a radio frequency identification (RFID) tag on the controllable target device. 8. The method of claim 1, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: recognizing an optical identification on the controllable target device. 9. The method of claim 8, wherein the optical identification is a barcode or a quick response (QR) code. 10. The method of claim 1, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: the wearable computing device obtaining environment information regarding the environment of the wearable computing device; andthe wearable computing device identifying the controllable target device based on the environment information. 11. The method of claim 1, wherein determining that a controllable target device is within an environment of a wearable computing device comprises: the wearable computing device obtaining environment information regarding the environment of the wearable computing device;the wearable computing device transmitting the environment information to a server network; andthe wearable computing device receiving an identification of the controllable target device from the server network. 12. The method of claim 11, wherein the environment information comprises a physical location of the wearable computing device. 13. The method of claim 1, wherein obtaining target device information related to the controllable target device comprises: the wearable computing device retrieving the target device information from a target device database. 14. The method of claim 1, wherein obtaining target device information related to the controllable target device comprises: the wearable computing device receiving the target device information from a server network. 15. The method of claim 1, wherein the defined area of the controllable target device is an external surface of the controllable target device. 16. The method of claim 15, further comprising: determining a perspective appearance of the defined area in the field of view; andgenerating the image of the virtual control interface based on the perspective appearance of the defined area in the field of view. 17. The method of claim 15, further comprising: determining a distance from the HMD to the defined area of the controllable target device; andgenerating the image of the virtual control interface based on the distance. 18. The method of claim 1, wherein transmitting the recognized control instruction to the controllable target device comprises the wireless computing device transmitting the recognized control instruction to the controllable target device via a WiFi, Bluetooth, or infrared link. 19. The method of claim 1, wherein transmitting the recognized control instruction to the controllable target device comprises the wireless computing device transmitting the recognized control instruction to a network for transmission to the controllable target device. 20. The method of claim 1, further comprising: the HMD displaying instructions related to the controllable target device. 21. The method of claim 1, wherein the virtual control interface comprises a plurality of visual elements and each visual element is associated with a respective control instruction for the controllable target device. 22. The method of claim 21, wherein the recognized gesture corresponds to interaction with a particular visual element of the virtual control interface, and wherein the particular visual element is associated with the recognized control instruction. 23. The method of claim 1, further comprising: receiving the status information from the controllable target device. 24. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising: determining that a controllable target device is within a field of view provided by a see-through display controlled by the computing device;obtaining target device information related to the controllable target device, wherein the target device information defines a virtual control interface for controlling the controllable target device and identifies a defined area of the controllable target device on which the virtual control interface is to be provided, wherein the target device information further includes status information related to an operational status of the controllable target device;controlling the see-through display to display the virtual control interface as an image superimposed over the defined area of the controllable target device in the field of view and to display an indication of the operational status of the controllable target device;recognizing a gesture corresponding to interaction with the virtual control interface superimposed over the defined area of the controllable target device;recognizing a control instruction for the controllable target device based on the recognized gesture; andtransmitting the recognized control instruction to the controllable target device. 25. The non-transitory computer readable medium of claim 24, wherein the virtual control interface comprises a plurality of visual elements and each visual element is associated with a respective control instruction for the controllable target device. 26. The non-transitory computer readable medium of claim 25, wherein the recognized gesture corresponds to interaction with a particular visual element of the virtual control interface, and wherein the particular visual element is associated with the recognized control instruction. 27. The non-transitory computer readable medium of claim 24, wherein the functions further comprise: receiving the status information from the controllable target device. 28. A wearable computing device, comprising: a head-mounted display (HMD), wherein the HMD is configured to provide a field of view in which at least a portion of an environment of the wearable computing device is viewable, and wherein the HMD is operable to display images superimposed over the field of view; anda controller, wherein the controller is configured to:determine that a controllable target device is within the environment of the wearable computing device;obtain target device information related to the controllable target device, wherein the target device information defines a virtual control interface for controlling the controllable target device and identifies a defined area of the controllable target device on which the virtual control interface is to be provided, wherein the target device information further includes status information related to an operational status of the controllable target device;control the HMD to display the virtual control interface as an image superimposed over the defined area of the controllable target device in the field of view and to display an indication of the operational status of the controllable target device;recognize a gesture corresponding to interaction with the virtual control interface superimposed over the defined area of the controllable target device;recognize a control instruction for the controllable target device based on the recognized gesture; andtransmit the recognized control instruction to the controllable target device. 29. The wearable computing device of claim 28, further comprising: a camera configured to image a portion of the environment located in front of the HMD, wherein the controller is configured to identify the controllable target device from one or more images obtained by the camera. 30. The wearable computing device of 28, further comprising: a target device database, wherein the controller is configured to obtain the target device information from the database. 31. The wearable computing device of claim 28, further comprising: a communication interface, wherein the controller is configured to obtain the target device information by communicating with a server network via the communication interface. 32. The wearable computing device of claim 28, further comprising: a communication interface, wherein the controller is configured to transmit the recognized control instruction to the controllable target device via the communication interface. 33. The wearable computing device of claim 28, wherein the virtual control interface comprises a plurality of visual elements and each visual element is associated with a respective control instruction for the controllable target device. 34. The wearable computing device of claim 33, wherein the recognized gesture corresponds to interaction with a particular visual element of the virtual control interface, and wherein the particular visual element is associated with the recognized control instruction. 35. The wearable device of claim 28, wherein the controller is further configured to receive the status information from the controllable target device.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (50)
Spitzer, Mark B.; Hunter, Gregory H.; Zavracky, Paul M., Binocular viewing system.
Rallison Richard Dennis ; Amadon C. Gregory ; Mack ; Jr. Wolfgang Adam ; Conner Arlie R., Head-mounted display with image generator, fold mirror and mirror for transmission to the eye position of the user.
King, William B.; Chen, Chungte W.; Hegg, Ronald G.; Gunther, John E.; Nichols, Richard W., Low-observability, wide-field-of-view, situation awareness viewing device.
Robert William McClelland ; Noa More Rensing ; Mark Bradley Spitzer ; Paul Daniel Aquilino ; Paul Martin Zavracky, Method of fabrication of a torsional micro-mechanical mirror system.
Rensing, Noa M.; Adams, George G.; McGruer, Nicol E.; McClelland, Robert W.; Zavracky, Paul M., Micro-electromechanical optical switch assembly for optical data networks.
Mitchell, Dennis B.; Lewis, Dennis G.; Head, James V. W., System, apparatus and method for providing a portable customizable maintenance support computer communications system.
McClelland Robert William ; Rensing Noa More ; Spitzer Mark Bradley ; Aquilino Paul Daniel ; Zavracky Paul Martin, Torsional micro-mechanical mirror system.
Yun, Sungrack; Hwang, Kyu Woong; Cho, Jun-Cheol; Kim, Taesu; Jin, Minho; Cho, Yongwoo; Kim, Kang, Method and apparatus for selectively providing information on objects in a captured image.
Sales, Jay William; Klosinski, Jr., Richard Chester; Workman, Matthew Allen; Murphy, Meghan Kathleen; Steen, Matthew David, System for monitoring individuals as they age in place.
Sales, Jay William; Klosinski, Jr., Richard Chester; Workman, Matthew Allen; Cook, Andrew, Systems and methods for a computerized temple for use with eyewear.
Klosinski, Jr., Richard Chester; Murphy, Meghan Kathleen; Workman, Matthew Allen; Sales, Jay William, Systems and methods for tracking motion, performance, and other data for an individual such as a winter sports athlete.
Sales, Jay William; Klosinski, Jr., Richard Chester; Workman, Matthew Allen; Murphy, Meghan Kathleen; Steen, Matthew David, Systems, apparatus, and methods for using eyewear, or other wearable item, to confirm the identity of an individual.
Sales, Jay William; Klosinski, Jr., Richard Chester; Workman, Matthew Allen; Murphy, Meghan Kathleen; Steen, Matthew David, Systems, apparatus, and methods for using eyewear, or other wearable item, to confirm the identity of an individual.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.