Wearable computer with superimposed controls and instructions for external device
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G02B-027/01
G06F-003/0487
G06F-003/14
G06F-001/16
G06F-003/01
G05B-019/12
출원번호
US-0577697
(2014-12-19)
등록번호
US-9678654
(2017-06-13)
발명자
/ 주소
Wong, Adrian
Miao, Xiaoyu
출원인 / 주소
Google Inc.
대리인 / 주소
McDonnell Boehnen Hulbert & Berghoff LLP
인용정보
피인용 횟수 :
0인용 특허 :
51
초록▼
A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device d
A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.
대표청구항▼
1. A method comprising: determining, at a server network, that a remotely controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein determining that the remotely controllable target device is within the environment of the wear
1. A method comprising: determining, at a server network, that a remotely controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein determining that the remotely controllable target device is within the environment of the wearable computing device comprises recognizing an optical identification on the remotely controllable target device;obtaining, from the server network, target device information related to the remotely controllable target device, wherein the target device information defines a virtual control interface for controlling the remotely controllable target device;while the HMD is oriented such that at least a portion of the remotely controllable target device is within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view;while the HMD is oriented such that the remotely controllable target device is not within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image within the field of view;recognizing an interaction with the virtual control interface;recognizing a control instruction for the remotely controllable target device based on the recognized interaction; andtransmitting the recognized control instruction from the wearable computing device to the server network for transmission to the remotely controllable target device. 2. The method of claim 1, wherein the optical identification is a barcode or a quick response (QR) code. 3. The method of claim 1, wherein the wearable computing device further comprises a camera configured to obtain images from a point-of-view. 4. The method of claim 3, wherein recognizing the optical identification on the remotely controllable target device comprises: receiving a point-of-view image obtained by the camera; andrecognizing the optical identification in the point-of-view image. 5. The method of claim 4, wherein the point-of-view image is a video image. 6. The method of claim 1, wherein the wearable computing device further comprises a scanner, wherein recognizing the optical identification of the remotely controllable target device comprises: scanning the optical identification by the scanner using infrared light. 7. The method of claim 1, wherein the interaction with the virtual control interface comprises a gesture. 8. The method of claim 1, wherein content of the virtual control interface is based on at least one of: an environmental context or a task context. 9. The method of claim 1, further comprising: receiving information, from a wearer of the wearable computing device, indicative of a desired location of the virtual control interface within the field of view, and;controlling the HIVID to adjust the location of the virtual control interface within the field of view based on the received information. 10. The method of claim 1, further comprising controlling the HIVID to dynamically adjust the virtual control interface according to an environment or task context. 11. The method of claim 10, wherein controlling the HMD to dynamically adjust the virtual control interface according to the environment or task context comprises transitioning between controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view to controlling the HMD to display the virtual control interface as an image within the field of view. 12. A wearable computing device, comprising: a head-mounted display (HMD); anda controller, wherein the controller is configured to perform operations comprising:transmitting, to a server network, information indicative of an environment of the wearable computing device;receiving, from the server network, information that a remotely controllable target device is within the environment of the wearable computing device;obtaining, from the server network, target device information related to the remotely controllable target device, wherein the target device information defines a virtual control interface for controlling the remotely controllable target device;while the HMD is oriented such that at least a portion of the remotely controllable target device is within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view;while the HMD is oriented such that the remotely controllable target device is not within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image within the field of view;recognizing an interaction with the virtual control interface;recognizing a control instruction for the remotely controllable target device based on the recognized interaction; andtransmitting the recognized control instruction from the wearable computing device to the server network for transmission to the remotely controllable target device. 13. The wearable computing device of claim 12, wherein the information indicative of an environment of the wearable computing device comprises an optical identification, wherein the optical identification comprises a barcode or a quick response (QR) code. 14. The wearable computing device of claim 12, wherein the wearable computing device further comprises a camera configured to obtain images from a point-of-view. 15. The wearable computing device of claim 14, wherein transmitting, to the server network, information indicative of the environment of the wearable computing device comprises: receiving a point-of-view image obtained by the camera; andtransmitting the point-of-view image to the server network. 16. The wearable computing device of claim 12, wherein the wearable computing device further comprises a scanner, wherein transmitting, to the server network, information indicative of the environment of the wearable computing device comprises: transmitting scanner information to the server network. 17. The wearable computing device of claim 12, wherein the interaction with the virtual control interface comprises a gesture. 18. The wearable computing device of claim 12, wherein the operations further comprise adjusting at least one of a shape, size, or orientation of the image superimposed over the corresponding portion of the remotely controllable target device based on a relative position of the HMD with respect to the remotely controllable target device. 19. The wearable computing device of claim 12, wherein the operations further comprise determining a distance to the remotely controllable target device and adjusting at least one of a shape, size, or orientation of the image superimposed over the corresponding portion of the remotely controllable target device based on the determined distance. 20. The wearable computing device of claim 12, wherein content of the virtual control interface is based on at least one of: an environmental context or a task context.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (51)
Spitzer, Mark B.; Hunter, Gregory H.; Zavracky, Paul M., Binocular viewing system.
Sako, Yoichiro; Tsuruta, Masaaki; Ito, Taiji; Asukai, Masamichi; Ebisawa, Kan, Display method and display apparatus in which a part of a screen area is in a through-state.
Rallison Richard Dennis ; Amadon C. Gregory ; Mack ; Jr. Wolfgang Adam ; Conner Arlie R., Head-mounted display with image generator, fold mirror and mirror for transmission to the eye position of the user.
King, William B.; Chen, Chungte W.; Hegg, Ronald G.; Gunther, John E.; Nichols, Richard W., Low-observability, wide-field-of-view, situation awareness viewing device.
Robert William McClelland ; Noa More Rensing ; Mark Bradley Spitzer ; Paul Daniel Aquilino ; Paul Martin Zavracky, Method of fabrication of a torsional micro-mechanical mirror system.
Rensing, Noa M.; Adams, George G.; McGruer, Nicol E.; McClelland, Robert W.; Zavracky, Paul M., Micro-electromechanical optical switch assembly for optical data networks.
Mitchell, Dennis B.; Lewis, Dennis G.; Head, James V. W., System, apparatus and method for providing a portable customizable maintenance support computer communications system.
McClelland Robert William ; Rensing Noa More ; Spitzer Mark Bradley ; Aquilino Paul Daniel ; Zavracky Paul Martin, Torsional micro-mechanical mirror system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.