Reducing control response latency with defined cross-control behavior
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-003/041
G06T-001/20
G06F-009/44
출원번호
US-0330522
(2014-07-14)
등록번호
US-9632615
(2017-04-25)
발명자
/ 주소
McCanny, Benjamin
Forlines, Clifton
Wigdor, Daniel
출원인 / 주소
Tactual Labs Co.
대리인 / 주소
Landa, Adam B.
인용정보
피인용 횟수 :
0인용 특허 :
4
초록▼
A system for processing user input with reduced control response latency includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals, and an output device. The low-latency subsystem receives the signals
A system for processing user input with reduced control response latency includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output. In an embodiment, the signals comprise an identification of a defined cross-control behavior.
대표청구항▼
1. A system for processing user input, comprising: display comprising a visualization of a user interface;user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input;input proce
1. A system for processing user input, comprising: display comprising a visualization of a user interface;user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input;input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit signals corresponding to the received signals;first graphical processing and output system comprising software running in a software stack, the first graphical processing and output system adapted to receive at least some of the emitted signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to the at least some of the emitted signals;second graphical processing and output system implemented at least partially in hardware, the second graphical processing and output system adapted to substantially simultaneously receive at least some of the emitted signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the emitted signals;wherein the at least some of the emitted signals received by the second graphical processing and output system comprise an identification of a cross-control behavior, the second graphical processing and output system comprises hardware configured to implement the cross-control behavior, and the generated low-latency data comprises data reflecting the cross-control behavior;wherein, with respect to the response to the at least some of the emitted signals, the second graphical processing and output system is adapted to output the generated low-latency data with low latency relative to the output of the high-latency data by the first graphical processing and output system; andthe display being configured to display at least some of the low-latency data and at least some of the high-latency data on the visualization of the user interface. 2. The system for processing user input according to claim 1, wherein the hardware configured to implement the cross-control behavior comprises hardware having logic for implementing the cross-control behavior encoded therein. 3. The system for processing user input according to claim 1, wherein the cross-control behavior comprises interaction between a first control and a second control. 4. The system for processing user input according to claim 3, wherein the first control comprises a button and the second control comprises a window. 5. The system for processing user input according to claim 1, wherein the hardware configured to implement the cross-control behavior comprises hardware configured to render tab content. 6. The system for processing user input according to claim 5, wherein the hardware is configured with software to render the tab content as a series of bitmaps and respond to input to change which tab is displayed. 7. The system for processing user input according to claim 1, configured such that the first graphical processing and output system passes rendered bitmaps of components of the user interface to the second graphical processing and output system. 8. The system for processing user input according to claim 1, wherein the input processing system is configured to respond to a flag associated with a control by executing code that implements the cross-control behavior upon receipt of user input. 9. The system for processing user input according to claim 1, wherein the cross-control behavior comprises disabling of a control. 10. The system for processing user input according to claim 1, wherein the cross-control behavior comprises disabling of a part of the user interface upon activation of a control. 11. The system for processing user input according to claim 10, wherein the control is a checkbox. 12. The system for processing user input according to claim 1, wherein the cross-control behavior comprises a change in appearance of a button. 13. The system for processing user input according to claim 1, wherein the cross-control behavior comprises a change in content, appearance or behavior of a menu. 14. The system for processing user input according to claim 1, wherein the cross-control behavior comprises display of at least one contextual interface element. 15. The system for processing user input according to claim 14, wherein the at least one contextual interface element comprises a menu or menu bar. 16. The system for processing user input according to claim 14, wherein the display of at least one contextual interface element is in response to a long-press. 17. The system for processing user input according to claim 1, wherein the cross-control behavior comprises advancement of an in-focus control. 18. The system for processing user input according to claim 1, wherein the cross-control behavior comprises insertion of text. 19. The system for processing user input according to claim 1, wherein the cross-control behavior comprises opening or closing a navigation drawer. 20. The system for processing user input according to claim 1, wherein the cross-control behavior comprises presenting a search interface. 21. A system for processing user input, comprising: display comprising a visualization of a user interface;user input device adapted to output signals corresponding to user input;input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit a stream of signals corresponding to at least some of the received signals;first graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to at least some of the signals in the at least a portion of the stream of signals received by the first graphical processing and output system;second graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the signals in the at least a portion of the stream of signals received by the second graphical processing and output system, the second graphical processing and output system being configured to output the generated low-latency data with low latency relative to the output of the high-latency data by the first output graphical processing and output system;wherein the at least a portion of the stream of signals received by the second graphical processing and output system comprise an identification of a cross-control behavior and the generated low-latency data comprises data reflecting the cross-control behavior; andthe display being configured to merge at least some of the low-latency data and at least some of the high-latency data onto the visualization of the user interface. 22. The system for processing user input according to claim 21, wherein the cross-control behavior comprises interaction between a first control and a second control. 23. The system for processing user input according to claim 22, wherein the first control comprises a button and the second control comprises a window. 24. The system for processing user input according to claim 21, wherein the cross-control behavior comprises display of tab content. 25. The system for processing user input according to claim 24, wherein the second graphical processing and output system is configured to render the tab content as a series of bitmaps and respond to input to change which tab is displayed. 26. The system for processing user input according to claim 21, configured such that the first graphical processing and output system passes rendered bitmaps of components of the user interface to the second graphical processing and output system. 27. The system for processing user input according to claim 21, wherein the input processing system is configured to respond to a flag associated with a control by executing code that implements the cross-control behavior upon receipt of user input. 28. The system for processing user input according to claim 21, wherein the cross-control behavior comprises disabling of a control. 29. The system for processing user input according to claim 21, wherein the cross-control behavior comprises disabling of a part of the user interface upon activation of a control. 30. The system for processing user input according to claim 29, wherein the control is a checkbox. 31. The system for processing user input according to claim 21, wherein the cross-control behavior comprises a change in appearance of a button. 32. The system for processing user input according to claim 21, wherein the cross-control behavior comprises a change in content, appearance or behavior of a menu. 33. The system for processing user input according to claim 21, wherein the cross-control behavior comprises display of at least one contextual interface element. 34. The system for processing user input according to claim 33, wherein the at least one contextual interface element comprises a menu or menu bar. 35. The system for processing user input according to claim 33, wherein the display of at least one contextual interface element is in response to a long-press. 36. The system for processing user input according to claim 21, wherein the cross-control behavior comprises advancement of an in-focus control. 37. The system for processing user input according to claim 21, wherein the cross-control behavior comprises insertion of text. 38. The system for processing user input according to claim 21, wherein the cross-control behavior comprises opening or closing a navigation drawer. 39. The system for processing user input according to claim 21, wherein the cross-control behavior comprises presenting a search interface. 40. A system for processing user input, comprising: input subsystem including an input device, the subsystem adapted to output signals in response to a plurality of user inputs to the input device, the signals comprising information concerning the input;low-latency subsystem adapted to receive the signals and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a high-latency subsystem;wherein the signals received by the low-latency subsystem comprise an identification of a cross-control behavior and the generated low-latency response comprises data reflecting the cross-control behavior;the high-latency subsystem adapted to receive the at least one of the signals, and to generate a high-latency response in response to one or more of the at least one of the signals; and,wherein the low-latency subsystem generates the low-latency response with low latency relative to the high-latency subsystem and the high-latency subsystem generates the high-latency response with high latency relative to the low-latency subsystem. 41. A system for processing user input, comprising: input subsystem including an input device, the subsystem adapted to output signals in response to a plurality of user inputs to the input device, the signals comprising information concerning the input;low-latency subsystem adapted to receive the signals and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a high-latency subsystem;wherein the signals received by the low-latency subsystem comprise an input which triggers a cross-control behavior, the low-latency subsystem makes an identification of the cross-control behavior, and the low-latency subsystem generates a low-latency response reflecting the cross-control behavior;the high-latency subsystem adapted to receive the at least one of the signals, and to generate a high-latency response in response to one or more of the at least one of the signals;wherein the low-latency subsystem generates the low-latency response with low latency relative to the high-latency subsystem and the high-latency subsystem generates the high-latency response with high latency relative to the low-latency subsystem. 42. The system for processing user input according to claim 41, wherein the cross-control behavior comprises interaction between a first control and a second control. 43. The system for processing user input according to claim 42, wherein the first control comprises a button and the second control comprises a window. 44. The system for processing user input according to claim 41, wherein the cross-control behavior comprises display of tab content. 45. The system for processing user input according to claim 44, wherein the low-latency subsystem is configured to render the tab content as a series of bitmaps and respond to input to change which tab is displayed. 46. The system for processing user input according to claim 41, configured such that the high-latency subsystem passes rendered bitmaps of components of the user interface to the low-latency subsystem. 47. The system for processing user input according to claim 41, wherein the input subsystem is configured to respond to a flag associated with a control by executing code that implements the cross-control behavior upon receipt of user input. 48. The system for processing user input according to claim 41, wherein the cross-control behavior comprises disabling of a control. 49. The system for processing user input according to claim 41, wherein the cross-control behavior comprises disabling of a part of the user interface upon activation of a control. 50. The system for processing user input according to claim 49, wherein the control is a checkbox. 51. The system for processing user input according to claim 41, wherein the cross-control behavior comprises a change in appearance of a button. 52. The system for processing user input according to claim 41, wherein the cross-control behavior comprises a change in content, appearance or behavior of a menu. 53. The system for processing user input according to claim 41, wherein the cross-control behavior comprises display of at least one contextual interface element. 54. The system for processing user input according to claim 53, wherein the at least one contextual interface element comprises a menu or menu bar. 55. The system for processing user input according to claim 53, wherein the display of at least one contextual interface element is in response to a long-press. 56. The system for processing user input according to claim 41, wherein the cross-control behavior comprises advancement of an in-focus control. 57. The system for processing user input according to claim 41, wherein the cross-control behavior comprises insertion of text. 58. The system for processing user input according to claim 41, wherein the cross-control behavior comprises opening or closing a navigation drawer. 59. The system for processing user input according to claim 41, wherein the cross-control behavior comprises presenting a search interface. 60. A system for processing user input with low latency, comprising: an input device;an input processing unit;a high-latency subsystem;a low-latency subsystem;input processing unit software adapted to generate signals in response to user inputs; and,output device;wherein the low-latency subsystem processes a plurality of the signals with low latency relative to the high-latency subsystem and the high-latency subsystem processes a plurality of the signals with high latency relative to the low-latency subsystem;wherein the input device, the input processing unit, the high-latency subsystem, the low-latency processing subsystem, the input processing unit software and the output device being arranged such that:at least some of the signals are processed in parallel by said low-latency subsystem and said high-latency subsystem, the low-latency subsystem creating a programmable response for output on the output device with low-latency and the high-latency subsystem creating a response for output on the output device with high-latency;wherein the plurality of the signals processed by the low-latency subsystem comprise an input from the user, in response to which the low-latency subsystem makes an identification of a cross-control behavior, and the programmable response comprises data reflecting the cross-control behavior; andthe output device outputting one or both of the response from the low-latency subsystem and the response from the high-latency subsystem when the responses are output thereto. 61. The system for processing user input according to claim 60, wherein the cross-control behavior comprises interaction between a first control and a second control. 62. The system for processing user input according to claim 61, wherein the first control comprises a button and the second control comprises a window. 63. The system for processing user input according to claim 60, wherein the cross-control behavior comprises display of tab content. 64. The system for processing user input according to claim 63, wherein the low-latency subsystem is configured to render the tab content as a series of bitmaps and respond to input to change which tab is displayed. 65. The system for processing user input according to claim 60, configured such that the high-latency subsystem passes rendered bitmaps of components of the user interface to the low-latency subsystem. 66. The system for processing user input according to claim 60, wherein the input processing unit is configured to respond to a flag associated with a control by executing code that implements the cross-control behavior upon receipt of user input. 67. The system for processing user input according to claim 60, wherein the cross-control behavior comprises disabling of a control. 68. The system for processing user input according to claim 60, wherein the cross-control behavior comprises disabling of a part of the user interface upon activation of a control. 69. The system for processing user input according to claim 68, wherein the control is a checkbox. 70. The system for processing user input according to claim 60, wherein the cross-control behavior comprises a change in appearance of a button. 71. The system for processing user input according to claim 60, wherein the cross-control behavior comprises a change in content, appearance or behavior of a menu. 72. The system for processing user input according to claim 60, wherein the cross-control behavior comprises display of at least one contextual interface element. 73. The system for processing user input according to claim 72, wherein the at least one contextual interface element comprises a menu or menu bar. 74. The system for processing user input according to claim 72, wherein the display of at least one contextual interface element is in response to a long-press. 75. The system for processing user input according to claim 60, wherein the cross-control behavior comprises advancement of an in-focus control. 76. The system for processing user input according to claim 60, wherein the cross-control behavior comprises insertion of text. 77. The system for processing user input according to claim 60, wherein the cross-control behavior comprises opening or closing a navigation drawer. 78. The system for processing user input according to claim 60, wherein the cross-control behavior comprises presenting a search interface. 79. A system for processing user input with low latency, comprising: an input device;output device;an input processing unit;input processing unit software adapted to generate signals in response to user inputs;a high-latency response subsystem adapted to create a high-latency response to at least some of the signals;a low-latency response subsystem implemented at least partially in hardware, the low-latency response subsystem adapted to create a low-latency response to at least some of the signals, the low-latency response subsystem comprising one or more parameters affecting the low-latency response;wherein the at least some of the signals comprise an identification of a cross-control behavior, the low-latency response subsystem comprises hardware configured to implement the cross-control behavior, and the low-latency response comprises data reflecting the cross-control behavior;wherein the low-latency response is not of higher latency than the high-latency response, and the high-latency response is not of lower latency than the low-latency response with respect to common signals;wherein the input device, output device, the input processing unit, input processing unit software, the high-latency response subsystem and the low-latency response subsystem are arranged such that: the output device outputs the low-latency response and the high-latency response; andwherein application software can alter the one or more parameters affecting the low-latency response. 80. The system for processing user input according to claim 79, wherein the cross-control behavior comprises interaction between a first control and a second control. 81. The system for processing user input according to claim 80, wherein the first control comprises a button and the second control comprises a window. 82. The system for processing user input according to claim 79, wherein the cross-control behavior comprises display of tab content. 83. The system for processing user input according to claim 82, wherein the low-latency response subsystem is configured to render the tab content as a series of bitmaps and respond to input to change which tab is displayed. 84. The system for processing user input according to claim 79, configured such that the high-latency response subsystem passes rendered bitmaps of components of the user interface to the second graphical processing and output system. 85. The system for processing user input according to claim 79, wherein the input processing unit is configured to respond to a flag associated with a control by executing code that implements the cross-control behavior upon receipt of user input. 86. The system for processing user input according to claim 79, wherein the cross-control behavior comprises disabling of a control. 87. The system for processing user input according to claim 79, wherein the cross-control behavior comprises disabling of a part of the user interface upon activation of a control. 88. The system for processing user input according to claim 87, wherein the control is a checkbox. 89. The system for processing user input according to claim 79, wherein the cross-control behavior comprises a change in appearance of a button. 90. The system for processing user input according to claim 79, wherein the cross-control behavior comprises a change in content, appearance or behavior of a menu. 91. The system for processing user input according to claim 79, wherein the cross-control behavior comprises display of at least one contextual interface element. 92. The system for processing user input according to claim 91, wherein the at least one contextual interface element comprises a menu or menu bar. 93. The system for processing user input according to claim 91, wherein the display of at least one contextual interface element is in response to a long-press. 94. The system for processing user input according to claim 79, wherein the cross-control behavior comprises advancement of an in-focus control. 95. The system for processing user input according to claim 79, wherein the cross-control behavior comprises insertion of text. 96. The system for processing user input according to claim 79, wherein the cross-control behavior comprises opening or closing a navigation drawer. 97. The system for processing user input according to claim 79, wherein the cross-control behavior comprises presenting a search interface. 98. The system for processing user input according to claim 79, wherein the cross-control behavior comprises a synchronized response between at least two interface elements.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (4)
Zehavi Ephraim (Haifa ILX) Carter Stephen S. (San Diego CA) Gilhousen Klein S. (Bozeman MT), Method and apparatus for using full spectrum transmitted power in a spread spectrum communication system for tracking in.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.