Unified user element information provisioning
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-009/44
G06F-011/36
출원번호
US-0043180
(2013-10-01)
등록번호
US-9703684
(2017-07-11)
발명자
/ 주소
Sanborn de Asis, Ezekiel Wade
Venkatanarayanan, Prasanna
Vinayak, Sai
출원인 / 주소
AMAZON TECHNOLOGIES, INC.
대리인 / 주소
K&L Gates LLP
인용정보
피인용 횟수 :
0인용 특허 :
7
초록▼
Embodiments of methods, systems and storage media associated with a unified UI element query interface (“UEI”) configured to facilitate provisioning of UI element information are described. A view server may be configured to respond to queries made using the UEI to provide indications of UI elements
Embodiments of methods, systems and storage media associated with a unified UI element query interface (“UEI”) configured to facilitate provisioning of UI element information are described. A view server may be configured to respond to queries made using the UEI to provide indications of UI elements that are being rendered by one or more rendering engines. The view server may also be configured to respond to queries about specific UI elements to provide properties for the UI elements. The UEI may provide a single point of interaction for an application that wishes to interact with UI elements rendered by different rendering engines. Other embodiments may be described and/or claimed.
대표청구항▼
1. A computer-implemented method for performing testing of user interface elements of an application, the method comprising: identifying, by a testing application of a computing device, a displayed window of the application for which testing is desired, the displayed window being rendered by a rende
1. A computer-implemented method for performing testing of user interface elements of an application, the method comprising: identifying, by a testing application of a computing device, a displayed window of the application for which testing is desired, the displayed window being rendered by a rendering engine operating on the computing device;requesting, by the testing application, through a programmatic unified user interface element query interface of a view server computing module operating on the computing device, the view server computing module being in communication with the rendering engine, a list of one or more user interface elements included in the displayed window, wherein the view server computing module implements the programmatic unified user interface element query interface to programmatically receive indications of currently rendered windows or user interface elements from the application for which testing is desired and, in response, to programmatically provide information about the currently rendered windows or user interface elements to the testing application;obtaining, by the view server computing module, the list of one or more user interface elements from the rendering engine;sending, by the view server computing module, the list of the one or more user interface elements to the testing application;selecting, by the testing application, from the list of one or more user interface elements, a user interface element for testing;requesting, by the testing application, from the view server computing module, through the programmatic unified user interface element query interface, user interface element properties of the selected user interface element;obtaining, by the view server computing module, one or more user interface element properties of the selected user interface elements from the rendering engine;sending, by the view server computing module, the one or more user interface element properties to the testing application; andperforming, by the testing application, one or more testing interactions with the selected user interface element based on the one or more user interface properties to validate that the selected user interface element has been rendered properly. 2. The method of claim 1, wherein obtaining the list of one or more user interface elements from the rendering engine comprises querying the rendering engine through a view server back end associated with the rendering engine. 3. The method of claim 1, wherein obtaining the one or more user interface properties from the rendering engine comprises requesting the rendering engine to provide a user interface element property structure that is configured to be directly returned by the programmatic unified user interface element query interface without requiring additional processing to be compatible with the programmatic unified user interface element query interface. 4. The method of claim 1, wherein obtaining the one or more user interface properties from the rendering engine comprises generating a user interface property structure by assembling user interface property information received from the rendering engine to form the user interface property structure. 5. A computer-implemented method for facilitating interaction with user interface elements of an application, the method comprising: providing, by a view server computing device, a programmatic unified user interface element query interface for receiving programmatic requests for user interface element information for user interface elements currently rendered by a plurality of rendering engines, wherein the view server computing device programmatically receives indications of currently rendered windows or user interface elements;receiving, by the view server computing device, through the programmatic unified user interface element query interface, a programmatic request for information about a first set of user interface elements of a window rendered by a first rendering engine of the plurality of rendering engines, wherein receiving the programmatic request for information comprises receiving a request to identify user interface elements in the window;obtaining, by the view server computing device, for each user interface element of the first set of user interface elements, user interface element information from the first rendering engine; andprogrammatically providing, by the view server computing device, the user interface element information for each user interface element of the first set of user interface elements, wherein programmatically providing the user interface element information comprises programmatically providing a list of identifiers for each user interface element in the first set of user interface elements in the window. 6. The method of claim 5, wherein receiving the programmatic request for information comprises receiving a request for user interface properties of a user interface element in the window. 7. The method of claim 6, wherein obtaining user interface element information comprises requesting the first rendering engine to provide the user interface properties in a user interface element property structure that is configured to be directly returned by the unified user interface element query interface without requiring additional processing to be compatible with the unified user interface element query interface. 8. The method of claim 6, wherein obtaining user interface element information comprises performing one or more native object queries of one or more native user interface element property interfaces implemented by the first rendering engine for information about the user interface element. 9. The method of claim 8, wherein: the first rendering engine is implemented in JAVA®, and the one or more native user interface element property interfaces comprise native JAVA® object interfaces; orthe first rendering engine is implemented in JAVASCRIPT®, and the one or more native user interface element property interfaces comprise document object model interfaces. 10. The method of claim 6, wherein obtaining user interface element information comprises generating a user interface property structure by assembling user interface property information received from the first rendering engine to form the user interface property structure. 11. The method of claim 5, wherein: receiving the request for user interface element information comprises receiving the request at a view server front end that is not associated with the first rendering engine; andobtaining the user interface element information comprises obtaining the user interface element information from a view server back end that is associated with the first rendering engine. 12. The method of claim 5, wherein information about the first set of user interface elements comprises a list of rendered user interface elements. 13. The method of claim 5, wherein information about the first set of user interface elements comprises one or more of: location, size, shape, title, text, activity, activation information, focus, or visibility. 14. The method of claim 5, wherein receiving a programmatic request comprises receiving the programmatic request from an application external to the programmatic unified user interface element query interface. 15. A computing system for facilitating interaction with user interface elements of an application executing on the computing system, comprising: one or more computing processors;one or more non-transitory computer readable media including instructions written thereon that, when executed by the computing processors cause the computing processors to: provide a programmatic unified user interface element query interface for receiving programmatic requests for user interface element information for user interface elements currently rendered by a plurality of rendering engines, wherein the programmatic unified user interface element query interface programmatically receives indications of currently rendered user interface elements;receive a programmatic request through the programmatic unified user interface element query interface for information about a first set of user interface elements of a window rendered by a first rendering engine of the plurality of rendering engines, wherein receive the programmatic request for information comprises receive a programmatic request for user interface properties of a user interface element in the window;obtain, for each user interface element of the first set of user interface elements, user interface element information from the first rendering engine, wherein obtain user interface element information comprises request the first rendering engine to provide user interface properties in a user interface element property structure that is configured to be directly returned by the unified user interface element query interface without requiring additional processing to be compatible with the unified user interface element query interface; andprogrammatically provide the request with user interface element information for teach user interface element of the first set of user interface elements. 16. The computing system of claim 15, wherein receive the programmatic request for information comprises receive a request to identify user interface elements in the window. 17. The computing system of claim 16, wherein programmatically provide the user interface element information comprises provide a list of identifiers for each user interface element in the first set of user interface elements in the window. 18. The computing system of claim 15, wherein obtain user interface element information comprises perform one or more native object queries implemented by the first rendering engine for information about the user interface element. 19. The computing system of claim 15, wherein obtain user interface element information comprises generate a user interface property structure through assembly of user interface property information received from the first rendering engine to form the user interface property structure. 20. The computing system of claim 15, wherein: receive the programmatic request for user interface element information comprises receive the programmatic request at a view server front end that is not associated with the first rendering engine; andobtain the user interface element information comprises obtain the user interface element information from a view server back end that is associated with the first rendering engine. 21. The computing system of claim 15, wherein information about the first set of user interface elements comprises a list of rendered user interface elements. 22. The computing system of claim 15, wherein information about the first set of user interface elements comprises one or more of: location, size, shape, title, text, activity, activation information, focus, or visibility. 23. The computing system of claim 15, wherein receive a programmatic request comprises receive the programmatic request from an application external to the programmatic unified user interface element query interface.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (7)
Sinclair,Robert; Wagoner,Patricia M.; McKeon,Brendan, Accessibility system and method.
Robertson,Niel; Burton,Christopher L.; Guzik,Thomas, Method for the use of information in an auxiliary data system in relation to automated testing of graphical user interface based applications.
Ginter Karl L. ; Shear Victor H. ; Sibert W. Olin ; Spahn Francis J. ; Van Wie David M., Systems and methods for secure transaction management and electronic rights protection.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.