Data structure pooling of voice activated data packets
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G10L-015/00
G10L-021/00
G10L-025/00
G10L-019/00
G10L-015/18
G10L-015/30
G10L-015/22
G06F-017/30
G10L-015/08
출원번호
US-0395707
(2016-12-30)
등록번호
US-10013986
(2018-07-03)
발명자
/ 주소
Bhaya, Gaurav
Stets, Robert
출원인 / 주소
GOOGLE LLC
대리인 / 주소
Foley & Lardner LLP
인용정보
피인용 횟수 :
3인용 특허 :
36
초록▼
Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor (“NLP”) component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A
Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor (“NLP”) component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A direct action application programming interface (“API”) can generate a first action data structure with a parameter defining a first action. The NLP component can receive and parse a second input audio signal to identify a second request and a second trigger keyword, and can generate a second action data structure with a parameter defining a second action. A pooling component can generate the first and second action data structures into a pooled data structure, and can transmit the pooled data structure to a service provider computing device to cause it device to perform an operation defined by the pooled data structure.
대표청구항▼
1. A system to manage voice activated threads in a voice activated data packet based computer network environment, comprising: a natural language processor component executed by a data processing system to receive, via an interface of the data processing system, data packets comprising a first input
1. A system to manage voice activated threads in a voice activated data packet based computer network environment, comprising: a natural language processor component executed by a data processing system to receive, via an interface of the data processing system, data packets comprising a first input audio signal detected by a sensor of a first client computing device;the natural language processor component to parse the first input audio signal to identify a first request and a first trigger keyword corresponding to the first request;a direct action application programming interface (“API”) of the data processing system to generate, based on the first trigger keyword and in response to the first request, a first action data structure with a parameter defining a first action;the natural language processor component to receive, via the interface of the data processing system, data packets comprising a second input audio signal detected by a sensor of a second client computing device, and to parse the second input audio signal to identify a second request and a second trigger keyword corresponding to the second request;the direct action API to generate, based on the second trigger keyword and in response to the second request, a second action data structure with a parameter defining a second action; anda pooling component of the data processing system to: determine, based on a heuristic technique applied to the parameter of the first action data structure and the parameter of the second action data structure, a pooling parameter that indicates a level of overlap between the first action data structure and the second action data structure, the pooling parameter used to generate a pooled data structure that causes a reduction in processor or bandwidth utilization as compared to separate transmissions of the first action data structure and the second action data structure;generate, based on the pooling parameter, the first action data structure, and the second action data structure, the pooled data structure; andtransmit, via a computer network, the pooled data structure to a service provider computing device to cause the service provider computing device to perform an operation defined by the pooled data structure and corresponding to the first action and the second action. 2. The system of claim 1, wherein the service provider computing device is a first service provider computing device corresponding to a first entity, comprising: the pooling component of the data processing system to transmit, via the computer network, a second pooled data structure to a second service provider computing device corresponding to a second entity to cause the second service provider computing device to perform an operation defined by the second pooled data structure. 3. The system of claim 1, wherein the pooling parameter is a first pooling parameter, the pooled data structure is a first pooled data structure, and the service provider computing device is a first service provider computing device, comprising the pooling component of the data processing system to: determine a second pooling parameter that indicates a level of overlap between a third action data structure and a fourth action data structure;generate, based on the second pooling parameter, the third action data structure, and the fourth action data structure, a second pooled data structure; andtransmit, via the computer network, the second pooled data structure to a second service provider computing device to cause the second service provider computing device to perform an operation defined by the second pooled data structure and corresponding to the third action data structure and the fourth action data structure. 4. The system of claim 1, wherein the pooling parameter is a first pooling parameter, comprising: the natural language processor component to receive, via the interface of the data processing system, data packets comprising a third input audio signal detected by the sensor of the first client computing device, and to parse the third input audio signal to identify a third request and a third trigger keyword corresponding to the third request;the direct action API to generate, based on the third trigger keyword and in response to the third request, a third action data structure with a parameter defining a third action;the pooling component of the data processing system to determine, a second pooling parameter that indicates a level of overlap between the third action data structure and at least one of first action data structure, the second action data structure, and the pooling parameter; andthe pooling component of the data processing system to combine, based on the pooling parameter, the third action data structure into the pooled data structure. 5. The system of claim 1, wherein the pooling parameter is a first pooling parameter, comprising: the pooling component of the data processing system to determine, a second pooling parameter based on a third action data structure; andthe pooling component of the data processing system to modify the pooled data structure based on the second pooling parameter. 6. The system of claim 1, wherein the level of overlap indicates a similarity metric between the first action data structure and the second action data structure. 7. The system of claim 1, comprising: the pooling component of the data processing system to determine the level of overlap between the first action data structure and the second action data structure based on subject matter indicated by the first action data structure and subject matter indicated by the second action data structure. 8. The system of claim 1, wherein the first action includes a first plurality of sub-actions and the second action includes a second plurality of sub-actions. 9. The system of claim 1, wherein the data processing system including the pooling component corresponds to a first entity, and the service provider computing device corresponds to a second entity different than the first entity. 10. The system of claim 1, wherein the parameter defining the first action and the parameter defining the second action each indicate location data. 11. The system of claim 1, wherein the parameter defining the first action and the parameter defining the second action each indicate time data. 12. The system of claim 1, wherein the parameter defining the first action and the parameter defining the second action each identify common subject matter. 13. A method to manage voice activated threads in a voice activated data packet based computer network environment, comprising: receiving, by a natural language processor component executed by a data processing system, via an interface of the data processing system, data packets comprising a first input audio signal detected by a sensor of a first client computing device;parsing, by the natural language processor component, the first input audio signal to identify a first request and a first trigger keyword corresponding to the first request;generating, by a direct action application programming interface (“API”) of the data processing system, based on the first trigger keyword and in response to the first request, a first action data structure with a parameter defining a first action;receiving, by the natural language processor component, via the interface of the data processing system, data packets comprising a second input audio signal detected by a sensor of a second client computing device, and parsing, by the natural language processor component, the second input audio signal to identify a second request and a second trigger keyword corresponding to the second request;generating, by the direct action API, based on the second trigger keyword and in response to the second request, a second action data structure with a parameter defining a second action;determining, by a pooling component of the data processing system, based on a heuristic technique applied to the parameter of the first action data structure and the parameter of the second action data structure, a pooling parameter that indicates a level of overlap between the first action data structure and the second action data structure, the pooling parameter used to generate a pooled data structure that causes a reduction in processor or bandwidth utilization as compared to separate transmissions of the first action data structure and the second action data structure;generating, based on the pooling parameter, the first action data structure and the second action data structure, the pooled data structure; andtransmitting, via a computer network, the pooled data structure to a service provider computing device to cause the service provider computing device to perform an operation defined by the pooled data structure and corresponding to the first action and the second action. 14. The method of claim 13, wherein the service provider computing device is a first service provider computing device corresponding to a first entity, comprising: transmitting, by the pooling component of the data processing system, via the computer network, a second pooled data structure to a second service provider computing device corresponding to a second entity to cause the second service provider computing device to perform an operation defined by the second pooled data structure. 15. The method of claim 13, wherein the pooling parameter is a first pooling parameter, the pooled data structure is a first pooled data structure, and the service provider computing device is a first service provider computing device, comprising: determining, by the pooling component of the data processing system, a second pooling parameter that indicates a level of overlap between a third action data structure and a fourth action data structure;combining, based on the second pooling parameter, the third action data structure with the fourth action data structure into a second pooled data structure; andtransmitting, via the computer network, the second pooled data structure to a second service provider computing device to cause the second service provider computing device to perform an operation defined by the second pooled data structure and corresponding to the third action data structure and the fourth action data structure. 16. The method of claim 13, wherein the pooling parameter is a first pooling parameter, comprising: receiving, by the natural language processor component, via the interface of the data processing system, data packets comprising a third input audio signal detected by the sensor of the first client computing device; andidentifying, based on the third input audio signal, a third request and a third trigger keyword corresponding to the third request;generating, based on the third trigger keyword and in response to the third request, a third action data structure with a parameter defining a third action;determining a second pooling parameter that indicates a level of overlap between the third action data structure and at least one of first action data structure, the second action data structure, and the pooling parameter; andcombining based on the pooling parameter, the third action data structure into the pooled data structure. 17. The method of claim 13, wherein the pooling parameter is a first pooling parameter, comprising: determining, by the pooling component of the data processing system, a second pooling parameter that indicates a level of overlap between a third action data structure and at least one of first action data structure, the second action data structure, and the pooling parameter; andcombining, based on the pooling parameter, the third action data structure into the pooled data structure. 18. The method of claim 13, comprising: determining the level of overlap between the first action data structure and the second action data structure based on subject matter indicated by the first action data structure and subject matter indicated by the second action data structure. 19. The method of claim 13, wherein the data processing system including the pooling component corresponds to a first entity, and the service provider computing device corresponds to a second entity different than the first entity. 20. The method of claim 13, wherein the parameter defining the first action and the parameter defining the second action each indicate at least one of location data, time data, and common subject matter.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (36)
Miyazawa, Gen, Advertising information display method, and advertising information display system.
Letchner, Julia M.; Krumm, John C.; Horvitz, Eric J., Collaborative route planning for generating personalized and context-sensitive routing recommendations.
Horvitz, Eric J.; Subramani, Murugesan S.; Apacible, Johnson T., Computing and harnessing inferences about the timing, duration, and nature of motion and cessation of motion with applications to mobile computing and communications.
Cole,Alan George; Duri,Sastry S.; Gupta,Vineet Kumar; Munson,Jonathan Paul; Wood, III,David Alvra, High-rate proximity detection with the ability to provide notification.
Frerichs, David J.; McDowall, Ian E.; Bolas, Mark T., Method and system for adding advertisements over streaming audio based upon a user profile over a world wide area network of computers.
Watterson, Scott R.; Dalebout, William T.; Ashby, Darren C., Methods and systems for controlling an exercise apparatus using a USB compatible portable remote device.
Laumeyer,Robert A.; Retterath,Jamie E., Network-based navigation system having virtual drive-thru advertisements integrated with actual imagery from along a physical route.
Komori Takashi,JPX ; Katagiri Shigeru,JPX, Pattern and speech recognition using accumulated partial scores from a posteriori odds, with pruning based on calculati.
Weksler, Arnold S.; Mese, John Carl; Peterson, Nathan J.; VanBlon, Russell Speight, Situationally suspending wakeup word to enable voice command input.
Pertrushin Valery A., System method and article of manufacture for detecting emotion in voice signals by utilizing statistics for voice signal parameters.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.