Methods and vehicles for processing voice input and use of tone/mood in voice input to select vehicle response
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H02J-007/00
G10L-015/22
H04L-029/08
G10L-025/63
G10L-021/0208
B60R-016/037
G10L-015/30
G01C-021/36
G10L-015/00
G10L-017/04
G10L-017/06
출원번호
US-0351422
(2016-11-14)
등록번호
US-9672823
(2017-06-06)
발명자
/ 주소
Penilla, Angel A.
Penilla, Albert S.
출원인 / 주소
Penilla, Angel A.
인용정보
피인용 횟수 :
5인용 특허 :
169
초록▼
Methods, systems and cloud processing are provided for coordinating and processing user input provided to vehicles during use. One example is for processing voice inputs at a vehicle to identify a mood of a user and then modifying or customizing the vehicle response based on the detected mood, physi
Methods, systems and cloud processing are provided for coordinating and processing user input provided to vehicles during use. One example is for processing voice inputs at a vehicle to identify a mood of a user and then modifying or customizing the vehicle response based on the detected mood, physical characteristic and/or physiological characteristic of the user. One example includes a vehicle having an on-board computer for processing voice input. The vehicle having a microphone interfaced with the on-board computer and memory for storing a sample of audio data received from the microphone. The audio data is a voice input directed to the vehicle. A processor of the on-board computer is configured to process the sample of audio data to identify markers in frequency and/or magnitude. The markers are used to define an audio signature for the voice input, and the audio signature is used to identify a voice profile. The voice profile is used to identify a vehicle response for the voice input, and the voice profile is associated with tone of voice used in the voice input. The vehicle response acts to direct a vehicle system function to take an action based on the voice input and the vehicle response is adjusted based on the tone of voice. The tones of voice are associated to inferred moods of the user which include one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof. The action to be taken is based on the voice input and is one of a command to input a setting of the vehicle, a command requesting information, a request to access data, a request to communicate, or a combination thereof.
대표청구항▼
1. A method for processing voice inputs at a vehicle, comprising, sending, to a server, data from the vehicle, the vehicle including an on-board computer for processing instructions for the vehicle and processing wireless communication to exchange data with the server;receiving, at the vehicle, data
1. A method for processing voice inputs at a vehicle, comprising, sending, to a server, data from the vehicle, the vehicle including an on-board computer for processing instructions for the vehicle and processing wireless communication to exchange data with the server;receiving, at the vehicle, data for a user account to use the vehicle, the data used to identify a user profile of a user;receiving, from the server, data for identifying voice profiles for the user profile, each voice profile being associated with a tone identifier, the voice profiles for the user being learned from a plurality of voice inputs made to the vehicle or other vehicles by the user, while using the user account, in one or more prior sessions of use; receiving, by the on-board computer, a voice input, and for the voice input,processing, by on-board computer, the voice input to identify a voice profile that is correlated to the voice input; andgenerating a vehicle response for the voice input, the vehicle response is moderated in that the vehicle response is based in part on the tone identifier of the identified voice profile;wherein the vehicle response is one among a plurality of alternate vehicle response for the voice input as defined by current predefined mappings between the tone identifier and the plurality of alternate vehicle responses. 2. The method of claim 1, wherein the tone identifiers are used to infer a mood of the user and/or a dialect of the user. 3. The method of claim 2, wherein the mood of the user includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof. 4. The method of claim 2, wherein the dialect of the user includes one or more of a language dialect, a country dialect, a geographic region dialect, an age dialect, or combinations of two or more thereof. 5. The method of claim 1, wherein the user account is accessed using login data at the vehicle, the login data defined by credentials of the user, wherein updates to the voice profiles and tone identifiers is processed periodically or upon login by the user profile at the vehicle. 6. The method of claim 5, wherein the login data includes one or more of a password, a wireless login code, a biometric identifier, a gesture, or a pairing between a device of the user and logic of the on-board computer. 7. The method of claim 1, wherein the data received from the server for identifying voice profiles for the user profile include either identifying information to enable selection of voice profiles currently stored in storage of the vehicle or storage of a user device present in the vehicle, or the data received from the server includes one or more voice profiles and/or tone identifiers stored on the server in association with the user account for the user. 8. The method of claim 1, wherein the server stores a copy of one or more of the voice profiles and associated tone identifiers, and storage of the vehicle stores a copy of one more or more of the voice profiles and associated tone identifiers, wherein from time to time, copies stored by the server and stored by the vehicle are synchronized. 9. A method for processing voice input for a vehicle, comprising, receiving voice input of a user at a microphone of the vehicle to command input or request information from a voice input interface of the vehicle, the voice input interface being in communication with the microphone, the voice input interface providing communication with an application executed by a processor, the processor being of electronics of the vehicle and/or of a portable device paired with the vehicle;analyzing the voice input of the user to identify a voice profile for the voice input;selecting a vehicle response from among a plurality of vehicle responses for the voice profile, the selection of the vehicle response uses a mapping of tone identifiers to select one of the plurality of vehicle responses,the mapping being customizable for the user, and the mapping being stored in association with one or more of a user account on storage of the vehicle, on storage of the portable device, and on storage associated with a server, the server being managed by a cloud processing system that manages a plurality of user accounts for a plurality of users of vehicles configured with wireless communication circuitry for communicating with the cloud processing system;receiving by electronics of the vehicle updates to settings including updates to the mapping based on learned behavior of the user when processing the one or more voice inputs over time; andwherein the vehicle response is configured to make or cause one of an operational setting to the vehicle, command the input, request information, provide an input to an application, or cause retrieval of data from a data source responsive to the voice input. 10. The method of claim 9, wherein each tone identifiers is related to a tone detected in the voice input of the user. 11. The method of claim 9, wherein receiving the voice input further includes, capturing an audio sample of the voice input;processing the audio sample to remove ambient noise;identifying frequency and/or magnitude characteristics in the audio samplegenerating signature markers for the audio sample based on the frequency and/or magnitude characteristics, and using the signature markers to identify the voice profile for the voice input. 12. The method of claim 11, wherein the analyzing of the voice input to identify voice profiles includes, filtering the voice profiles associated with the user account of the user to find a voice profile having a threshold level of signature markers to the audio sample associated with the voice input. 13. The method of claim 11, wherein the tone identifiers infer a mood of the user, and the mood of the user includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, an excited mood, or combinations of two or more thereof. 14. The method of claim 9, wherein the voice input includes a tone that is used to identify the tone identifiers and each tone identifier is configurable to set a level of information to be provided back to the user when providing the voice input. 15. The method of claim 14, wherein the level of information is configured to additionally include advertising data, or discount data, or related information that is in addition to the requested information or instructed command found in the voice input. 16. The method of claim 14, wherein setting the level of information to be provided assists in moderating when to provide additional information to the user or when to avoid providing additional information to the user. 17. A vehicle including an on-board computer for processing voice input, comprising, a microphone interfaced with the on-board computer;memory for storing a sample of audio data received from the microphone, the audio data being a voice input directed to the vehicle; anda processor of the on-board computer configured process the sample of audio data to identify markers in frequency and/or magnitude, the markers used to define an audio signature for the voice input of a user, the audio signature being used to identify a voice profile, the voice profile used to identify a vehicle response for the voice input, the voice profile is associated with tone of voice used in the voice input,wherein the vehicle response acts to direct a vehicle system function to take an action based on the voice input;wherein the vehicle response is adjusted based on the tone of voice, the tones of voice are associated to inferred moods of the user which include one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof;wherein the action to be taken based on the voice input is one of a command to input a setting of the vehicle, a command requesting information, a request to access data, a request to communicate, or a combination thereof. 18. The vehicle of claim 17, wherein the voice profile is one of a plurality of voice profiles of a user associated with predefined tones of voice, and each voice profile is mapped to select vehicle responses. 19. The vehicle of claim 18, wherein the mapping being customizable for the user, and the mapping being stored in association with one or more of a user account on storage of the vehicle, on storage of a portable device that is associated with the vehicle, and on storage associated with a server that is connectable to the vehicle, the server being managed by a cloud processing system that manages a plurality of user accounts for a plurality of users of vehicles configured with wireless communication circuitry for communicating with the cloud processing system. 20. The vehicle of claim 19, wherein the mapping is customizable based on learned behavior of the user; the learned behavior is inferred from inputs and/or settings made to a vehicle when the user account of the user was active on one or more vehicles, the cloud processing system storing inputs and/or settings made to a vehicle in a database for processing said inferring of the learned behavior, said processing is configured to use machine learning.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (169)
David S. Breed ; Wilbur E. Duvall ; Wendell C. Johnson, Accident avoidance system.
Matsuoka, Yoky; Fisher, Evan J.; Malhotra, Mark; Stefanski, Mark D.; Sharan, Rangoli; Astier, Frank E., Automated presence detection and presence-related control within an intelligent controller.
Rivers, Jr., Cecil; Narel, Radoslaw; Green, Marvin Herville, Charging system, kiosk, and method of reserving a power charging device and supplying current to a power storage device.
Stefik, Mark Jeffrey; Bell, Alan G.; Eldershaw, Craig; Good, Lance E.; Greene, Daniel H.; Torres, Francisco Eduardo; Uckun, Serdar; Cummins, David Preston, Computer-implemented system and method for managing motor vehicle parking reservations.
Stefik, Mark Jeffrey; Bell, Alan G.; Eldershaw, Craig; Good, Lance E.; Greene, Daniel H.; Torres, Francisco Eduardo; Uckun, Serdar; Cummins, David Preston, Computer-implemented system and method for offering commercial parking reservations.
Buck Michael (Winennden DEX) Boll Wolf (Weinstadt DEX) Knorzer Gunther (Sachsenheim DEX), Consumption-oriented driving-power limitation of a vehicle drive.
Ambrosio, Ronald; Ferro, Erica Haefner; Hafner, James L.; Harrison, Colin G.; O'Mara, Melissa W.; Schurr, Allan J.; Trekell, Mark W.; Williamson, Paul S., Electric vehicle charging transaction interface for managing electric vehicle charging transactions.
Ambrosio, Ronald; Ferro, Erica Haefner; Hafner, James Lee; Harrison, Colin George; O'Mara, Melissa Wiltsey; Schurr, Allan James; Trekell, Mark William; Williamson, Paul Stuart, Electric vehicle charging transaction interface for managing electric vehicle charging transactions.
Reimers Eberhart (8807 Strause Ct. Springfield VA 22153) Moyer Elmo E. (7 Fenlon St. West Saratoga Springs NY 12866), Electric vehicle controller adapted for charge station connection.
Asakawa Shiro,JPX ; Tsutsui Hiroshi,JPX ; Taketomi Yoshinao,JPX ; Okuda Eiichiro,JPX, Head up display unit, liquid crystal display panel, and method of fabricating the liquid crystal display panel.
Alofs Cornell W. (Petoskey MI) Drenth Ronald R. (Petoskey MI), Method and apparatus for guiding a driverless vehicle using a sensor tracking a cable emitting an electromagnetic field.
Smith, Harry F., Methods for providing information, messages and advertisements to a user of a fuel pump that is coupled to remote computers through a data communications network.
Meese William G. (Bloomfield Hills MI) Pratt Robert G. (Farmington Hills MI) Charneski Mitchell D. (Southfield MI) Brokenshire Robert E. (Troy MI) Whitney Bruce F. (South Lyon MI), Microprocessor electric vehicle charging and parking meter system structure and method.
Prosser, Ronald; Burchett, Stephen M., Overhead mobile charger system for reaching and charging electric vehicles parked in a pair of adjacent and spaced-part rows of side-by-side parking spaces.
Lowrey, Larkin H.; Borrego, Diego A.; Wettig, Alan; Lightner, Bruce Davis; Banet, Matthew J.; Washicko, Paul; Berkobin, Eric C.; Link, II, Charles M., Peripheral access devices and sensors for use with vehicle telematics devices and systems.
Benayad-Cherif Faycal E. K. (66 Highland Ave. ; #4 Somerville MA 02143) Maddox James F. (55 Hillside Ave. Arlington MA 02174) George ; II Robert W. (2 Karen Rd. Windham NH 03087), Position locating system for a vehicle.
Rodkey, Ryan Scott; Rodkey, John Frank; Ledder, Mark Stephen; Hickey, David Lynn; Ross, Darren Lynn; Ramsey, Ronald F., Power management system for a plurality of at least partially rechargeable vehicles.
Hoshina, Masaki, Service providing system, second connecting part, service providing device, second connecting part control program and service providing device control program.
Pierson Mark V. (65 Hospital Hill Rd. Binghamton NY 13901) Lin How T. (1200 Hartwick La. Binghamton NY 13903), Solar recharge station for electric vehicles.
Joanne T. Woestman ; Prabhakar B. Patil ; Ross M. Stunz ; Thomas E. Pilutti, Strategy to use an on-board navigation system for electric and hybrid electric vehicle energy management.
Chou Paul Bao-Luo ; Iyer Bhavani S. ; Lai Jennifer ; Levas Anthony ; Lieberman Lawrence Isaac ; Liu Te-Kai ; Moskowitz Paul Andrew ; Tang Jung-Mu ; Williams Rose Marie ; Wong Danny Chan-Yong ; Chakra, System and method for vehicle diagnostics and health monitoring.
Ferro, Erica Haefner; Trekell, Mark William; Williamson, Paul Stuart, System for detecting interrupt conditions during an electric vehicle charging process.
Jackson, Dean Kenneth; Klein, Daniel Victor, Systems and methods for updating vehicle behavior and settings based on the locations of vehicle passengers.
Wallace, Charles L.; Basin, Ernest; DeWall, Eric G.; van Gool, Sjef; Somla, Rajendra K.; Deninger, Daniel A.; Woody, Douglas C., Systems and methods for vehicle monitoring with processing interruption tolerance.
Yoshikawa, Kazutaka; Nakamura, Masaki; Mutsuga, Katsuhiko; Ishikawa, Hiroki, Traffic information retrieval method, traffic information retrieval system, mobile communication device, and network navigation center.
Dahl Ernest A. (3247 Breaker Dr. Ventura CA 93003) Barry George H. (21225 Saratoga Hills Saratoga CA 95070), Transformerless battery controlled battery charger.
Kreysler William (363 El Faisan Dr. San Rafael CA 94903) Labesque Serge (2300 Warm Springs Rd. Glen Ellen CA 95442) Jordan Kurt (242 B. Evergreen Ave. Mill Valley CA 94941) Luzaich Mark (925 Birkdale, Underground service bay for vehicles and process for constructing same.
Pollack, Seth B.; Bridges, Seth W.; Kaplan, David L., User interface and user control in a power aggregation system for distributed electric resources.
Dougherty Thomas J. (Waukesha WI) Wruck William J. (Shorewood WI) Johnson Richard J. (Hubertus WI), Vehicle battery system providing battery back-up and opportunity charging.
Murakami, Hiroshi; Yano, Shunji; Nakamura, Kazuhiro; Barth, Matthew James; Todd, Michael Donovan, Vehicle sharing system and method for allocating vehicles based on state of charge.
Obata, Kijuro, Vehicle-to-vehicle communication apparatus, vehicle-to-vehicle communication system, and method of determining applicability of moving image information to an application program.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.