System and method for storing and playback of information for blind users
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G01C-021/20
G09B-021/00
출원번호
US-0664234
(2015-03-20)
등록번호
US-9972216
(2018-05-15)
발명자
/ 주소
Chen, Tiffany L.
출원인 / 주소
TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
대리인 / 주소
Snell & Wilmer
인용정보
피인용 횟수 :
0인용 특허 :
173
초록▼
A system for providing information to a user includes a haptic display including a plurality of sensors positioned thereon, a map positioned on the haptic display and including points of interest where each point of interest is positioned adjacent to or directly on at least one of the plurality of s
A system for providing information to a user includes a haptic display including a plurality of sensors positioned thereon, a map positioned on the haptic display and including points of interest where each point of interest is positioned adjacent to or directly on at least one of the plurality of sensors, and a memory for storing a plurality of breadcrumb files where each of the plurality of breadcrumb files corresponds to at least one of the points of interest and contains information related to at least one of an environment, an object, an obstacle, a path or a location. The system includes a processor for determining which point of interest has been selected based on contact with at least one of the points of interest and an output device configured to provide the information contained in the breadcrumb file corresponding to the selected point of interest to the user.
대표청구항▼
1. A system for providing information to a blind user, comprising: a haptic display including a plurality of display sensors positioned thereon;a map positioned on or superimposed onto the haptic display and including a plurality of points of interest, each point of interest of the plurality of poin
1. A system for providing information to a blind user, comprising: a haptic display including a plurality of display sensors positioned thereon;a map positioned on or superimposed onto the haptic display and including a plurality of points of interest, each point of interest of the plurality of points of interest being positioned adjacent to or directly on at least one of the plurality of display sensors;a memory configured to store a plurality of media files, each media file of the plurality of media files corresponding to at least one of the plurality of points of interest and including information related to at least one of an environment, an object, an obstacle, a path or a location of the at least one of the plurality of points of interest;a media sensor configured to detect new media that is at least one of operator-generated media or media captured from the environment and that corresponds to one of the plurality of points of interest or a new point of interest;an input device configured to receive a media capture request corresponding to a request for the new media to be captured or stored;a processor coupled to the haptic display, the memory, the media sensor, and the input device and configured to: update the plurality of media files to include a new media file that includes the new media when the input device receives the media capture request;control the haptic display to output data indicating which one or more sensor of the plurality of display sensors is associated with at least one stored media file of the plurality of media files, each of the one or more sensor corresponding to a respective point of interest of the plurality of points of interest, anddetermine that the respective point of interest has been selected based on contact of the one or more sensor; andan output device configured to be held or worn by the blind user and configured to output the information included in the stored media file associated with the one or more sensor that corresponds to the respective point of interest. 2. The system of claim 1 wherein the output device is configured to output the information included in the stored media file to the blind user via a combined audio and tactile immersive experience by activating a vibration unit within the output device to generate vibrations while simultaneously reproducing audio from the stored media file. 3. The system of claim 1 wherein each sensor of the plurality of display sensors has an active state and a deactive state and is activated when there is a corresponding media file associated with a particular point of interest and deactivated when there is no corresponding media file associated with the particular point of interest. 4. The system of claim 1 wherein each sensor of the plurality of display sensors is tactile only when there is a corresponding media file associated with a particular point of interest that the user is touching. 5. The system of claim 1 wherein the media sensor is further configured to create or obtain the information related to the at least one of the environment, the object, the obstacle or the location and wherein the information corresponding to at least some of the plurality of media files is provided by the media sensor or by a second media sensor of another user device. 6. The system of claim 5 wherein the media sensor includes at least one of a camera, a computer, a necklace device, a smart phone, a video recorder or a voice recorder capable of creating or obtaining the information. 7. The system of claim 1 further comprising a receiver, coupled to the memory, and configured to receive at least some of the plurality of media files from a cloud storage device. 8. The system of claim 1 wherein the haptic display is a haptic pin display or a haptic vibrating display. 9. The system of claim 1 wherein the haptic display is a haptic pin display including a surface and a plurality of pins each corresponding to one of the plurality of display sensors such that the processor is configured to control the haptic display to output data indicating which one or more sensor is associated with the at least one stored media file by controlling a corresponding pin of each of the one or more sensor that is associated with the at least one stored media file to raise above the surface of the haptic pin display. 10. The system of claim 1 wherein the plurality of display sensors are force sensors that are activated by physical contact by the blind user. 11. A system for providing information to a blind user, comprising: a haptic device including a plurality of display sensors positioned thereon, a surface, and a plurality of pins each corresponding to one of the plurality of display sensors and capable of being raised above the surface;a map positioned on or superimposed onto the haptic device and including a plurality of points of interest, each point of interest of the plurality of points of interest corresponding to at least one of the plurality of display sensors;a memory configured to store a plurality of media files, each media file of the plurality of media files corresponding to at least one of the plurality of points of interest and including information related to at least one of an environment, an object, an obstacle, a path or a location of the at least one of the plurality of points of interest;a media sensor configured to detect new media that is at least one of operator-generated media or media captured from the environment and that corresponds to one of the plurality of points of interest or a new point of interest;an input device configured to receive a media capture request corresponding to a request for the new media to be captured or stored;a processor coupled to the haptic device, the memory, the media sensor, and the input device and configured to: update the plurality of media files to include a new media file that includes the new media when the input device receives the media capture request,control the haptic display to raise a pin corresponding to each of the plurality of display sensors that is associated with a stored media file of the plurality of media files, each of the plurality of display sensors that is associated with a stored media file corresponding to a respective point of interest of the plurality of points of interest, anddetermine that the respective point of interest has been selected based on contact of a respective sensor; anda necklace having a speaker and a vibration unit, configured to be worn by the blind user and configured to provide the information included in the stored media file associated with the respective sensor that corresponds to the respective point of interest to the blind user via a combined audio and tactile immersive experience by activating the vibration unit to generate vibrations while simultaneously reproducing audio from the stored media file using the speaker. 12. The system of claim 11 wherein each sensor of the plurality of display sensors has an active state and a deactive state and is activated when there is a corresponding media file associated with a particular point of interest and deactivated when there is no corresponding media file associated with the particular point of interest. 13. The system of claim 11 wherein each sensor of the plurality of display sensors is tactile only when there is a corresponding media file associated with a particular point of interest that the blind user is touching. 14. The system of claim 11 wherein the input device is further configured to create or obtain the information related to the at least one of the environment, the object, the obstacle or the location, and wherein the information corresponding to at least some of the plurality of media files is provided by the media sensor or by a second media sensor of another user device. 15. The system of claim 14 wherein the media sensor includes at least one of a camera, a computer, a necklace device, a smart phone, a video recorder or a voice recorder capable of creating or obtaining the information. 16. The system of claim 11 further comprising a receiver, coupled to the memory, and configured to receive at least some of the plurality of media files from a cloud storage device. 17. The system of claim 11 wherein the haptic device further includes a haptic vibrating feature. 18. The system of claim 11 wherein the plurality of display sensors are force sensors that are activated by physical contact by the blind user. 19. The system of claim 11 wherein each media file of the plurality of media files includes a title to allow the blind user the ability to listen to the title without having to play the entire media file. 20. The system of claim 11 wherein the memory is further configured to store a table with data indicating the relationship between each point of interest of the plurality of points of interest on the map and at least one of the plurality of display sensors on the haptic device.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (173)
Chao, Hui; Das, Saumitra Mohan; Gupta, Rajarshi; Khorashadi, Behrooz; Sridhara, Vinay; Pakzad, Payam, Adaptive updating of indoor navigation assistance data for use by a mobile device.
Lynt Ingrid H. (7502 Toll Ct. Alexandria VA 22306) Lynt Christopher H. (7502 Toll Ct. Alexandria VA 22306), Apparatus for converting visual images into tactile representations for use by a person who is visually impaired.
Albertson, Jacob C.; Arnold, Kenneth C.; Goldman, Steven D.; Paolini, Michael A.; Sessa, Anthony J., Assisting a vision-impaired user with navigation based on a 3D captured image stream.
Janardhanan, Jayawardan; Dutta, Goutam; Tripuraneni, Varun, Attitude estimation for pedestrian navigation using low cost mems accelerometer in mobile applications, and processing methods, apparatus and systems.
Sawan,Mohamad; Harvey,Jean Fran챌ois; Roy,Martin; Coulombe,Jonathan; Savaria,Yvon; Donfack,Colince, Body electronic implant and artificial vision system thereof.
Kramer James P. (Stanford CA) Lindener Peter (E. Palo Alto CA) George William R. (Palo Alto CA), Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove.
Kurzweil, Raymond C.; Albrecht, Paul; Gashel, James; Gibson, Lucy; Lvovsky, Lev, Gesture processing with low resolution images with high resolution processing for optical character recognition for a reading machine.
Hanson Charles M. (Richardson TX) Koester Vaughn J. (Dallas TX) Fallstrom Robert D. (Richardson TX), Head mounted video display and remote camera system.
Strub, Henry B.; Burgess, David A.; Johnson, Kimberly H.; Cohen, Jonathan R.; Reed, David P., Hybrid recording unit including portable video recorder and auxillary device.
Hirsch Hermann (Hirschstrasse 5 A-9021 Klagenfurt (Karnten) ATX) Pichler Heinrich (Sailerackergasse 38/2 A-1190 Wien (Osterreich) ATX), Information system.
Wellner Pierre D.,GBX ; Flynn Michael J.,GBX ; Carter Kathleen A.,GBX ; Newman William M.,GBX, Interactive desktop display system for automatically adjusting pan and zoom functions in response to user adjustment of a feedback image.
Kretsch Mary J. (Vallejo CA) Gunn Moira A. (San Francisco CA) Fong Alice K. (San Francisco CA), Method and system for measurement of intake of foods, nutrients and other food components in the diet.
Stanford Thomas H. (Escondido CA) Sahne Farhad Noroozi (San Diego CA) Riches Thomas P. (Temecula CA) O\Neill Robert (San Diego CA), Neck engageable transducer support assembly and method of using same.
Jung,Kyung Kwon; Chae,Yeon Sik; Rhee,Jin Koo, Object identification system combined with millimeter-wave passive image system and global positioning system (GPS) for the blind.
Holakovszky Lszl (Beregszsz u.4o/I. Budapest ; 1112 HUX) Endrei Kroly (Fehryri t 86. Budapest 1119 HUX) Kezi Lszl (Zugligeti t 69. Budapest 1121 HUX) Endrei Krolyn (Trogatt 55. Budapest 1021 HUX), Stereoscopic video image display appliance wearable on head like spectacles.
Dieberger, Andreas, System and method for non-visually presenting multi-part information pages using a combination of sonifications and tactile feedback.
Naick, Indran; Spinac, Clifford J.; Sze, Calvin L., Using a display associated with an imaging device to provide instructions to the subjects being recorded.
Lipton Lenny (San Rafael CA) Halnon Jeffrey J. (Richmond CA) Mitchell Larry H. (Cupertino CA) Hursey Robert (Carmel Valley CA), Wireless active eyewear for stereoscopic applications.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.