Sound to haptic effect conversion system using waveform
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04B-003/36
G08B-006/00
G06F-003/01
출원번호
US-0175163
(2014-02-07)
등록번호
US-9064387
(2015-06-23)
발명자
/ 주소
Bhatia, Satvir Singh
Gandhi, Kanav
Ullrich, Christopher J.
Cruz-Hernandez, Juan Manuel
Timone, Herve Thu
Lau, Jason Hoi Fun
출원인 / 주소
Immersion Corporation
대리인 / 주소
Miles & Stockbridge P.C.
인용정보
피인용 횟수 :
7인용 특허 :
12
초록▼
A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data f
A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data frame, which defines a magnitude of the haptic signal. The haptic signal is applied to the actuator configured to receive the haptic signal, where the actuator utilizes the haptic signal to generate the one or more haptic effects.
대표청구항▼
1. A computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an audio signal into one or more haptic effects, the converting comprising: receiving a data frame of the audio signal;generating a maximum amplitude value of the data
1. A computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an audio signal into one or more haptic effects, the converting comprising: receiving a data frame of the audio signal;generating a maximum amplitude value of the data frame;transforming the data frame;generating at least one sine carrier waveform that is scaled according to a maximum amplitude value of the transformed data frame;mixing the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame;generating a haptic signal based on the maximum amplitude value of the data frame and the modulated data frame, wherein the maximum amplitude value of the data frame determines whether the haptic signal is generated; andsending the haptic signal to an actuator to generate the one or more haptic effects. 2. The computer-readable medium of claim 1, wherein the modulated data frame defines a waveform of the haptic signal. 3. The computer-readable medium of claim 2, wherein the haptic signal is generated only when the maximum amplitude value of the data frame is greater than a specified threshold. 4. The computer-readable medium of claim 1, wherein the haptic signal comprises a waveform effect. 5. The computer-readable medium of claim 1, wherein transforming the data frame comprises band-pass filtering the data frame. 6. The computer-readable medium of claim 1, wherein transforming the data frame comprises low-pass filtering the data frame. 7. The computer-readable medium of claim 1, the converting further comprising resampling the data frame before the data frame is transformed. 8. The computer-readable medium of claim 1, the converting further comprising boosting the audio signal contained within the data frame after the data frame is transformed. 9. The computer-readable medium of claim 1, the generating at least one sine carrier waveform further comprising: calculating a sine value of the transformed data frame based on a frequency of the transformed data frame and a phase of the transformed data frame; andmultiplying the calculated sine value by the maximum amplitude value of the transformed data frame. 10. The computer-readable medium of claim 1, wherein the transformed data frame is mixed with the at least one sine carrier waveform according to a formula where the mix of the transformed data frame and the at least one sine carrier waveform is normalized. 11. The computer-readable medium of claim 1, the converting further comprising extracting a frequency content from the data frame using a fast fourier transformation of the data frame. 12. The computer-readable medium of claim 1, the converting further comprising extracting a frequency content from the data frame using a band-pass filter. 13. The computer-readable medium of claim 1, the converting further comprising: dividing the data frame into low frequency content, middle frequency content, and high frequency content; andextracting the middle frequency content and high frequency content. 14. A computer-implemented method for converting an audio signal into one or more haptic effects, the computer-implemented method comprising: receiving a data frame of the audio signal;generating a maximum amplitude value of the data frame;transforming the data frame;generating at least one sine carrier waveform that is scaled according to a maximum amplitude value of the transformed data frame;mixing the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame;generating a haptic signal based on the maximum amplitude value of the data frame and the modulated data frame, wherein the maximum amplitude value of the data frame determines whether the haptic signal is generated; andsending the haptic signal to an actuator to generate the one or more haptic effects. 15. The computer-implemented method of claim 14, wherein the modulated data frame defines a waveform of the haptic signal. 16. The computer-implemented method of claim 15, wherein the haptic signal is generated only when the maximum amplitude value of the data frame is greater than a specified threshold. 17. The computer-implemented method of claim 14, wherein the haptic signal comprises a waveform effect. 18. The computer-implemented method of claim 14, wherein transforming the data frame comprises band-pass filtering the data frame. 19. The computer-implemented method of claim 14, further comprising extracting a frequency content from the data frame using a fast fourier transformation of the data frame. 20. The computer-implemented method of claim 14, further comprising extracting a frequency content from the data frame using a band-pass filter. 21. The computer-implemented method of claim 14, further comprising: dividing the data frame into low frequency content, middle frequency content, and high frequency content; andextracting the middle frequency content and high frequency content. 22. A haptic conversion system comprising: a memory configured to store a haptic conversion module, wherein the haptic conversion module comprises a reverb module, a boombox module, and a transformation module;a processor configured to execute the haptic conversion module stored on the memory; andan actuator configured to output one or more haptic effects;wherein the reverb module is configured to receive a data frame of the audio signal;wherein the boombox module is configured to generate a maximum amplitude value of the data frame;wherein the transformation module is configured to transform the data frame;wherein the boombox module is further configured to generate at least one sine carrier waveform that is scaled according to a maximum amplitude value of the transformed data frame;wherein the boombox module is further configured to mix the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame;wherein the reverb module is further configured to generate a haptic signal based on the maximum amplitude value of the data frame and the modulated data frame, wherein the maximum amplitude value of the data frame determines whether the haptic signal is generated; andwherein the reverb module is further configured to send the haptic signal to an actuator to generate the one or more haptic effects. 23. The haptic conversion system of claim 22, wherein the modulated data frame defines a waveform of the haptic signal. 24. The haptic conversion system of claim 23, wherein the reverb module is further configured to generate the haptic signal only when the maximum amplitude value of the data frame is greater than a specified threshold. 25. The haptic conversion system of claim 22, wherein the haptic signal comprises a waveform effect. 26. The haptic conversion system of claim 22, wherein the transformation module further comprises a band-pass filter configured to band-pass filter the data frame. 27. The haptic conversion system of claim 22, wherein the boombox module is further configured to extract a frequency content from the data frame using a fast fourier transformation of the data frame. 28. The haptic conversion system of claim 22, wherein the boombox module is further configured to extract a frequency content from the data frame using a band-pass filter. 29. The haptic conversion system of claim 22, wherein the boombox module is further configured to: divide the data frame into low frequency content, middle frequency content, and high frequency content; andextract the middle frequency content and high frequency content.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (12)
Thorner Craig (16 Nantucket Ct. Howell NJ 07731) Glass Thomas K. (277 Frank Applegate Rd. Jackson NJ 08527), Apparatus and method for generating a control signal for a tactile sensation generator.
Bhatia, Satvir Singh; Gandhi, Kanav; Ullrich, Christopher J.; Cruz-Hernandez, Juan Manuel; Timone, Herve Thu; Lau, Jason Hoi Fun, Sound to haptic effect conversion system using waveform.
Ullrich, Christopher J.; Rank, Stephen D.; Bakircioglu, Munibe M., System and method for automatically producing haptic events from a digital audio file.
Ullrich, Christopher J.; Grant, Danny A.; Rank, Stephen D.; Bakircioglu, Munibe M., System and method for automatically producing haptic events from a digital audio signal.
Chiba Takeshi (Kanagawa JPX), System for efficiently processing digital sound data in accordance with index data of feature quantities of the sound da.
Da Costa, Henry; Timone, Herve Thu; Heubel, Robert; Rank, Stephen; Cruz-Hernandez, Juan Manuel; Grant, Danny, Sound to haptic effect conversion system using multiple actuators.
Da Costa, Henry; Timone, Herve; Heubel, Robert; Rank, Steve; Cruz-Hernandez, Juan Manuel; Grant, Danny, Sound to haptic effect conversion system using multiple actuators.
Bhatia, Satvir Singh; Gandhi, Kanav; Ullrich, Christopher J.; Cruz-Hernandez, Juan Manuel; Timone, Herve Thu; Lau, Jason Hoi Fun, Sound to haptic effect conversion system using waveform.
Bhatia, Satvir Singh; Gandhi, Kanav; Ullrich, Christopher J.; Cruz-Hernandez, Juan Manuel; Timone, Herve Thu; Lau, Jason Hoi Fun, Sound to haptic effect conversion system using waveform.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.