Method, apparatus, and system for enhancing robustness of predictive video codecs using a side-channel based on distributed source coding techniques
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04B-001/66
H04N-007/12
출원번호
US-0140086
(2005-05-27)
등록번호
US-8331445
(2012-12-11)
발명자
/ 주소
Garudadri, Harinath
Srinivasamurthy, Naveen B.
Chung, Hyukjune
Ramachandran, Kannan
Majumdar, Abhik
출원인 / 주소
QUALCOMM Incorporated
대리인 / 주소
Tam, Kam T.
인용정보
피인용 횟수 :
15인용 특허 :
29
초록▼
A method, apparatus, and system for providing distributed source coding techniques that improve data coding performance, such as video data coding, when channel errors or losses occur. Errors in the reconstruction of the data is eliminated or reduced by sending extra information. Correlation between
A method, apparatus, and system for providing distributed source coding techniques that improve data coding performance, such as video data coding, when channel errors or losses occur. Errors in the reconstruction of the data is eliminated or reduced by sending extra information. Correlation between a predicted sequence and an original sequence can be used to design codebooks and find the cosets required to represent the original image. This information may be sent over another channel, or a secondary channel.
대표청구항▼
1. A wireless communication device comprising: a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding technique, and output a predictive encoded bit-stream;a secondary channel encoder configured to receive the input signal, encode the signal
1. A wireless communication device comprising: a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding technique, and output a predictive encoded bit-stream;a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding technique, and output a secondary channel encoded bit-stream, wherein the secondary channel encoder comprises:a distortion statistics calculator configured to calculate an expected distortion for a current video block based on data associated with the current video block and a packet loss probability; andan encoder module configured to generate the secondary channel encoded-bit stream based on the expected distortion for the current video block. 2. A wireless communication device as defined in claim 1, wherein the predictive encoded bit-stream is transmitted over a main communication channel. 3. A wireless communication device as defined in claim 1, wherein the secondary channel encoded bit-stream is transmitted over a secondary channel communication channel. 4. A wireless communication device as defined in claim 1, wherein the predictive encoding technique is a technique compatible with MPEG-4 standard. 5. A wireless communication device as defined in claim 1, wherein the predictive encoding technique is a technique compatible with H.26x standard. 6. A wireless communication device as defined in claim 1, wherein the secondary channel encoding technique is a technique compatible with Wyner Ziv techniques. 7. A wireless communication device as defined in claim 1, wherein the input signal is a video signal. 8. A wireless communication device as defined in claim 1, wherein the input signal comprises intra-coded blocks of data and inter-coded blocks of data. 9. A wireless communication device as defined in claim 8, wherein Wyner Ziv techniques are applied to the inter-coded data blocks. 10. A wireless communication device as defined in claim 1, wherein the secondary channel encoder will encode the input signal using a predetermined number of cosets. 11. A wireless communication device as defined in claim 10, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream. 12. The device of claim 1, wherein the distortion statistics calculator is further configured to receive an expected reconstructed predictor block for the current video block, and calculate the expected distortion based on data associated with the current video block and the expected reconstructed predictor block, and wherein the expected reconstructed predictor block is based on the packet loss probability. 13. The device of claim 12, wherein the device further comprises: a frame statistics calculator configured to calculate a plurality of expected reconstructed video blocks based on the packet loss probability, wherein each of the expected reconstructed video blocks corresponds to a video block in a video frame, and wherein the distortion statistics calculator is further configured to receive a block within the plurality of expected reconstructed video blocks as the expected reconstructed predictor block for the current video block. 14. The device of claim 13, wherein the frame statistics calculator is further configured to calculate expected reconstructed discrete cosine transform (DCT) coefficients associated with a video block based on the packet loss probability. 15. The device of claim 14, wherein the frame statistics calculator is further configured to calculate the expected reconstructed DCT coefficients for all DCT coefficients within the video block based on the packet loss probability. 16. The device of claim 14, wherein the frame statistics calculator is further configured to calculate the expected reconstructed DCT coefficients for a subset of the DCT coefficients within the video block based on the packet loss probability. 17. The device of claim 13, wherein the frame statistics calculator is further configured to calculate the plurality of expected reconstructed video blocks for a current video frame based on a plurality of expected reconstructed video blocks for a previous frame and the packet loss probability. 18. The device of claim 13, wherein the frame statistics calculator is further configured to calculate an expected reconstructed video block for a video block within a current video frame based on a corresponding expected reconstructed video block for a previous video frame and the packet loss probability. 19. The device of claim 1, wherein the distortion statistics calculator is further configured to calculate the expected distortion for the current video block based on discrete cosine transform (DCT) coefficients associated with the current video block. 20. The device of claim 1, further comprising: a transmitter configured to transmit the predictive encoded bit-stream over a main communication channel, wherein the packet loss probability comprises a probability of losing a packet over the main communication channel. 21. The device of claim 1, wherein the transmitter is further configured to transmit the secondary channel encoded bit-stream over a secondary communication channel, wherein the packet loss probability further comprises a probability of losing a packet over the secondary communication channel. 22. The device of claim 1, further comprising: a transmitter configured to transmit the predictive encoded bit-stream and the secondary channel encoded bit-stream over a single wireless communication channel. 23. The device of claim 1, wherein the transmitter is further configured to transmit the predictive encoded bit-stream over a first logical channel within the single wireless communication channel, and transmit the secondary channel encoded bit-stream over a second logical channel within the single wireless communication channel. 24. The device of claim 1, wherein encoder module is further configured to determine a number of partitions of a source codebook based upon the expected distortion, and generate the secondary channel encoded-bit stream based on the number of partitions of the source codebook. 25. A wireless communication device comprising: an encoder comprising:a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding technique, and output a predictive encoded bit-stream;a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding technique, and output a secondary channel encoded bit-stream, wherein the secondary channel encoder comprises:a distortion statistics calculator configured to calculate an expected distortion for a current video block based data associated with the current video block and a packet loss probability, andan encoder module configured to generate the secondary channel encoded-bit stream based on the expected distortion for the current video block,wherein the wireless communication device further comprises:a decoder comprising:a predictive decoder configured to receive a predictive encoded bit-stream, decode the predictive encoded bit-stream according to the predictive decoding technique, and output a reconstructed signal; anda secondary channel decoder configured to receive a secondary channel encoded bit-stream and the reconstructed signal, decode the secondary channel encoded bit-stream according to a secondary channel decoding technique, andcombine the decoded secondary channel encoded bit-stream and the reconstructed signal to generate and output a final reconstruction of an original signal. 26. A wireless communication device as defined in claim 25, wherein the predictive decoding technique is a technique compatible with MPEG-4 standard. 27. A wireless communication device as defined in claim 25, wherein the predictive decoding technique is a technique compatible with H.26x standard. 28. A wireless communication device as defined in claim 25, wherein the secondary channel decoding technique is a technique compatible with Wyner Ziv techniques. 29. A wireless communication device as defined in claim 25, wherein the input signal is a video signal. 30. A wireless communication device as defined in claim 25, wherein the wireless communication device is a cell phone. 31. A wireless communication device as defined in claim 25, wherein the wireless device is part of a wireless infrastructure. 32. A wireless communication system comprising: a first wireless device comprising:a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding technique, and output a predictive encoded bit-stream representation of the input signal;a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding technique, and output a secondary channel encoded bit-stream representation of the input signal, wherein the secondary channel encoder comprises:a distortion statistics calculator configured to calculate an expected distortion for a current video block based on data associated with the current video block and a packet loss probability, andan encoder module configured to generate the secondary channel encoded-bit stream based on the expected distortion for the current video block,wherein the wireless communication system further comprises:a second wireless device comprising:a predictive decoder configured to receive the predictive encoded bit-stream output by the predictive encoder, decode the predictive encoded bit-stream according to the predictive decoding technique, and output a reconstruction of the input signal; anda secondary channel decoder configured to receive the secondary channel encoded bit-stream output by the secondary channel encoder, decode the secondary channel encoded bit-stream according to a secondary channel decoding technique, and combine the decoded secondary channel encoded bit-stream and the reconstructed signal to generate and output a final reconstruction of the input signal. 33. A wireless communication system as defined in claim 32, wherein the predictive decoding technique is a technique compatible with MPEG-4 standard. 34. A wireless communication system as defined in claim 32, wherein the predictive decoding technique is a technique compatible with H.26x standard. 35. A wireless communication system as defined in claim 32, wherein the secondary channel decoding technique is a technique compatible with Wyner Ziv techniques. 36. A wireless communication system as defined in claim 32, wherein the first wireless communication device is a cell phone. 37. A wireless communication system as defined in claim 32, wherein the first wireless device is part of a wireless communication infrastructure device. 38. A wireless communication system as defined in claim 32, wherein the second wireless communication device is a cell phone. 39. A wireless communication system as defined in claim 32, wherein the second wireless device is part of a wireless communication infrastructure device. 40. A method of encoding data, the method comprising: receiving an input signal;encoding the signal according to a predictive encoding technique, and outputting a predictive encoded bit-stream; andencoding the signal according to a secondary channel encoding technique, and outputting a secondary channel encoded bit-stream, wherein encoding the signal according to the secondary channel encoding technique comprises:calculating an expected distortion for a current video block based on data associated with the current video block and a packet loss probability; andgenerating the secondary channel encoded-bit stream based on the expected distortion for the current video block. 41. A method of encoding as defined in claim 40, wherein the predictive encoding technique is a technique compatible with MPEG-4 standard. 42. A method of encoding as defined in claim 40, wherein the predictive encoding technique is a technique compatible with H.26x standard. 43. A method of encoding as defined in claim 40, wherein the secondary channel encoding technique is a technique compatible with Wyner Ziv techniques. 44. A method of encoding as defined in claim 40, wherein the input signal is a video signal. 45. A method of encoding as defined in claim 40, wherein the input signal comprises intra-coded blocks of data and inter-coded blocks of data. 46. A method of encoding as defined in claim 45, wherein Wyner Ziv techniques are applied to the inter-coded data blocks. 47. A method of encoding as defined in claim 40, wherein the secondary channel encoder will encode the input signal using a predetermined number of cosets. 48. A method of encoding as defined in claim 47, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream. 49. The method of claim 40, wherein calculating the expected distortion for the current video block comprises: receiving an expected reconstructed predictor block for the current video block, wherein the expected reconstructed predictor block is based on the packet loss probability; andcalculating the expected distortion based on data associated with the current video block and the expected reconstructed predictor block. 50. The method of claim 49, wherein receiving the expected reconstructed predictor block comprises: calculating a plurality of expected reconstructed video blocks based on the packet loss probability, wherein each of the expected reconstructed video blocks corresponds to a video block in a video frame; andreceiving a block within the plurality of expected reconstructed video blocks as the expected reconstructed predictor block for the current video block. 51. The method of claim 50, wherein calculating the plurality of expected reconstructed video blocks comprises: calculating expected reconstructed discrete cosine transform (DCT) coefficients associated with a video block based on the packet loss probability. 52. The method of claim 51, wherein calculating expected reconstructed DCT coefficients associated with the video block comprises: calculating the expected reconstructed DCT coefficients for all DCT coefficients within the video block based on the packet loss probability. 53. The method of claim 51, wherein calculating expected reconstructed DCT coefficients associated with the video block comprises: calculating the expected reconstructed DCT coefficients for a subset of the DCT coefficients within the video block of the previous frame based on the packet loss probability. 54. The method of claim 50, wherein calculating the plurality of expected reconstructed video blocks comprises: calculating the plurality of expected reconstructed video blocks for a current video frame based on a plurality of expected reconstructed video blocks for a previous video frame and the packet loss probability. 55. The method of claim 50, wherein calculating the plurality of expected reconstructed video blocks comprises: calculating an expected reconstructed video block for a video block within a current video frame based on a corresponding expected reconstructed video block for a previous video frame and the packet loss probability. 56. The method of claim 40, wherein calculating the expected distortion for the current video block comprises: calculating the expected distortion for the current video block based on discrete cosine transform (DCT) coefficients associated with the current video block. 57. The method of claim 40, further comprising: transmitting the predictive encoded bit-stream over a main communication channel, wherein the packet loss probability comprises a probability of losing a packet over the main communication channel. 58. The method of claim 40, further comprising: transmitting the secondary channel encoded bit-stream over a secondary communication channel, wherein the packet loss probability comprises a probability of losing a packet over the secondary communication channel. 59. The method of claim 40, further comprising: transmitting the predictive encoded bit-stream and the secondary channel encoded bit-stream over a single wireless communication channel. 60. The method of claim 59, wherein transmitting the predictive encoded bit-stream and the secondary channel encoded bit-stream comprises: transmitting the predictive encoded bit-stream over a first logical channel within the single wireless communication channel; andtransmitting the secondary channel encoded bit-stream over a second logical channel within the single wireless communication channel. 61. The method of claim 40, wherein generating the secondary channel encoded-bit stream comprises: determining a number of partitions of a source codebook based upon the expected distortion; andgenerating the secondary channel encoded-bit stream based on the number of partitions of the source codebook. 62. A computer-readable medium comprising instructions that upon execution by a processor cause the processor to: receive an input signal;encode the signal according to a predictive encoding technique, and output a predictive encoded bit-stream; andencode the signal according to a secondary channel encoding technique, and output a secondary channel encoded bit-stream, wherein the instructions that cause the processor to encode the signal according to the secondary channel encoding technique comprise instructions that cause the processor to:calculate an expected distortion for a current video block based on data associated with a the current video block and a packet loss probability; andgenerate the secondary channel encoded-bit stream based on the expected distortion for the current video block. 63. A wireless communication device comprising: means for receiving an input signal;means for encoding the signal according to a predictive encoding technique, and outputting a predictive encoded bit-stream; andmeans for encoding the signal according to a secondary channel encoding technique, and outputting a secondary channel encoded bit-stream, wherein the means for encoding the signal according to the secondary channel encoding technique comprises:means for calculating an expected distortion for a current video block based on data associated with the current video block and a packet loss probability; andmeans for generating the secondary channel encoded-bit stream based on the expected distortion for the current video block.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (29)
Makiyama Takeshi,JPX ; Sato Seiji,JPX ; Koizumi Noritaka,JPX ; Uchiumi Tadashi,JPX, Coding and decoding apparatus which transmits and receives tool information for constructing decoding scheme.
Raisanen, Vilho; Rosti, Jari, Method and apparatus for determining VoIP QoS characteristics of a network using multiple streams of packets and synchronizing measurements of the streams.
Chujoh, Takeshi; Kikuchi, Yoshihiro; Sakuma, Akira; Hayashi, Toshifumi; Kobayashi, Hiroyuki, Method for detecting a moving object in motion video and apparatus therefor.
Peterson Fred M. (401 Varsity Estates Bay N.W. Calgary CAX T3B 2W7 ) Yee James A. (76 Silver Springs Drive ; N.W. Calgary CAX T3B 3G4 ), Motion detection and image acquisition apparatus and method of detecting the motion of and acquiring an image of an obje.
Cho,Hyun Duk; Redkov,Victor V.; Tikhotski,Anatoli I.; Maiboroda,Alexandr L.; Djourinski,Eugene V.; Smolentsev,Sergei V., System and method for coding and decoding picture signals based on a partition table including length information.
Barnes Nigel E. (Stapleford GB3) Bidwell Brian A. (Luton GB3) Bud Andrew (Ivrea ITX) Crisp Malcolm (Over CA GB3) Dudek Michael T. (Agoura CA) Goodings Rupert (Cambridge GB3) Odhams David C. (Epping G, Time division duplex telecommunication system.
Luby, Michael G.; Shokrollahi, Mohammad Amin; Minder, Lorenz Christoph, Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes.
Luby, Michael G.; Shokrollahi, Mohammad Amin; Minder, Lorenz Christoph, Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.